-- Logs begin at Fri 2022-04-29 08:08:10 UTC, end at Fri 2022-04-29 09:16:38 UTC. -- Apr 29 08:42:03.740271 dv-cinder-839872-1-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Apr 29 08:42:03.751866 dv-cinder-839872-1-iscsi devstack@n-api.service[109071]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Apr 29 08:42:03.753875 dv-cinder-839872-1-iscsi devstack@n-api.service[109071]: *** Starting uWSGI 2.0.18-debian (64bit) on [Fri Apr 29 08:42:03 2022] *** Apr 29 08:42:03.753875 dv-cinder-839872-1-iscsi devstack@n-api.service[109071]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Apr 29 08:42:03.753875 dv-cinder-839872-1-iscsi devstack@n-api.service[109071]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Apr 29 08:42:03.753875 dv-cinder-839872-1-iscsi devstack@n-api.service[109071]: nodename: dv-cinder-839872-1-iscsi Apr 29 08:42:03.753875 dv-cinder-839872-1-iscsi devstack@n-api.service[109071]: machine: x86_64 Apr 29 08:42:03.753875 dv-cinder-839872-1-iscsi devstack@n-api.service[109071]: clock source: unix Apr 29 08:42:03.753875 dv-cinder-839872-1-iscsi devstack@n-api.service[109071]: pcre jit disabled Apr 29 08:42:03.753875 dv-cinder-839872-1-iscsi devstack@n-api.service[109071]: detected number of CPU cores: 4 Apr 29 08:42:03.753875 dv-cinder-839872-1-iscsi devstack@n-api.service[109071]: current working directory: / Apr 29 08:42:03.753875 dv-cinder-839872-1-iscsi devstack@n-api.service[109071]: detected binary path: /usr/bin/uwsgi-core Apr 29 08:42:03.754515 dv-cinder-839872-1-iscsi devstack@n-api.service[109071]: your processes number limit is 47680 Apr 29 08:42:03.754515 dv-cinder-839872-1-iscsi devstack@n-api.service[109071]: your memory page size is 4096 bytes Apr 29 08:42:03.754515 dv-cinder-839872-1-iscsi devstack@n-api.service[109071]: detected max file descriptor number: 2048 Apr 29 08:42:03.754515 dv-cinder-839872-1-iscsi devstack@n-api.service[109071]: lock engine: pthread robust mutexes Apr 29 08:42:03.754515 dv-cinder-839872-1-iscsi devstack@n-api.service[109071]: thunder lock: enabled Apr 29 08:42:03.754515 dv-cinder-839872-1-iscsi devstack@n-api.service[109071]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Apr 29 08:42:03.754515 dv-cinder-839872-1-iscsi devstack@n-api.service[109071]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Apr 29 08:42:03.801220 dv-cinder-839872-1-iscsi devstack@n-api.service[109071]: Python main interpreter initialized at 0x55b919e209c0 Apr 29 08:42:03.801220 dv-cinder-839872-1-iscsi devstack@n-api.service[109071]: python threads support enabled Apr 29 08:42:03.801220 dv-cinder-839872-1-iscsi devstack@n-api.service[109071]: your server socket listen backlog is limited to 100 connections Apr 29 08:42:03.801220 dv-cinder-839872-1-iscsi devstack@n-api.service[109071]: your mercy for graceful operations on workers is 90 seconds Apr 29 08:42:03.801642 dv-cinder-839872-1-iscsi devstack@n-api.service[109071]: mapped 403077 bytes (393 KB) for 2 cores Apr 29 08:42:03.801642 dv-cinder-839872-1-iscsi devstack@n-api.service[109071]: *** Operational MODE: preforking *** Apr 29 08:42:03.801917 dv-cinder-839872-1-iscsi devstack@n-api.service[109071]: *** uWSGI is running in multiple interpreter mode *** Apr 29 08:42:03.801917 dv-cinder-839872-1-iscsi devstack@n-api.service[109071]: spawned uWSGI master process (pid: 109071) Apr 29 08:42:03.802126 dv-cinder-839872-1-iscsi systemd[1]: Started Devstack devstack@n-api.service. Apr 29 08:42:03.803556 dv-cinder-839872-1-iscsi devstack@n-api.service[109071]: spawned uWSGI worker 1 (pid: 109072, cores: 1) Apr 29 08:42:03.803556 dv-cinder-839872-1-iscsi devstack@n-api.service[109071]: spawned uWSGI worker 2 (pid: 109073, cores: 1) Apr 29 08:42:03.803556 dv-cinder-839872-1-iscsi devstack@n-api.service[109071]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Apr 29 08:42:05.009221 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Apr 29 08:42:05.014414 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Apr 29 08:42:05.754400 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Apr 29 08:42:05.754400 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: from cryptography.utils import int_from_bytes Apr 29 08:42:05.754674 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Apr 29 08:42:05.754674 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: from cryptography.utils import int_from_bytes Apr 29 08:42:05.754798 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Apr 29 08:42:05.754798 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: from cryptography.utils import int_from_bytes Apr 29 08:42:05.754931 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Apr 29 08:42:05.754931 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: from cryptography.utils import int_from_bytes Apr 29 08:42:08.379645 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Apr 29 08:42:08.380334 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Apr 29 08:42:08.380546 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Apr 29 08:42:08.380917 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Apr 29 08:42:08.381176 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Apr 29 08:42:08.381566 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 08:42:08.381896 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 08:42:08.382219 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 08:42:08.382542 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 08:42:08.382807 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Apr 29 08:42:08.383179 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 08:42:08.383260 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Apr 29 08:42:08.383334 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 08:42:08.383487 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 08:42:08.383622 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Apr 29 08:42:08.383807 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 08:42:08.383998 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Apr 29 08:42:08.384165 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 08:42:08.384272 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Apr 29 08:42:08.384426 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 08:42:08.384668 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 08:42:08.384764 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 08:42:08.385006 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 08:42:08.385093 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-839872-1-iscsi {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 08:42:08.385336 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 08:42:08.385439 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 08:42:08.385662 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 08:42:08.385761 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 08:42:08.385972 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 08:42:08.386056 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 08:42:08.386291 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 08:42:08.386380 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 08:42:08.386598 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 08:42:08.386690 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 08:42:08.386921 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 08:42:08.387008 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 08:42:08.387230 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 08:42:08.387326 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 08:42:08.387506 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 08:42:08.387728 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 08:42:08.387832 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 08:42:08.388331 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-839872-1-iscsi {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 08:42:08.388540 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 08:42:08.388728 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 08:42:08.388862 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 08:42:08.388980 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 08:42:08.389105 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 08:42:08.389310 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 08:42:08.389455 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 08:42:08.389631 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 08:42:08.389779 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 08:42:08.389932 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 08:42:08.390027 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 08:42:08.390253 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 08:42:08.390386 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 08:42:08.390567 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 08:42:08.390655 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 08:42:08.390898 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 08:42:08.391085 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 08:42:08.391264 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 08:42:08.391405 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 08:42:08.391609 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-839872-1-iscsi {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 08:42:08.391723 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 08:42:08.391933 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 08:42:08.392067 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 08:42:08.392308 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 08:42:08.392407 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 08:42:08.392593 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 08:42:08.392730 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 08:42:08.393023 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 08:42:08.393127 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 08:42:08.393336 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 08:42:08.393462 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 08:42:08.393648 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 08:42:08.393734 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 08:42:08.393982 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 08:42:08.394301 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 08:42:08.394301 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 08:42:08.394593 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 08:42:08.394593 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 08:42:08.394933 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-839872-1-iscsi {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 08:42:08.395113 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 08:42:08.395291 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 08:42:08.395455 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 08:42:08.395618 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 08:42:08.395768 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 08:42:08.395917 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 08:42:08.396047 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 08:42:08.396172 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 08:42:08.396279 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 08:42:08.396384 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 08:42:08.396533 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 08:42:08.396676 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 08:42:08.396830 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 08:42:08.396972 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 08:42:08.397133 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 08:42:08.397300 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 08:42:08.397434 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 08:42:08.397643 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 08:42:08.397744 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 08:42:08.397915 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 08:42:08.398000 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 08:42:08.398189 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 08:42:08.398305 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 08:42:08.398516 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 08:42:08.398611 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 08:42:08.398862 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 08:42:08.398952 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 08:42:08.399169 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 08:42:08.399274 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 08:42:08.399413 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 08:42:08.399587 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 08:42:08.399696 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 08:42:08.399833 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 08:42:08.399967 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 08:42:08.400175 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 08:42:08.400313 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 08:42:08.400494 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 08:42:08.400627 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 08:42:08.400805 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 08:42:08.400938 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 08:42:08.401060 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 08:42:08.401247 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 08:42:08.401386 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 08:42:08.401558 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 08:42:08.401689 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 08:42:08.401867 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 08:42:08.402016 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 08:42:08.402174 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 08:42:08.402346 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 08:42:08.402481 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 08:42:08.402604 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 08:42:08.402791 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 08:42:08.402882 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 08:42:08.403111 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 08:42:08.403204 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 08:42:08.403428 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 08:42:08.403513 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 08:42:08.403752 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 08:42:08.403840 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 08:42:08.404722 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 08:42:08.404837 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 08:42:08.405008 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 08:42:08.405168 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 08:42:08.405279 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 08:42:08.405376 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.31 {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 08:42:08.405549 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 08:42:08.405745 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.31 {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 08:42:08.405917 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 08:42:08.406076 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 08:42:08.406236 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 08:42:08.406413 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 08:42:08.406567 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 08:42:08.406717 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 08:42:08.406871 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 08:42:08.407016 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 08:42:08.407153 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 08:42:08.407297 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 08:42:08.407432 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 08:42:08.407563 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 08:42:08.407693 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 08:42:08.407828 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 08:42:08.408000 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 08:42:08.408256 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 08:42:08.408389 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 08:42:08.408472 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.31 {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 08:42:08.408667 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 08:42:08.408756 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.31 {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 08:42:08.408986 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 08:42:08.409086 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 08:42:08.409290 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 08:42:08.409375 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 08:42:08.409544 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 08:42:08.409647 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 08:42:08.409851 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 08:42:08.409949 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 08:42:08.410155 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 08:42:08.410241 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 08:42:08.410475 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 08:42:08.410563 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 08:42:08.410785 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 08:42:08.410875 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 08:42:08.411094 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 08:42:08.411183 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 08:42:08.411403 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 08:42:08.411493 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 08:42:08.411709 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 08:42:08.411799 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 08:42:08.412018 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 08:42:08.412106 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 08:42:08.412351 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 08:42:08.412452 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 08:42:08.412656 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 08:42:08.412745 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 08:42:08.412962 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 08:42:08.413050 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 08:42:08.413270 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 08:42:08.413370 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 08:42:08.413572 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 08:42:08.413657 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 08:42:08.413880 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 08:42:08.413976 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 08:42:08.414186 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 08:42:08.414283 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 08:42:08.414491 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 08:42:08.414580 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 08:42:08.414815 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 08:42:08.414904 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 08:42:08.415128 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 08:42:08.415224 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 08:42:08.415433 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 08:42:08.415518 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 08:42:08.415753 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 08:42:08.415850 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 08:42:08.416038 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 08:42:08.416157 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 08:42:08.416373 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 08:42:08.416470 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 08:42:08.416683 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 08:42:08.416771 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 08:42:08.416989 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 08:42:08.417086 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 08:42:08.417296 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 08:42:08.417380 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 08:42:08.417606 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 08:42:08.417701 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 08:42:08.417908 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 08:42:08.418004 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 08:42:08.418214 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 08:42:08.418300 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 08:42:08.418533 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 08:42:08.418629 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 08:42:08.418842 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 08:42:08.418931 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 08:42:08.419149 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 08:42:08.419246 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 08:42:08.419542 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 08:42:08.420261 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 08:42:08.420501 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 08:42:08.420651 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 08:42:08.420737 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 08:42:08.420863 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 08:42:08.421132 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 08:42:08.421241 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 08:42:08.421378 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 08:42:08.421461 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 08:42:08.421648 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 08:42:08.421738 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 08:42:08.421936 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 08:42:08.422031 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 08:42:08.422240 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 08:42:08.422385 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 08:42:08.422544 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 08:42:08.422639 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 08:42:08.422849 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 08:42:08.422935 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 08:42:08.423151 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 08:42:08.423241 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 08:42:08.423465 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 08:42:08.423601 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 08:42:08.423757 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 08:42:08.423845 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 08:42:08.424080 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 08:42:08.424205 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 08:42:08.424412 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 08:42:08.424501 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 08:42:08.424720 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 08:42:08.424808 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 08:42:08.425028 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 08:42:08.425156 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 08:42:08.425330 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 08:42:08.425416 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 08:42:08.425635 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 08:42:08.425758 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 08:42:08.425954 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 08:42:08.426149 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.426304 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 08:42:08.426454 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.426599 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 08:42:08.426766 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.426928 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 08:42:08.427079 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.427228 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 08:42:08.427390 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.427539 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 08:42:08.427708 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.427858 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 08:42:08.428008 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.428189 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 08:42:08.428355 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.428515 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 08:42:08.428661 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.428811 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 08:42:08.428957 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.429106 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.429256 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.429417 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.429567 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.429713 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.429872 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.430030 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.430175 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.430344 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.430499 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.430645 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.430791 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.431048 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.431143 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.431271 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.431436 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.431580 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.431730 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.431895 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.432091 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.432286 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.432436 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.432609 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.432761 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.432921 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.433069 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.433229 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.433378 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.433540 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.433687 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.433832 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.433991 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.434140 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.434275 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.434377 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.434460 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.434703 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.434875 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.435051 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.435226 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.435392 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.435554 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.435705 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.435870 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.436021 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.436188 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.436339 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.436488 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.436637 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.436804 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.436954 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.437101 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.437245 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.437403 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.437568 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.437729 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.437888 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.438029 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.438118 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.438199 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.438433 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.438598 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.438758 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.438907 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.439068 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.439218 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.439378 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.439537 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.439683 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.439832 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.439979 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.440117 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.440323 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.440469 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.440610 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.440751 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.440904 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.441063 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.441207 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.441378 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.441536 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.441686 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.441832 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.442091 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.442252 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.442401 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.442548 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.442693 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.442836 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.442997 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.443155 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.443282 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.443366 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.443492 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.443710 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.443872 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.444021 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.444212 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.444378 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.444538 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.444698 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.444957 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.445109 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.445321 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.445465 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.445623 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.445845 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.445946 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.446016 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.446016 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.446218 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.446364 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.446521 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.446670 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.446831 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.446980 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.447140 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.447289 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.447443 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.447592 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.447734 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.447890 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.448045 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.448221 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.448389 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.448538 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.448691 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.448839 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.448991 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.449150 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.449298 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.449451 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.449611 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.449757 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.449898 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.450059 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.450199 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.450342 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.450493 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.450637 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.450823 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.451076 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.451227 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.451439 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.451591 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.451736 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.451894 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.452059 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.452290 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.452290 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.452558 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.452704 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.452866 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.453012 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.453158 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.453304 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.453462 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.453614 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.453781 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.453934 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.454081 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.454234 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.454380 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.454529 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.454688 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.454833 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.455035 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.455198 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.455337 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.455479 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.455639 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.455784 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.455924 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.456068 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.456253 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.456418 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.456624 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.456777 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.456872 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.456962 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.457046 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.457154 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.457239 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.457501 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.457598 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.457809 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.457896 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.458120 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.458216 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.458429 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.458524 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.458739 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.458834 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.459085 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.459222 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.459399 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.459542 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.459714 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.459874 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.460018 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.460106 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.460348 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.460436 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.460667 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.460818 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.460973 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.461076 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.461293 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.461382 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.461605 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.461703 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.461927 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.462014 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.462237 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.462324 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.462563 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.462660 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.462875 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.462963 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.463197 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.463285 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.463502 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.463592 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.463818 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.463906 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.464163 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.464255 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.464499 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.464596 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.464816 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.464959 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.465125 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.465265 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.465438 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.465571 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.465749 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.465892 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.466058 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.466196 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.466893 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.467098 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.467233 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.467490 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.467632 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.467839 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.468200 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.468361 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.468487 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.468696 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.468836 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.468989 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.469140 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.469372 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.469468 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.469714 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.469881 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.470029 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.470205 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.470410 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.470595 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.470735 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.470879 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.471077 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.471219 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.471433 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.471526 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.471614 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.471771 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.471986 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.472111 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.472246 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.472495 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.472618 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.472803 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.472897 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.473155 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.473308 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.473455 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.473588 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.473737 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.473896 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.474034 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.474167 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.474298 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.474472 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.474614 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.474809 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.474947 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.475172 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.475312 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.475474 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.475637 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.475772 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.476206 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.476372 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.476484 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.476680 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.476840 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.477006 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.477265 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.477375 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.477557 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.477663 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.477746 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.477897 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.478057 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.478219 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.478374 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.478544 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.478694 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.478852 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.479012 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.479159 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.479327 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.479485 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.479640 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.479797 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.479960 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.480105 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.480309 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.480432 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.480618 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.480739 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.480932 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.481082 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.481256 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.481393 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.481587 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.481698 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.481906 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.482143 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.482314 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.482471 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.482652 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.482783 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.482971 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.483116 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.483288 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.483404 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.483624 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.483709 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.483942 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.484034 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.484281 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.484383 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.484597 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.484683 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.484912 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.485010 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.485252 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.485425 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.485572 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.485721 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.485859 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.486008 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.486172 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.486318 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.486466 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.486601 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.486780 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.486934 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.487077 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.487321 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.487464 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.487599 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.487757 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.487950 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.488116 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.488308 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.488469 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.488583 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.488806 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.488926 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.489182 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.489281 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.489559 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.489653 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.489882 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.489973 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.490209 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.490353 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.490541 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.490640 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.490870 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.491029 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.491249 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.491389 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.491541 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.491639 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.491852 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.491949 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.492213 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.492307 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.492490 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.492579 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.492811 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.493119 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.493274 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.493436 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.493569 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.493711 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.493898 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.494019 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.494233 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.494384 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.494615 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.494781 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.494926 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.495058 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.495206 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.495373 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.495507 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.495638 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.495837 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.495990 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.496167 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.496311 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.496452 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.496589 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.496723 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.496943 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.497080 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.497213 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.497403 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.497539 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.498163 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.498281 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.498460 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.498590 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.498805 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.499133 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.499340 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.499493 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.499641 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.499777 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.499922 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.500059 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.500229 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.500358 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.500492 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.500625 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.500761 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.500892 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.501033 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.501125 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.501302 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.501447 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.501582 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.501718 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.501861 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.501993 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.502161 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.502302 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.502469 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.502616 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.502776 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.502937 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.503174 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.503329 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.503464 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.503610 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.503749 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.503885 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.504027 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.504183 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.504318 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.504466 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.504599 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.504776 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.504916 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.505094 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.505269 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.505416 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.505658 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.505824 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.505969 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.506055 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.506149 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.506313 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.506403 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.506615 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.506705 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.506919 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.507017 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.507228 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.507316 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.507529 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.507617 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.507841 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.507937 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.508156 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.508275 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.508473 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.508572 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.508776 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.508889 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.509080 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.509175 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.509383 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.509476 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.509687 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.509782 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.510001 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.510102 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.510309 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.510402 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.510613 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.510716 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.510916 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.511009 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.511218 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.511311 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.511522 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.511640 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.511825 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.511916 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.512250 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.512345 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.512443 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.512532 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.512776 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.512873 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.513085 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.513243 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.514076 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.514226 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.514422 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.514584 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.514718 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.514819 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.515028 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.515117 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.515336 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.515432 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.515651 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.515791 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.515941 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.516072 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.516288 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.516380 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.516596 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.516696 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.516901 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.516988 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.517223 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.517310 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.517532 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.517657 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.517835 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.517921 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.518144 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.518232 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.518447 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.518559 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.518767 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.518854 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.519080 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.519166 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.519390 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.519485 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.519702 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.519797 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.520015 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.520106 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.520352 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.520444 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.520664 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.520758 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.520971 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.521071 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.521279 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.521366 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.521585 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.521672 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.521898 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.521998 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.522207 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.522294 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.522519 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.522633 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.522826 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.522929 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.523129 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.523217 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.523435 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.523557 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.523748 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.523850 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.524058 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.524167 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.524410 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.524512 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.524733 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.524832 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.525059 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.525155 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.525365 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.525453 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.525674 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.525765 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.525986 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.526077 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.526293 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.526381 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.526605 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.526720 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.526910 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.526998 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.527226 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.527313 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.527536 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.527624 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.527846 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.527992 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.528157 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.528292 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.528483 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.528665 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.528830 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.529406 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.529549 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.529695 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.529874 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.529874 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.530184 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.530184 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.530490 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.530490 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.530776 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.530921 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.531059 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.531195 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.531331 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.531519 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.531717 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.531920 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.532118 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.532391 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.532579 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.532579 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.532968 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.533122 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.533271 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.533271 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.533658 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.533826 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.534018 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.534200 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.534336 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.534469 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.534662 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.534853 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.535014 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.535203 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.535361 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.535496 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.535647 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.535781 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.535924 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.536118 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.536324 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.536505 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.536663 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.536812 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.536812 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.537071 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.537205 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.537352 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.537490 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.537623 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.537755 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.537969 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.538108 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.538255 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.538457 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.538457 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.538736 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.538870 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.539003 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.539149 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.539282 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.539421 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.539557 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.539557 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.539816 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.539961 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.540100 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.540100 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.540390 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.540390 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.540666 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.540801 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.540933 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.541070 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.541203 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.541346 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.541490 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.541675 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.541813 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.542000 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.542135 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.542289 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.542434 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.542601 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.542734 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.542909 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.543042 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.543238 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.543338 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.543565 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.543703 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.543874 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.544007 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.544240 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.544380 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.544591 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.544682 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.544916 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.545128 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.545355 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.545571 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.545807 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.545955 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.546098 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.546233 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.546329 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.546432 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.546649 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.546740 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.546968 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.547057 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.547285 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.547382 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.547616 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.547706 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.547948 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.548036 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.548294 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.548398 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.548608 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.548697 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.548915 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.549010 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.549221 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.549324 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.549543 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.549638 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.549850 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.549949 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.550163 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.550260 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.550474 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.550563 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.550782 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.550870 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.551090 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.551188 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.551405 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.551494 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.551727 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.551822 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.552035 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.552197 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.552385 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.552473 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.552700 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.552810 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.553006 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = None {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.553130 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.553326 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.553477 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.553633 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.553809 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.553956 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.554130 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.554265 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.554444 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.554571 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.554761 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.554862 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.555075 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.555164 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.555387 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.555482 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.555719 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.555820 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.556032 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.556121 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.556377 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.556500 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.556697 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.556788 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.557011 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.557100 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.557327 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.557418 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.557675 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.557765 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.557991 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.558123 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.558309 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.558397 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.558635 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.558733 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.558943 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.559032 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.559250 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.559345 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = None {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.559558 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.559710 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.559864 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.560083 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.560743 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.560973 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.561126 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.561426 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.561649 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.561809 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.561910 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.562051 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.562185 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.562323 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.562461 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.562752 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.562893 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.563041 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.563132 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.563368 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.563521 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.563660 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.563805 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.563955 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.564089 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.564286 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.564431 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.564578 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.564761 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.564902 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.565101 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.565257 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.565421 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.565567 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.565749 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.565899 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.566084 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.566228 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.566398 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.566490 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.566713 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.566857 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.567030 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.567163 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.567342 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.567475 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.567655 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.567789 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.567967 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.568099 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.568314 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.568437 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.568603 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.568691 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.568912 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.569470 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.569673 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.569797 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.569797 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.569999 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.570482 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.570609 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.570717 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.570834 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.570834 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.571035 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.571141 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.571247 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.571353 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.571353 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.571566 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.571680 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.571786 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.571935 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.572060 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.572350 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.572444 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.572788 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.573129 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.573469 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.573828 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.574122 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.574284 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.574443 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.574550 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.574771 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.574886 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.575108 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.575222 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.575459 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.575562 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.575881 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.576047 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.576351 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.576465 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.576689 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.576941 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.577152 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.577302 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.577448 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.577542 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.577755 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.577895 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.578075 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.578282 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.578402 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.578684 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.578863 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.579049 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.579262 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.579403 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.579537 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.579671 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.579806 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.579954 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.580110 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.580350 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.580520 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.580672 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.580887 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.581059 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.581278 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.581543 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.581699 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.581842 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.582058 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.582261 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.582471 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.582663 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.582806 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.582943 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.583088 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.583240 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.583396 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.583543 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.583684 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.583887 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.584044 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.584149 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.584234 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.584338 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.584338 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.584518 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.584609 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.584692 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.584871 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.584966 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.585306 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.585468 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.585617 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.585707 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.585941 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.586042 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.586264 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.586363 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.586585 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.586675 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.586902 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.586994 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.587220 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.587321 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.587542 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.587633 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.587861 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.587950 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.588219 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.588314 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.588513 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.588614 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.588831 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.588921 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.589140 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.589230 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.589464 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.589553 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.589778 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.589878 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.590086 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.590175 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.590407 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.590495 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.590716 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.590995 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.591101 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.591261 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.592099 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.592294 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.592491 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.592734 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.592858 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.593133 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.593221 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.593453 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.593555 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.593763 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.593853 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.594087 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.594175 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.594397 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.594494 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.594705 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.594793 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.595021 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.595109 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.595332 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.595428 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.595638 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.595726 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.595960 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.596068 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.596272 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.596371 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.596597 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.596685 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.596903 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.597038 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.597212 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.597308 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.597515 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.597610 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.597840 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.597936 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.598144 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.598392 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.598482 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.598740 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.598837 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.599050 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.599217 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.599347 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.599432 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.599650 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.599738 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.599953 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.600055 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.600280 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.600372 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.600591 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.600701 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.601138 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.601247 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.601452 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.601540 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.601756 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.601852 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.602066 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.602155 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.602370 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.602466 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.602677 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.602771 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.603018 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.603114 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.603336 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.603425 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.603638 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.603724 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.604014 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.604114 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.604275 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.604383 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.604592 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.604680 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.604915 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.605003 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.605223 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.605310 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.605531 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.605626 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.605848 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.605947 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.606160 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.606256 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.606472 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.606690 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.606782 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.607128 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.607742 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.607958 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.608190 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.608373 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.608510 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.608636 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.608828 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.608930 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.609146 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.609244 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.609467 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.609565 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.609780 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.609876 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.610097 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.610187 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.610446 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.610534 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.610756 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.610855 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.611067 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.611156 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.611376 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.611471 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.611683 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.611772 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.611993 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.612083 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.612340 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.612431 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.612653 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.612773 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.612962 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.613061 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.613272 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.613360 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.613581 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.613678 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.613895 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.614154 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.614243 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.614503 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.614591 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.614831 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.614922 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.615143 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.615231 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.615458 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.615547 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.615772 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.615862 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.616084 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.616205 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.616422 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.616518 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.616732 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.616821 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.617054 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.617160 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.617386 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.617517 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.617696 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.617785 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.618004 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.618094 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.618402 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.618504 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.618718 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.618854 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.619036 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.619126 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.619355 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.619445 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.619661 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.619748 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.619973 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.620063 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.620314 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.620408 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.620624 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.620758 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.620941 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.621028 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.621248 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.621344 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.621576 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.621665 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.621905 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.622006 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.622227 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.622317 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.622552 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.622851 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.623012 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.623190 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.623337 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.623457 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.623542 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.623623 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.623799 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.623898 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.624116 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.624228 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.624447 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.624556 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.624752 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.624842 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.625055 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.625152 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.625365 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.625555 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.625653 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.625880 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.625969 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.626203 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.626292 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.626531 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.626628 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.626833 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.626921 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.627135 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.627274 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.627440 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.627539 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.627744 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.627833 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.628048 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.628197 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.628376 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.628467 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.628680 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.628769 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.628995 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.629093 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.629297 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.629387 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.629601 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.629758 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.629904 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.630046 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.630206 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.630339 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.630509 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.630653 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.630839 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.630969 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.631172 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.631293 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.631485 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.631609 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.631807 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.631906 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.632117 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.632226 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.632461 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.632561 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.632772 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.632870 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.633095 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.633192 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.633415 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.633515 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.633723 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.633822 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.634028 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.634116 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.634334 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.634429 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.634650 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.634739 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.634966 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.635074 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.635263 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.635366 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.635567 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.635664 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.635872 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.636027 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.636204 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.636298 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.636518 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.636609 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.636827 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.636916 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.637135 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.637223 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.637440 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.637532 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.637751 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.637840 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.638070 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.638166 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.638492 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.638613 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.638823 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.639159 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.639264 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.639473 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.639575 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.639784 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.639897 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.640101 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.640242 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.640437 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.640557 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.640751 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.640891 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.641067 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.641223 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.641381 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.641548 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.641711 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.641865 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.642034 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.642272 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.642371 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.642508 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.642671 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.642827 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.643014 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.643146 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.643327 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.643461 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.643668 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.643762 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.643994 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.644089 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.644336 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.644437 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.644653 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.644808 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.644958 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.645095 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.645246 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=109072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Apr 29 08:42:08.645385 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.645675 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.646004 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.646326 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.646643 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.646983 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.647303 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.647619 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.647941 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.648279 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.648599 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.648919 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.649240 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.649575 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.649908 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.650242 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.650574 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.650926 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.651246 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.651596 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.651930 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.652275 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.652598 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.652909 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:42:08.653157 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=109073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Apr 29 08:42:08.668505 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG oslo_db.sqlalchemy.engines [None req-522abd32-9388-4629-886c-fee93d5d0ba0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=109072) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Apr 29 08:42:08.676931 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG oslo_db.sqlalchemy.engines [None req-3b76a4fe-12ab-4932-82ce-9200b7e33af5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=109073) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Apr 29 08:42:08.736470 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.context [None req-522abd32-9388-4629-886c-fee93d5d0ba0 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),57204a03-ce3c-49ae-ada5-166fc5c6d151(cell1) {{(pid=109072) load_cells /opt/stack/nova/nova/context.py:464}} Apr 29 08:42:08.740875 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG oslo_concurrency.lockutils [None req-522abd32-9388-4629-886c-fee93d5d0ba0 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:42:08.741739 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.context [None req-3b76a4fe-12ab-4932-82ce-9200b7e33af5 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),57204a03-ce3c-49ae-ada5-166fc5c6d151(cell1) {{(pid=109073) load_cells /opt/stack/nova/nova/context.py:464}} Apr 29 08:42:08.742464 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG oslo_concurrency.lockutils [None req-522abd32-9388-4629-886c-fee93d5d0ba0 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=109072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:42:08.743260 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG oslo_concurrency.lockutils [None req-522abd32-9388-4629-886c-fee93d5d0ba0 None None] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:42:08.745234 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG oslo_concurrency.lockutils [None req-522abd32-9388-4629-886c-fee93d5d0ba0 None None] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=109072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:42:08.746070 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG oslo_concurrency.lockutils [None req-3b76a4fe-12ab-4932-82ce-9200b7e33af5 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:42:08.747696 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG oslo_concurrency.lockutils [None req-3b76a4fe-12ab-4932-82ce-9200b7e33af5 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=109073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:42:08.748547 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG oslo_concurrency.lockutils [None req-3b76a4fe-12ab-4932-82ce-9200b7e33af5 None None] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:42:08.750493 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG oslo_concurrency.lockutils [None req-3b76a4fe-12ab-4932-82ce-9200b7e33af5 None None] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=109073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:42:08.756005 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG oslo_db.sqlalchemy.engines [None req-522abd32-9388-4629-886c-fee93d5d0ba0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=109072) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Apr 29 08:42:08.759020 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG oslo_db.sqlalchemy.engines [None req-522abd32-9388-4629-886c-fee93d5d0ba0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=109072) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Apr 29 08:42:08.763078 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG oslo_db.sqlalchemy.engines [None req-3b76a4fe-12ab-4932-82ce-9200b7e33af5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=109073) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Apr 29 08:42:08.766487 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG oslo_db.sqlalchemy.engines [None req-3b76a4fe-12ab-4932-82ce-9200b7e33af5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=109073) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Apr 29 08:42:08.931331 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG oslo_db.sqlalchemy.engines [None req-522abd32-9388-4629-886c-fee93d5d0ba0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=109072) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Apr 29 08:42:08.934170 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG oslo_db.sqlalchemy.engines [None req-3b76a4fe-12ab-4932-82ce-9200b7e33af5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=109073) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Apr 29 08:42:09.278057 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: WARNING keystonemiddleware.auth_token [None req-3b76a4fe-12ab-4932-82ce-9200b7e33af5 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 29 08:42:09.280515 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: WARNING keystonemiddleware.auth_token [None req-522abd32-9388-4629-886c-fee93d5d0ba0 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 29 08:42:09.285306 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: WARNING keystonemiddleware.auth_token [None req-3b76a4fe-12ab-4932-82ce-9200b7e33af5 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 29 08:42:09.287151 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: WARNING keystonemiddleware.auth_token [None req-522abd32-9388-4629-886c-fee93d5d0ba0 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 29 08:42:09.634928 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: WARNING keystonemiddleware.auth_token [None req-3b76a4fe-12ab-4932-82ce-9200b7e33af5 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 29 08:42:09.637612 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: WARNING keystonemiddleware.auth_token [None req-522abd32-9388-4629-886c-fee93d5d0ba0 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 29 08:42:09.640493 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: WARNING keystonemiddleware.auth_token [None req-3b76a4fe-12ab-4932-82ce-9200b7e33af5 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 29 08:42:09.643477 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: WARNING keystonemiddleware.auth_token [None req-522abd32-9388-4629-886c-fee93d5d0ba0 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 29 08:42:09.645660 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55b919e209c0 pid: 109073 (default app) Apr 29 08:42:09.647859 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi [None req-3b76a4fe-12ab-4932-82ce-9200b7e33af5 None None] Calling method '>' {{(pid=109073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:42:09.648705 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55b919e209c0 pid: 109072 (default app) Apr 29 08:42:09.649070 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: INFO nova.api.openstack.requestlog [None req-3b76a4fe-12ab-4932-82ce-9200b7e33af5 None None] 10.222.0.31 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001873 Apr 29 08:42:09.649498 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: [pid: 109073|app: 0|req: 1/1] 10.222.0.31 () {50 vars in 788 bytes} [Fri Apr 29 08:42:09 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 29 08:43:30.921593 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi [None req-522abd32-9388-4629-886c-fee93d5d0ba0 None None] Calling method '>' {{(pid=109072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:43:30.923733 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: INFO nova.api.openstack.requestlog [None req-522abd32-9388-4629-886c-fee93d5d0ba0 None None] 10.222.0.31 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.003053 Apr 29 08:43:30.924887 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: [pid: 109072|app: 0|req: 1/2] 10.222.0.31 () {54 vars in 930 bytes} [Fri Apr 29 08:43:30 2022] GET /compute/v2.1 => generated 388 bytes in 7 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 29 08:43:31.354754 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi [None req-4c249107-cb36-4272-af4a-7a0f0f667f82 admin admin] Calling method '>' {{(pid=109073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:43:31.386168 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: INFO nova.api.openstack.requestlog [None req-4c249107-cb36-4272-af4a-7a0f0f667f82 admin admin] 10.222.0.31 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.452925 Apr 29 08:43:31.390313 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: [pid: 109073|app: 0|req: 2/3] 10.222.0.31 () {60 vars in 1291 bytes} [Fri Apr 29 08:43:30 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 08:43:33.770949 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi [None req-522abd32-9388-4629-886c-fee93d5d0ba0 None None] Calling method '>' {{(pid=109072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:43:33.772507 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: INFO nova.api.openstack.requestlog [None req-522abd32-9388-4629-886c-fee93d5d0ba0 None None] 10.222.0.31 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001946 Apr 29 08:43:33.772916 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: [pid: 109072|app: 0|req: 2/4] 10.222.0.31 () {54 vars in 930 bytes} [Fri Apr 29 08:43:33 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 29 08:43:33.834148 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi [None req-896c72cf-aebb-43ae-93af-0831c4382ab9 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "c1", "os-flavor-access:is_public": true, "disk": 1, "name": "cirros256", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "vcpus": 1, "ram": 256}} {{(pid=109073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 29 08:43:33.853279 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 29 08:43:33.853279 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: warnings.warn(msg) Apr 29 08:43:33.883260 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: INFO nova.api.openstack.requestlog [None req-896c72cf-aebb-43ae-93af-0831c4382ab9 admin admin] 10.222.0.31 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.103525 Apr 29 08:43:33.891035 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: [pid: 109073|app: 0|req: 3/5] 10.222.0.31 () {64 vars in 1282 bytes} [Fri Apr 29 08:43:33 2022] POST /compute/v2.1/flavors => generated 407 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 29 08:43:34.101884 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi [None req-826b7e18-d3d1-49f5-b75a-775fc3974308 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 29 08:43:34.104591 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 29 08:43:34.104591 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: warnings.warn(msg) Apr 29 08:43:34.154781 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: INFO nova.api.openstack.requestlog [None req-826b7e18-d3d1-49f5-b75a-775fc3974308 admin admin] 10.222.0.31 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.262474 Apr 29 08:43:34.155626 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: [pid: 109072|app: 0|req: 3/6] 10.222.0.31 () {64 vars in 1335 bytes} [Fri Apr 29 08:43:33 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 08:43:36.497512 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi [None req-896c72cf-aebb-43ae-93af-0831c4382ab9 admin admin] Calling method '>' {{(pid=109073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:43:36.498660 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: INFO nova.api.openstack.requestlog [None req-896c72cf-aebb-43ae-93af-0831c4382ab9 admin admin] 10.222.0.31 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001939 Apr 29 08:43:36.499068 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: [pid: 109073|app: 0|req: 4/7] 10.222.0.31 () {54 vars in 930 bytes} [Fri Apr 29 08:43:36 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 29 08:43:36.609218 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi [None req-6b8f14fd-8541-4e37-9e03-08dc02a3c8e3 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds512M", "OS-FLV-EXT-DATA:ephemeral": 0, "id": "d1", "swap": 0, "disk": 5, "rxtx_factor": 1.0, "vcpus": 1, "os-flavor-access:is_public": true, "ram": 512}} {{(pid=109072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 29 08:43:36.627477 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 29 08:43:36.627477 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: warnings.warn(msg) Apr 29 08:43:36.654790 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: INFO nova.api.openstack.requestlog [None req-6b8f14fd-8541-4e37-9e03-08dc02a3c8e3 admin admin] 10.222.0.31 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.149584 Apr 29 08:43:36.655349 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: [pid: 109072|app: 0|req: 4/8] 10.222.0.31 () {64 vars in 1282 bytes} [Fri Apr 29 08:43:36 2022] POST /compute/v2.1/flavors => generated 404 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 29 08:43:36.667190 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi [None req-32540718-51d9-4552-95e4-3748f7c60c05 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 29 08:43:36.669251 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 29 08:43:36.669251 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: warnings.warn(msg) Apr 29 08:43:36.706663 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: INFO nova.api.openstack.requestlog [None req-32540718-51d9-4552-95e4-3748f7c60c05 admin admin] 10.222.0.31 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.043200 Apr 29 08:43:36.707247 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: [pid: 109073|app: 0|req: 5/9] 10.222.0.31 () {64 vars in 1335 bytes} [Fri Apr 29 08:43:36 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 29 08:43:39.133445 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi [None req-6b8f14fd-8541-4e37-9e03-08dc02a3c8e3 admin admin] Calling method '>' {{(pid=109072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:43:39.134461 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: INFO nova.api.openstack.requestlog [None req-6b8f14fd-8541-4e37-9e03-08dc02a3c8e3 admin admin] 10.222.0.31 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001476 Apr 29 08:43:39.134903 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: [pid: 109072|app: 0|req: 5/10] 10.222.0.31 () {54 vars in 930 bytes} [Fri Apr 29 08:43:39 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 29 08:43:39.211826 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi [None req-1cb048de-04a8-4096-b6be-c3534d8dee53 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds1G", "id": "d2", "rxtx_factor": 1.0, "swap": 0, "disk": 10, "vcpus": 1, "ram": 1024, "os-flavor-access:is_public": true}} {{(pid=109073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 29 08:43:39.233034 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: INFO nova.api.openstack.requestlog [None req-1cb048de-04a8-4096-b6be-c3534d8dee53 admin admin] 10.222.0.31 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.090976 Apr 29 08:43:39.233706 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: [pid: 109073|app: 0|req: 6/11] 10.222.0.31 () {64 vars in 1282 bytes} [Fri Apr 29 08:43:39 2022] POST /compute/v2.1/flavors => generated 404 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Apr 29 08:43:39.245790 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi [None req-7adf49ae-6227-4675-8c06-a60434c8794b admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 29 08:43:39.272744 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: INFO nova.api.openstack.requestlog [None req-7adf49ae-6227-4675-8c06-a60434c8794b admin admin] 10.222.0.31 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030771 Apr 29 08:43:39.273511 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: [pid: 109072|app: 0|req: 6/12] 10.222.0.31 () {64 vars in 1335 bytes} [Fri Apr 29 08:43:39 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 08:43:41.637904 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi [None req-1cb048de-04a8-4096-b6be-c3534d8dee53 admin admin] Calling method '>' {{(pid=109073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:43:41.638927 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: INFO nova.api.openstack.requestlog [None req-1cb048de-04a8-4096-b6be-c3534d8dee53 admin admin] 10.222.0.31 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001987 Apr 29 08:43:41.639665 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: [pid: 109073|app: 0|req: 7/13] 10.222.0.31 () {54 vars in 930 bytes} [Fri Apr 29 08:43:41 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 29 08:43:41.700335 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi [None req-2b2b51e1-9eae-49c5-8df1-65183ef5bba7 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "rxtx_factor": 1.0, "id": "d3", "ram": 2048, "disk": 10, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds2G", "vcpus": 2}} {{(pid=109072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 29 08:43:41.719238 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: INFO nova.api.openstack.requestlog [None req-2b2b51e1-9eae-49c5-8df1-65183ef5bba7 admin admin] 10.222.0.31 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.073704 Apr 29 08:43:41.719869 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: [pid: 109072|app: 0|req: 7/14] 10.222.0.31 () {64 vars in 1282 bytes} [Fri Apr 29 08:43:41 2022] POST /compute/v2.1/flavors => generated 404 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 29 08:43:41.731662 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi [None req-347850fc-0421-46f3-97ff-998d9e086c9b admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 29 08:43:41.754254 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: INFO nova.api.openstack.requestlog [None req-347850fc-0421-46f3-97ff-998d9e086c9b admin admin] 10.222.0.31 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.026419 Apr 29 08:43:41.754857 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: [pid: 109073|app: 0|req: 8/15] 10.222.0.31 () {64 vars in 1335 bytes} [Fri Apr 29 08:43:41 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 08:43:44.097365 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi [None req-2b2b51e1-9eae-49c5-8df1-65183ef5bba7 admin admin] Calling method '>' {{(pid=109072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:43:44.098372 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: INFO nova.api.openstack.requestlog [None req-2b2b51e1-9eae-49c5-8df1-65183ef5bba7 admin admin] 10.222.0.31 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001447 Apr 29 08:43:44.098782 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: [pid: 109072|app: 0|req: 8/16] 10.222.0.31 () {54 vars in 930 bytes} [Fri Apr 29 08:43:44 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 29 08:43:44.156585 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi [None req-802d9b10-c248-4b34-a350-66ad70c77d74 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 4, "ram": 4096, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "name": "ds4G", "disk": 20, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "d4", "swap": 0}} {{(pid=109073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 29 08:43:44.184268 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: INFO nova.api.openstack.requestlog [None req-802d9b10-c248-4b34-a350-66ad70c77d74 admin admin] 10.222.0.31 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.079362 Apr 29 08:43:44.185541 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: [pid: 109073|app: 0|req: 9/17] 10.222.0.31 () {64 vars in 1282 bytes} [Fri Apr 29 08:43:44 2022] POST /compute/v2.1/flavors => generated 404 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 29 08:43:44.197034 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi [None req-d42d6bf2-8547-40a0-b050-e28f9030af4f admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 29 08:43:44.224071 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: INFO nova.api.openstack.requestlog [None req-d42d6bf2-8547-40a0-b050-e28f9030af4f admin admin] 10.222.0.31 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030412 Apr 29 08:43:44.224417 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: [pid: 109072|app: 0|req: 9/18] 10.222.0.31 () {64 vars in 1335 bytes} [Fri Apr 29 08:43:44 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 29 08:43:46.539822 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi [None req-802d9b10-c248-4b34-a350-66ad70c77d74 admin admin] Calling method '>' {{(pid=109073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:43:46.540861 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: INFO nova.api.openstack.requestlog [None req-802d9b10-c248-4b34-a350-66ad70c77d74 admin admin] 10.222.0.31 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001499 Apr 29 08:43:46.541256 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: [pid: 109073|app: 0|req: 10/19] 10.222.0.31 () {54 vars in 930 bytes} [Fri Apr 29 08:43:46 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 29 08:43:46.602097 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi [None req-e48c7011-ca31-4d58-80a6-3a6a2a5befed admin admin] Calling method '>' {{(pid=109072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:43:46.628111 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: INFO nova.api.openstack.requestlog [None req-e48c7011-ca31-4d58-80a6-3a6a2a5befed admin admin] 10.222.0.31 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.079890 Apr 29 08:43:46.628996 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: [pid: 109072|app: 0|req: 10/20] 10.222.0.31 () {60 vars in 1291 bytes} [Fri Apr 29 08:43:46 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 29 08:43:48.990512 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi [None req-802d9b10-c248-4b34-a350-66ad70c77d74 admin admin] Calling method '>' {{(pid=109073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:43:48.992539 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: INFO nova.api.openstack.requestlog [None req-802d9b10-c248-4b34-a350-66ad70c77d74 admin admin] 10.222.0.31 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002765 Apr 29 08:43:48.993133 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: [pid: 109073|app: 0|req: 11/21] 10.222.0.31 () {54 vars in 930 bytes} [Fri Apr 29 08:43:48 2022] GET /compute/v2.1 => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 29 08:43:49.071358 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi [None req-4254b1a2-4862-4021-8465-a16b9d971904 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "os-flavor-access:is_public": true, "ram": 512, "id": "1", "vcpus": 1, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 1, "name": "m1.tiny"}} {{(pid=109072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 29 08:43:49.091136 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: INFO nova.api.openstack.requestlog [None req-4254b1a2-4862-4021-8465-a16b9d971904 admin admin] 10.222.0.31 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.090336 Apr 29 08:43:49.091957 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: [pid: 109072|app: 0|req: 11/22] 10.222.0.31 () {64 vars in 1282 bytes} [Fri Apr 29 08:43:48 2022] POST /compute/v2.1/flavors => generated 402 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Apr 29 08:43:49.103556 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi [None req-5bc0ccaa-16d4-466a-8f38-1de3536d9a0e admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 29 08:43:49.130659 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: INFO nova.api.openstack.requestlog [None req-5bc0ccaa-16d4-466a-8f38-1de3536d9a0e admin admin] 10.222.0.31 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031096 Apr 29 08:43:49.131258 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: [pid: 109073|app: 0|req: 12/23] 10.222.0.31 () {64 vars in 1332 bytes} [Fri Apr 29 08:43:49 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 08:43:51.850386 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi [None req-4254b1a2-4862-4021-8465-a16b9d971904 admin admin] Calling method '>' {{(pid=109072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:43:51.851404 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: INFO nova.api.openstack.requestlog [None req-4254b1a2-4862-4021-8465-a16b9d971904 admin admin] 10.222.0.31 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001473 Apr 29 08:43:51.851809 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: [pid: 109072|app: 0|req: 12/24] 10.222.0.31 () {54 vars in 930 bytes} [Fri Apr 29 08:43:51 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 29 08:43:51.927282 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi [None req-cab68912-f0dc-4ede-a2ac-5d5095180885 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "2", "vcpus": 1, "os-flavor-access:is_public": true, "disk": 20, "rxtx_factor": 1.0, "name": "m1.small", "ram": 2048, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=109073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 29 08:43:51.947357 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: INFO nova.api.openstack.requestlog [None req-cab68912-f0dc-4ede-a2ac-5d5095180885 admin admin] 10.222.0.31 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.088948 Apr 29 08:43:51.947910 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: [pid: 109073|app: 0|req: 13/25] 10.222.0.31 () {64 vars in 1282 bytes} [Fri Apr 29 08:43:51 2022] POST /compute/v2.1/flavors => generated 405 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 29 08:43:51.959796 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi [None req-633bb6b4-81c0-4573-a151-039f75d996b6 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 29 08:43:51.986563 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: INFO nova.api.openstack.requestlog [None req-633bb6b4-81c0-4573-a151-039f75d996b6 admin admin] 10.222.0.31 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030042 Apr 29 08:43:51.987321 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: [pid: 109072|app: 0|req: 13/26] 10.222.0.31 () {64 vars in 1332 bytes} [Fri Apr 29 08:43:51 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 08:43:54.410660 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi [None req-cab68912-f0dc-4ede-a2ac-5d5095180885 admin admin] Calling method '>' {{(pid=109073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:43:54.411670 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: INFO nova.api.openstack.requestlog [None req-cab68912-f0dc-4ede-a2ac-5d5095180885 admin admin] 10.222.0.31 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001462 Apr 29 08:43:54.412072 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: [pid: 109073|app: 0|req: 14/27] 10.222.0.31 () {54 vars in 930 bytes} [Fri Apr 29 08:43:54 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 29 08:43:54.473065 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi [None req-6eafa35d-d79f-47d6-9449-f93b32b88738 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.medium", "os-flavor-access:is_public": true, "ram": 4096, "id": "3", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 40, "rxtx_factor": 1.0, "vcpus": 2}} {{(pid=109072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 29 08:43:54.494102 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: INFO nova.api.openstack.requestlog [None req-6eafa35d-d79f-47d6-9449-f93b32b88738 admin admin] 10.222.0.31 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.075753 Apr 29 08:43:54.494520 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: [pid: 109072|app: 0|req: 14/28] 10.222.0.31 () {64 vars in 1282 bytes} [Fri Apr 29 08:43:54 2022] POST /compute/v2.1/flavors => generated 406 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Apr 29 08:43:54.507685 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi [None req-a0ab5b55-7afe-4e62-9dc4-545bf335a8cb admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 29 08:43:54.532167 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: INFO nova.api.openstack.requestlog [None req-a0ab5b55-7afe-4e62-9dc4-545bf335a8cb admin admin] 10.222.0.31 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028304 Apr 29 08:43:54.533005 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: [pid: 109073|app: 0|req: 15/29] 10.222.0.31 () {64 vars in 1332 bytes} [Fri Apr 29 08:43:54 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 08:43:56.995572 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi [None req-6eafa35d-d79f-47d6-9449-f93b32b88738 admin admin] Calling method '>' {{(pid=109072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:43:56.998383 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: INFO nova.api.openstack.requestlog [None req-6eafa35d-d79f-47d6-9449-f93b32b88738 admin admin] 10.222.0.31 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002997 Apr 29 08:43:56.998743 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: [pid: 109072|app: 0|req: 15/30] 10.222.0.31 () {54 vars in 930 bytes} [Fri Apr 29 08:43:56 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 29 08:43:57.071161 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi [None req-8941158f-ec11-4880-a762-c4164a051239 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 4, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 80, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "name": "m1.large", "swap": 0, "ram": 8192, "id": "4"}} {{(pid=109073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 29 08:43:57.104432 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: INFO nova.api.openstack.requestlog [None req-8941158f-ec11-4880-a762-c4164a051239 admin admin] 10.222.0.31 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.099125 Apr 29 08:43:57.106329 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: [pid: 109073|app: 0|req: 16/31] 10.222.0.31 () {64 vars in 1282 bytes} [Fri Apr 29 08:43:57 2022] POST /compute/v2.1/flavors => generated 405 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 29 08:43:57.119043 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi [None req-1d12337b-e0fc-4c96-9ba0-a710f7d28dfb admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 29 08:43:57.145735 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: INFO nova.api.openstack.requestlog [None req-1d12337b-e0fc-4c96-9ba0-a710f7d28dfb admin admin] 10.222.0.31 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030330 Apr 29 08:43:57.146810 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: [pid: 109072|app: 0|req: 16/32] 10.222.0.31 () {64 vars in 1332 bytes} [Fri Apr 29 08:43:57 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 29 08:43:59.687902 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi [None req-8941158f-ec11-4880-a762-c4164a051239 admin admin] Calling method '>' {{(pid=109073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:43:59.688950 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: INFO nova.api.openstack.requestlog [None req-8941158f-ec11-4880-a762-c4164a051239 admin admin] 10.222.0.31 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001496 Apr 29 08:43:59.689358 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: [pid: 109073|app: 0|req: 17/33] 10.222.0.31 () {54 vars in 930 bytes} [Fri Apr 29 08:43:59 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 29 08:43:59.763413 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi [None req-6603542b-2767-4286-89b3-0205dc7d7070 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "name": "m1.xlarge", "id": "5", "vcpus": 8, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "disk": 160, "ram": 16384}} {{(pid=109072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 29 08:43:59.785092 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: INFO nova.api.openstack.requestlog [None req-6603542b-2767-4286-89b3-0205dc7d7070 admin admin] 10.222.0.31 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.089556 Apr 29 08:43:59.788779 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: [pid: 109072|app: 0|req: 17/34] 10.222.0.31 () {64 vars in 1282 bytes} [Fri Apr 29 08:43:59 2022] POST /compute/v2.1/flavors => generated 408 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Apr 29 08:43:59.797904 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi [None req-af3a9c3c-5c79-41c3-92d1-5518c21ba5bc admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 29 08:43:59.825495 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: INFO nova.api.openstack.requestlog [None req-af3a9c3c-5c79-41c3-92d1-5518c21ba5bc admin admin] 10.222.0.31 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031243 Apr 29 08:43:59.844602 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: [pid: 109073|app: 0|req: 18/35] 10.222.0.31 () {64 vars in 1332 bytes} [Fri Apr 29 08:43:59 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 29 08:44:24.251596 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi [None req-6603542b-2767-4286-89b3-0205dc7d7070 admin admin] Calling method '>' {{(pid=109072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:44:24.252733 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: INFO nova.api.openstack.requestlog [None req-6603542b-2767-4286-89b3-0205dc7d7070 admin admin] 10.222.0.31 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001736 Apr 29 08:44:24.253165 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: [pid: 109072|app: 0|req: 18/36] 10.222.0.31 () {54 vars in 930 bytes} [Fri Apr 29 08:44:24 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 29 08:44:24.316019 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi [None req-23d8c06c-6698-4a5a-a746-b2ba24fd943b admin admin] Calling method '>' {{(pid=109073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:44:24.335209 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: INFO nova.api.openstack.requestlog [None req-23d8c06c-6698-4a5a-a746-b2ba24fd943b admin admin] 10.222.0.31 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.075818 Apr 29 08:44:24.335762 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: [pid: 109073|app: 0|req: 19/37] 10.222.0.31 () {60 vars in 1291 bytes} [Fri Apr 29 08:44:24 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 29 08:44:25.714064 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi [None req-6603542b-2767-4286-89b3-0205dc7d7070 admin admin] Calling method '>' {{(pid=109072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:44:25.715781 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: INFO nova.api.openstack.requestlog [None req-6603542b-2767-4286-89b3-0205dc7d7070 admin admin] 10.222.0.31 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002090 Apr 29 08:44:25.716236 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: [pid: 109072|app: 0|req: 19/38] 10.222.0.31 () {56 vars in 1074 bytes} [Fri Apr 29 08:44:25 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 29 08:44:25.912821 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi [None req-1e9e6270-8877-47e8-b16d-ada234f66396 admin admin] Calling method '>' {{(pid=109073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:44:25.919034 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: INFO nova.api.openstack.wsgi [None req-1e9e6270-8877-47e8-b16d-ada234f66396 admin admin] HTTP exception thrown: Flavor 42 could not be found. Apr 29 08:44:25.919730 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi [None req-1e9e6270-8877-47e8-b16d-ada234f66396 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=109073) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 29 08:44:25.920574 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: INFO nova.api.openstack.requestlog [None req-1e9e6270-8877-47e8-b16d-ada234f66396 admin admin] 10.222.0.31 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.061868 Apr 29 08:44:25.921197 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: [pid: 109073|app: 0|req: 20/39] 10.222.0.31 () {60 vars in 1190 bytes} [Fri Apr 29 08:44:25 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Apr 29 08:44:25.930781 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi [None req-487ad931-11ea-4c40-841d-6e2d75641d8c admin admin] Calling method '>' {{(pid=109072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:44:25.952569 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: INFO nova.api.openstack.requestlog [None req-487ad931-11ea-4c40-841d-6e2d75641d8c admin admin] 10.222.0.31 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.025687 Apr 29 08:44:25.953174 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: [pid: 109072|app: 0|req: 20/40] 10.222.0.31 () {60 vars in 1210 bytes} [Fri Apr 29 08:44:25 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 29 08:44:25.962982 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi [None req-0829e308-2e4c-4408-bab8-01c23a087d4d admin admin] Calling method '>' {{(pid=109073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:44:25.984706 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: INFO nova.api.openstack.requestlog [None req-0829e308-2e4c-4408-bab8-01c23a087d4d admin admin] 10.222.0.31 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.025195 Apr 29 08:44:25.985265 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: [pid: 109073|app: 0|req: 21/41] 10.222.0.31 () {60 vars in 1210 bytes} [Fri Apr 29 08:44:25 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 29 08:44:25.994694 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi [None req-633020db-0a80-405b-8241-ab8795b981dc admin admin] Calling method '>' {{(pid=109072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:44:26.001452 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: INFO nova.api.openstack.wsgi [None req-633020db-0a80-405b-8241-ab8795b981dc admin admin] HTTP exception thrown: Flavor 42 could not be found. Apr 29 08:44:26.002024 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi [None req-633020db-0a80-405b-8241-ab8795b981dc admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=109072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 29 08:44:26.002830 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: INFO nova.api.openstack.requestlog [None req-633020db-0a80-405b-8241-ab8795b981dc admin admin] 10.222.0.31 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.011787 Apr 29 08:44:26.003352 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: [pid: 109072|app: 0|req: 21/42] 10.222.0.31 () {60 vars in 1190 bytes} [Fri Apr 29 08:44:25 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Apr 29 08:44:27.236710 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi [None req-0829e308-2e4c-4408-bab8-01c23a087d4d admin admin] Calling method '>' {{(pid=109073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:44:27.238240 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: INFO nova.api.openstack.requestlog [None req-0829e308-2e4c-4408-bab8-01c23a087d4d admin admin] 10.222.0.31 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002372 Apr 29 08:44:27.238834 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: [pid: 109073|app: 0|req: 22/43] 10.222.0.31 () {56 vars in 1074 bytes} [Fri Apr 29 08:44:27 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 29 08:44:27.450054 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi [None req-62fc4549-d5aa-4971-8186-d7369d59765f admin admin] Calling method '>' {{(pid=109072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:44:27.458118 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: INFO nova.api.openstack.wsgi [None req-62fc4549-d5aa-4971-8186-d7369d59765f admin admin] HTTP exception thrown: Flavor 84 could not be found. Apr 29 08:44:27.459024 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi [None req-62fc4549-d5aa-4971-8186-d7369d59765f admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=109072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 29 08:44:27.460407 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: INFO nova.api.openstack.requestlog [None req-62fc4549-d5aa-4971-8186-d7369d59765f admin admin] 10.222.0.31 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.072753 Apr 29 08:44:27.461294 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: [pid: 109072|app: 0|req: 22/44] 10.222.0.31 () {60 vars in 1190 bytes} [Fri Apr 29 08:44:27 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Apr 29 08:44:27.471462 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi [None req-e8921a7f-781c-4576-bc88-0956156680f7 admin admin] Calling method '>' {{(pid=109073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:44:27.486822 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: INFO nova.api.openstack.requestlog [None req-e8921a7f-781c-4576-bc88-0956156680f7 admin admin] 10.222.0.31 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019007 Apr 29 08:44:27.487411 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: [pid: 109073|app: 0|req: 23/45] 10.222.0.31 () {60 vars in 1210 bytes} [Fri Apr 29 08:44:27 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 29 08:44:27.497902 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi [None req-a0587a67-8f27-41a9-a235-48e84ccba211 admin admin] Calling method '>' {{(pid=109072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:44:27.513011 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: INFO nova.api.openstack.requestlog [None req-a0587a67-8f27-41a9-a235-48e84ccba211 admin admin] 10.222.0.31 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018942 Apr 29 08:44:27.513349 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: [pid: 109072|app: 0|req: 23/46] 10.222.0.31 () {60 vars in 1210 bytes} [Fri Apr 29 08:44:27 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 29 08:44:27.524184 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi [None req-b528910a-4caf-4364-a71f-1d47e47fba41 admin admin] Calling method '>' {{(pid=109073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:44:27.531453 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: INFO nova.api.openstack.wsgi [None req-b528910a-4caf-4364-a71f-1d47e47fba41 admin admin] HTTP exception thrown: Flavor 84 could not be found. Apr 29 08:44:27.532043 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi [None req-b528910a-4caf-4364-a71f-1d47e47fba41 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=109073) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 29 08:44:27.532906 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: INFO nova.api.openstack.requestlog [None req-b528910a-4caf-4364-a71f-1d47e47fba41 admin admin] 10.222.0.31 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.013643 Apr 29 08:44:27.533449 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: [pid: 109073|app: 0|req: 24/47] 10.222.0.31 () {60 vars in 1190 bytes} [Fri Apr 29 08:44:27 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 15 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Apr 29 08:44:28.759093 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi [None req-a0587a67-8f27-41a9-a235-48e84ccba211 admin admin] Calling method '>' {{(pid=109072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:44:28.760096 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: INFO nova.api.openstack.requestlog [None req-a0587a67-8f27-41a9-a235-48e84ccba211 admin admin] 10.222.0.31 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001448 Apr 29 08:44:28.760524 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: [pid: 109072|app: 0|req: 24/48] 10.222.0.31 () {56 vars in 1074 bytes} [Fri Apr 29 08:44:28 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 29 08:44:28.953163 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi [None req-81d9da21-b3c5-4db6-ae01-1f7c60e395ef admin admin] Calling method '>' {{(pid=109073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:44:28.958352 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: INFO nova.api.openstack.wsgi [None req-81d9da21-b3c5-4db6-ae01-1f7c60e395ef admin admin] HTTP exception thrown: Flavor 451 could not be found. Apr 29 08:44:28.958912 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi [None req-81d9da21-b3c5-4db6-ae01-1f7c60e395ef admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=109073) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 29 08:44:28.959695 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: INFO nova.api.openstack.requestlog [None req-81d9da21-b3c5-4db6-ae01-1f7c60e395ef admin admin] 10.222.0.31 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.060975 Apr 29 08:44:28.960222 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: [pid: 109073|app: 0|req: 25/49] 10.222.0.31 () {60 vars in 1193 bytes} [Fri Apr 29 08:44:28 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Apr 29 08:44:28.970142 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi [None req-fbd7e658-fd99-4618-9564-fb8630b7e4eb admin admin] Calling method '>' {{(pid=109072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:44:28.983579 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: INFO nova.api.openstack.requestlog [None req-fbd7e658-fd99-4618-9564-fb8630b7e4eb admin admin] 10.222.0.31 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017081 Apr 29 08:44:28.984151 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: [pid: 109072|app: 0|req: 25/50] 10.222.0.31 () {60 vars in 1210 bytes} [Fri Apr 29 08:44:28 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 29 08:44:28.994030 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi [None req-7e240696-2b51-47c7-bb79-615cb7a3c198 admin admin] Calling method '>' {{(pid=109073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:44:29.006943 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: INFO nova.api.openstack.requestlog [None req-7e240696-2b51-47c7-bb79-615cb7a3c198 admin admin] 10.222.0.31 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.016859 Apr 29 08:44:29.007474 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: [pid: 109073|app: 0|req: 26/51] 10.222.0.31 () {60 vars in 1210 bytes} [Fri Apr 29 08:44:28 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 29 08:44:29.017148 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi [None req-0d4db509-0ad8-4bb6-82b9-8c6fc035c136 admin admin] Calling method '>' {{(pid=109072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:44:29.022292 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: INFO nova.api.openstack.wsgi [None req-0d4db509-0ad8-4bb6-82b9-8c6fc035c136 admin admin] HTTP exception thrown: Flavor 451 could not be found. Apr 29 08:44:29.022849 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi [None req-0d4db509-0ad8-4bb6-82b9-8c6fc035c136 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=109072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 29 08:44:29.023624 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: INFO nova.api.openstack.requestlog [None req-0d4db509-0ad8-4bb6-82b9-8c6fc035c136 admin admin] 10.222.0.31 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.010030 Apr 29 08:44:29.024109 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: [pid: 109072|app: 0|req: 26/52] 10.222.0.31 () {60 vars in 1193 bytes} [Fri Apr 29 08:44:29 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 11 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Apr 29 08:44:30.239695 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi [None req-7e240696-2b51-47c7-bb79-615cb7a3c198 admin admin] Calling method '>' {{(pid=109073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:44:30.240730 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: INFO nova.api.openstack.requestlog [None req-7e240696-2b51-47c7-bb79-615cb7a3c198 admin admin] 10.222.0.31 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001467 Apr 29 08:44:30.241119 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: [pid: 109073|app: 0|req: 27/53] 10.222.0.31 () {56 vars in 1074 bytes} [Fri Apr 29 08:44:30 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 29 08:44:30.432457 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi [None req-8648bc3d-f364-415b-954f-6e9c12a12cfa admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=109072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 29 08:44:30.452047 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: INFO nova.api.openstack.requestlog [None req-8648bc3d-f364-415b-954f-6e9c12a12cfa admin admin] 10.222.0.31 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.074200 Apr 29 08:44:30.452535 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: [pid: 109072|app: 0|req: 27/54] 10.222.0.31 () {64 vars in 1235 bytes} [Fri Apr 29 08:44:30 2022] POST /compute/v2.1/flavors => generated 404 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Apr 29 08:44:31.759196 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi [None req-7e240696-2b51-47c7-bb79-615cb7a3c198 admin admin] Calling method '>' {{(pid=109073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:44:31.760212 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: INFO nova.api.openstack.requestlog [None req-7e240696-2b51-47c7-bb79-615cb7a3c198 admin admin] 10.222.0.31 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001398 Apr 29 08:44:31.760604 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: [pid: 109073|app: 0|req: 28/55] 10.222.0.31 () {56 vars in 1074 bytes} [Fri Apr 29 08:44:31 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 29 08:44:31.954778 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi [None req-3ce4b78f-46e7-46c9-8911-ec93dd6c0795 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=109072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 29 08:44:31.971950 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: INFO nova.api.openstack.requestlog [None req-3ce4b78f-46e7-46c9-8911-ec93dd6c0795 admin admin] 10.222.0.31 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.074736 Apr 29 08:44:31.972465 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: [pid: 109072|app: 0|req: 28/56] 10.222.0.31 () {64 vars in 1235 bytes} [Fri Apr 29 08:44:31 2022] POST /compute/v2.1/flavors => generated 405 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 29 08:44:33.183369 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi [None req-7e240696-2b51-47c7-bb79-615cb7a3c198 admin admin] Calling method '>' {{(pid=109073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:44:33.184991 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: INFO nova.api.openstack.requestlog [None req-7e240696-2b51-47c7-bb79-615cb7a3c198 admin admin] 10.222.0.31 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001971 Apr 29 08:44:33.185343 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: [pid: 109073|app: 0|req: 29/57] 10.222.0.31 () {56 vars in 1074 bytes} [Fri Apr 29 08:44:33 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 29 08:44:33.380276 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi [None req-3cecd64c-7ab2-4190-af02-a6417948a5fb admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=109072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 29 08:44:33.397995 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: INFO nova.api.openstack.requestlog [None req-3cecd64c-7ab2-4190-af02-a6417948a5fb admin admin] 10.222.0.31 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.070294 Apr 29 08:44:33.398537 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: [pid: 109072|app: 0|req: 29/58] 10.222.0.31 () {64 vars in 1235 bytes} [Fri Apr 29 08:44:33 2022] POST /compute/v2.1/flavors => generated 407 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 29 08:44:34.627984 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi [None req-7e240696-2b51-47c7-bb79-615cb7a3c198 admin admin] Calling method '>' {{(pid=109073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:44:34.629012 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: INFO nova.api.openstack.requestlog [None req-7e240696-2b51-47c7-bb79-615cb7a3c198 admin admin] 10.222.0.31 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001441 Apr 29 08:44:34.629402 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: [pid: 109073|app: 0|req: 30/59] 10.222.0.31 () {56 vars in 1074 bytes} [Fri Apr 29 08:44:34 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 29 08:44:34.829504 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi [None req-9611530e-7cee-4b12-9e64-969af3a9423b admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=109072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 29 08:44:34.847000 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: INFO nova.api.openstack.requestlog [None req-9611530e-7cee-4b12-9e64-969af3a9423b admin admin] 10.222.0.31 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.069996 Apr 29 08:44:34.847478 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: [pid: 109072|app: 0|req: 30/60] 10.222.0.31 () {64 vars in 1235 bytes} [Fri Apr 29 08:44:34 2022] POST /compute/v2.1/flavors => generated 409 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 29 08:44:36.071855 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi [None req-7e240696-2b51-47c7-bb79-615cb7a3c198 admin admin] Calling method '>' {{(pid=109073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:44:36.072869 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: INFO nova.api.openstack.requestlog [None req-7e240696-2b51-47c7-bb79-615cb7a3c198 admin admin] 10.222.0.31 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001429 Apr 29 08:44:36.073255 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: [pid: 109073|app: 0|req: 31/61] 10.222.0.31 () {56 vars in 1074 bytes} [Fri Apr 29 08:44:36 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 29 08:44:36.261050 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi [None req-80fdc2ef-21c7-4d91-ac8f-8a73ac9e551b admin admin] Calling method '>' {{(pid=109072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:44:36.281792 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: INFO nova.api.openstack.requestlog [None req-80fdc2ef-21c7-4d91-ac8f-8a73ac9e551b admin admin] 10.222.0.31 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.073025 Apr 29 08:44:36.282563 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: [pid: 109072|app: 0|req: 31/62] 10.222.0.31 () {60 vars in 1202 bytes} [Fri Apr 29 08:44:36 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 29 08:45:39.934338 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi [None req-7e240696-2b51-47c7-bb79-615cb7a3c198 admin admin] Calling method '>' {{(pid=109073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:45:39.935406 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: INFO nova.api.openstack.requestlog [None req-7e240696-2b51-47c7-bb79-615cb7a3c198 admin admin] 10.222.0.31 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001447 Apr 29 08:45:39.935712 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: [pid: 109073|app: 0|req: 32/63] 10.222.0.31 () {54 vars in 930 bytes} [Fri Apr 29 08:45:39 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 29 08:45:40.001626 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi [None req-1f9c2e6a-abff-4d50-88dc-d5e7e3d1684c admin admin] Calling method '>' {{(pid=109072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:45:40.020766 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: INFO nova.api.openstack.requestlog [None req-1f9c2e6a-abff-4d50-88dc-d5e7e3d1684c admin admin] 10.222.0.31 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.078811 Apr 29 08:45:40.021301 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: [pid: 109072|app: 0|req: 32/64] 10.222.0.31 () {60 vars in 1291 bytes} [Fri Apr 29 08:45:39 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 29 08:45:40.044902 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi [None req-3c75dc5d-cb36-4b0c-8441-d4560db8785b admin admin] Calling method '>' {{(pid=109073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:45:40.052506 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: INFO nova.api.openstack.requestlog [None req-3c75dc5d-cb36-4b0c-8441-d4560db8785b admin admin] 10.222.0.31 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013013 Apr 29 08:45:40.053033 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: [pid: 109073|app: 0|req: 33/65] 10.222.0.31 () {60 vars in 1282 bytes} [Fri Apr 29 08:45:40 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 29 08:45:40.064796 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi [None req-40c0dd78-d2d9-4ae6-9517-d82bd1c12e6c admin admin] Calling method '>' {{(pid=109072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:45:40.072606 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: INFO nova.api.openstack.requestlog [None req-40c0dd78-d2d9-4ae6-9517-d82bd1c12e6c admin admin] 10.222.0.31 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011059 Apr 29 08:45:40.073265 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: [pid: 109072|app: 0|req: 33/66] 10.222.0.31 () {60 vars in 1285 bytes} [Fri Apr 29 08:45:40 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 08:45:40.084940 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi [None req-596d40c8-fda4-4879-8a7b-f13a24020e6c admin admin] Calling method '>' {{(pid=109073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:45:40.093066 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: INFO nova.api.openstack.requestlog [None req-596d40c8-fda4-4879-8a7b-f13a24020e6c admin admin] 10.222.0.31 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011680 Apr 29 08:45:40.093591 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: [pid: 109073|app: 0|req: 34/67] 10.222.0.31 () {60 vars in 1285 bytes} [Fri Apr 29 08:45:40 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 08:45:40.105224 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi [None req-4ffa45b5-d228-4b38-813c-54ea7346b440 admin admin] Calling method '>' {{(pid=109072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:45:40.112876 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: INFO nova.api.openstack.requestlog [None req-4ffa45b5-d228-4b38-813c-54ea7346b440 admin admin] 10.222.0.31 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011803 Apr 29 08:45:40.113392 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: [pid: 109072|app: 0|req: 34/68] 10.222.0.31 () {60 vars in 1282 bytes} [Fri Apr 29 08:45:40 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 29 08:47:20.023725 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi [None req-94ecfb51-4dd9-48e5-889d-e4610209d1df tempest-verify_tempest_config-1580436944 tempest-verify_tempest_config-1580436944-project] Calling method '>' {{(pid=109073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:47:20.025782 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: INFO nova.api.openstack.requestlog [None req-94ecfb51-4dd9-48e5-889d-e4610209d1df tempest-verify_tempest_config-1580436944 tempest-verify_tempest_config-1580436944-project] 10.222.0.31 "GET /compute/v2.1/extensions" status: 200 len: 22700 microversion: 2.1 time: 0.111091 Apr 29 08:47:20.026312 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: [pid: 109073|app: 0|req: 35/69] 10.222.0.31 () {58 vars in 1133 bytes} [Fri Apr 29 08:47:19 2022] GET /compute/v2.1/extensions => generated 22700 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 29 08:49:00.449897 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi [None req-4ffa45b5-d228-4b38-813c-54ea7346b440 admin admin] Calling method '>' {{(pid=109072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:49:00.450937 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: INFO nova.api.openstack.requestlog [None req-4ffa45b5-d228-4b38-813c-54ea7346b440 admin admin] 10.222.0.31 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001444 Apr 29 08:49:00.451332 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: [pid: 109072|app: 0|req: 35/70] 10.222.0.31 () {56 vars in 1074 bytes} [Fri Apr 29 08:49:00 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 29 08:49:00.710328 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi [None req-904de26f-85b1-478b-b9b4-a6fa61526e77 admin admin] Calling method '>' {{(pid=109073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:49:00.711495 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 29 08:49:00.711495 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: warnings.warn(msg) Apr 29 08:49:00.712738 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG oslo_concurrency.lockutils [None req-904de26f-85b1-478b-b9b4-a6fa61526e77 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:49:00.713183 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG oslo_concurrency.lockutils [None req-904de26f-85b1-478b-b9b4-a6fa61526e77 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:49:00.713971 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG oslo_concurrency.lockutils [None req-904de26f-85b1-478b-b9b4-a6fa61526e77 admin admin] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:49:00.714402 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG oslo_concurrency.lockutils [None req-904de26f-85b1-478b-b9b4-a6fa61526e77 admin admin] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:49:00.749044 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: INFO nova.api.openstack.requestlog [None req-904de26f-85b1-478b-b9b4-a6fa61526e77 admin admin] 10.222.0.31 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.160106 Apr 29 08:49:00.749604 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: [pid: 109073|app: 0|req: 36/71] 10.222.0.31 () {60 vars in 1193 bytes} [Fri Apr 29 08:49:00 2022] GET /compute/v2.1/os-services => generated 791 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 29 08:49:01.973762 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi [None req-4ffa45b5-d228-4b38-813c-54ea7346b440 admin admin] Calling method '>' {{(pid=109072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:49:01.974774 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: INFO nova.api.openstack.requestlog [None req-4ffa45b5-d228-4b38-813c-54ea7346b440 admin admin] 10.222.0.31 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001497 Apr 29 08:49:01.975184 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: [pid: 109072|app: 0|req: 36/72] 10.222.0.31 () {56 vars in 1074 bytes} [Fri Apr 29 08:49:01 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 29 08:49:02.190721 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi [None req-8badf747-2ef5-4a93-a7ca-e49770a0fddf admin admin] Calling method '>' {{(pid=109073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:49:02.191877 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 29 08:49:02.191877 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: warnings.warn(msg) Apr 29 08:49:02.193075 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG oslo_concurrency.lockutils [None req-8badf747-2ef5-4a93-a7ca-e49770a0fddf admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:49:02.193507 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG oslo_concurrency.lockutils [None req-8badf747-2ef5-4a93-a7ca-e49770a0fddf admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:49:02.194285 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG oslo_concurrency.lockutils [None req-8badf747-2ef5-4a93-a7ca-e49770a0fddf admin admin] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:49:02.194708 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG oslo_concurrency.lockutils [None req-8badf747-2ef5-4a93-a7ca-e49770a0fddf admin admin] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:49:02.213319 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: INFO nova.api.openstack.requestlog [None req-8badf747-2ef5-4a93-a7ca-e49770a0fddf admin admin] 10.222.0.31 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.074564 Apr 29 08:49:02.213878 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: [pid: 109073|app: 0|req: 37/73] 10.222.0.31 () {60 vars in 1193 bytes} [Fri Apr 29 08:49:02 2022] GET /compute/v2.1/os-services => generated 791 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 29 08:49:13.882530 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi [None req-4ffa45b5-d228-4b38-813c-54ea7346b440 admin admin] Calling method '>' {{(pid=109072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:49:13.883557 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: INFO nova.api.openstack.requestlog [None req-4ffa45b5-d228-4b38-813c-54ea7346b440 admin admin] 10.222.0.31 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001456 Apr 29 08:49:13.883950 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: [pid: 109072|app: 0|req: 37/74] 10.222.0.31 () {56 vars in 1074 bytes} [Fri Apr 29 08:49:13 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 29 08:49:14.072414 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi [None req-432d8aed-24d1-460d-920c-91a3eb33dc1d admin admin] Calling method '>' {{(pid=109073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:49:14.073590 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 29 08:49:14.073590 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: warnings.warn(msg) Apr 29 08:49:14.074803 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG oslo_concurrency.lockutils [None req-432d8aed-24d1-460d-920c-91a3eb33dc1d admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:49:14.075250 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG oslo_concurrency.lockutils [None req-432d8aed-24d1-460d-920c-91a3eb33dc1d admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:49:14.076126 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG oslo_concurrency.lockutils [None req-432d8aed-24d1-460d-920c-91a3eb33dc1d admin admin] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:49:14.076584 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG oslo_concurrency.lockutils [None req-432d8aed-24d1-460d-920c-91a3eb33dc1d admin admin] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:49:14.101127 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: INFO nova.api.openstack.requestlog [None req-432d8aed-24d1-460d-920c-91a3eb33dc1d admin admin] 10.222.0.31 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.90 time: 0.079742 Apr 29 08:49:14.101624 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: [pid: 109073|app: 0|req: 38/75] 10.222.0.31 () {60 vars in 1193 bytes} [Fri Apr 29 08:49:14 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 29 08:49:15.333606 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: DEBUG nova.api.openstack.wsgi [None req-4ffa45b5-d228-4b38-813c-54ea7346b440 admin admin] Calling method '>' {{(pid=109072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:49:15.334643 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: INFO nova.api.openstack.requestlog [None req-4ffa45b5-d228-4b38-813c-54ea7346b440 admin admin] 10.222.0.31 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001463 Apr 29 08:49:15.335047 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: [pid: 109072|app: 0|req: 38/76] 10.222.0.31 () {56 vars in 1074 bytes} [Fri Apr 29 08:49:15 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 29 08:49:15.527146 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG nova.api.openstack.wsgi [None req-fe422833-5962-4ea1-a4d8-8a41418fcdc3 admin admin] Calling method '>' {{(pid=109073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:49:15.528334 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 29 08:49:15.528334 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: warnings.warn(msg) Apr 29 08:49:15.530459 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG oslo_concurrency.lockutils [None req-fe422833-5962-4ea1-a4d8-8a41418fcdc3 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:49:15.531055 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG oslo_concurrency.lockutils [None req-fe422833-5962-4ea1-a4d8-8a41418fcdc3 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:49:15.532232 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG oslo_concurrency.lockutils [None req-fe422833-5962-4ea1-a4d8-8a41418fcdc3 admin admin] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:49:15.532828 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: DEBUG oslo_concurrency.lockutils [None req-fe422833-5962-4ea1-a4d8-8a41418fcdc3 admin admin] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:49:15.555724 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: INFO nova.api.openstack.requestlog [None req-fe422833-5962-4ea1-a4d8-8a41418fcdc3 admin admin] 10.222.0.31 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.90 time: 0.081901 Apr 29 08:49:15.556306 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: [pid: 109073|app: 0|req: 39/77] 10.222.0.31 () {60 vars in 1193 bytes} [Fri Apr 29 08:49:15 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 29 08:50:14.623357 dv-cinder-839872-1-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Apr 29 08:50:14.623965 dv-cinder-839872-1-iscsi devstack@n-api.service[109071]: Fri Apr 29 08:50:14 2022 - graceful shutdown triggered... Apr 29 08:50:14.624459 dv-cinder-839872-1-iscsi devstack@n-api.service[109073]: Gracefully killing worker 2 (pid: 109073)... Apr 29 08:50:14.624817 dv-cinder-839872-1-iscsi devstack@n-api.service[109072]: Gracefully killing worker 1 (pid: 109072)... Apr 29 08:50:15.625130 dv-cinder-839872-1-iscsi devstack@n-api.service[109071]: worker 1 buried after 1 seconds Apr 29 08:50:15.625130 dv-cinder-839872-1-iscsi devstack@n-api.service[109071]: worker 2 buried after 1 seconds Apr 29 08:50:15.625130 dv-cinder-839872-1-iscsi devstack@n-api.service[109071]: goodbye to uWSGI. Apr 29 08:50:15.626631 dv-cinder-839872-1-iscsi systemd[1]: devstack@n-api.service: Succeeded. Apr 29 08:50:15.627238 dv-cinder-839872-1-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Apr 29 08:50:15.630026 dv-cinder-839872-1-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Apr 29 08:50:15.643847 dv-cinder-839872-1-iscsi devstack@n-api.service[123440]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Apr 29 08:50:15.660989 dv-cinder-839872-1-iscsi devstack@n-api.service[123440]: *** Starting uWSGI 2.0.18-debian (64bit) on [Fri Apr 29 08:50:15 2022] *** Apr 29 08:50:15.660989 dv-cinder-839872-1-iscsi devstack@n-api.service[123440]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Apr 29 08:50:15.660989 dv-cinder-839872-1-iscsi devstack@n-api.service[123440]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Apr 29 08:50:15.660989 dv-cinder-839872-1-iscsi devstack@n-api.service[123440]: nodename: dv-cinder-839872-1-iscsi Apr 29 08:50:15.660989 dv-cinder-839872-1-iscsi devstack@n-api.service[123440]: machine: x86_64 Apr 29 08:50:15.660989 dv-cinder-839872-1-iscsi devstack@n-api.service[123440]: clock source: unix Apr 29 08:50:15.660989 dv-cinder-839872-1-iscsi devstack@n-api.service[123440]: pcre jit disabled Apr 29 08:50:15.660989 dv-cinder-839872-1-iscsi devstack@n-api.service[123440]: detected number of CPU cores: 4 Apr 29 08:50:15.660989 dv-cinder-839872-1-iscsi devstack@n-api.service[123440]: current working directory: / Apr 29 08:50:15.660989 dv-cinder-839872-1-iscsi devstack@n-api.service[123440]: detected binary path: /usr/bin/uwsgi-core Apr 29 08:50:15.660989 dv-cinder-839872-1-iscsi devstack@n-api.service[123440]: your processes number limit is 47680 Apr 29 08:50:15.660989 dv-cinder-839872-1-iscsi devstack@n-api.service[123440]: your memory page size is 4096 bytes Apr 29 08:50:15.660989 dv-cinder-839872-1-iscsi devstack@n-api.service[123440]: detected max file descriptor number: 2048 Apr 29 08:50:15.660989 dv-cinder-839872-1-iscsi devstack@n-api.service[123440]: lock engine: pthread robust mutexes Apr 29 08:50:15.662131 dv-cinder-839872-1-iscsi devstack@n-api.service[123440]: thunder lock: enabled Apr 29 08:50:15.662131 dv-cinder-839872-1-iscsi devstack@n-api.service[123440]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Apr 29 08:50:15.662131 dv-cinder-839872-1-iscsi devstack@n-api.service[123440]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Apr 29 08:50:15.709288 dv-cinder-839872-1-iscsi devstack@n-api.service[123440]: Python main interpreter initialized at 0x55e0c9fce9c0 Apr 29 08:50:15.709288 dv-cinder-839872-1-iscsi devstack@n-api.service[123440]: python threads support enabled Apr 29 08:50:15.709288 dv-cinder-839872-1-iscsi devstack@n-api.service[123440]: your server socket listen backlog is limited to 100 connections Apr 29 08:50:15.709288 dv-cinder-839872-1-iscsi devstack@n-api.service[123440]: your mercy for graceful operations on workers is 90 seconds Apr 29 08:50:15.709758 dv-cinder-839872-1-iscsi devstack@n-api.service[123440]: mapped 403077 bytes (393 KB) for 2 cores Apr 29 08:50:15.709758 dv-cinder-839872-1-iscsi devstack@n-api.service[123440]: *** Operational MODE: preforking *** Apr 29 08:50:15.710010 dv-cinder-839872-1-iscsi devstack@n-api.service[123440]: *** uWSGI is running in multiple interpreter mode *** Apr 29 08:50:15.710010 dv-cinder-839872-1-iscsi devstack@n-api.service[123440]: spawned uWSGI master process (pid: 123440) Apr 29 08:50:15.710219 dv-cinder-839872-1-iscsi systemd[1]: Started Devstack devstack@n-api.service. Apr 29 08:50:15.711024 dv-cinder-839872-1-iscsi devstack@n-api.service[123440]: spawned uWSGI worker 1 (pid: 123458, cores: 1) Apr 29 08:50:15.712418 dv-cinder-839872-1-iscsi devstack@n-api.service[123440]: spawned uWSGI worker 2 (pid: 123459, cores: 1) Apr 29 08:50:15.712418 dv-cinder-839872-1-iscsi devstack@n-api.service[123440]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Apr 29 08:50:16.971658 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Apr 29 08:50:16.978368 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Apr 29 08:50:17.816086 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Apr 29 08:50:17.816086 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: from cryptography.utils import int_from_bytes Apr 29 08:50:17.816459 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Apr 29 08:50:17.816459 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: from cryptography.utils import int_from_bytes Apr 29 08:50:17.838881 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Apr 29 08:50:17.838881 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: from cryptography.utils import int_from_bytes Apr 29 08:50:17.839305 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Apr 29 08:50:17.839305 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: from cryptography.utils import int_from_bytes Apr 29 08:50:20.276012 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Apr 29 08:50:20.276648 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Apr 29 08:50:20.276849 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Apr 29 08:50:20.277204 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Apr 29 08:50:20.277464 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Apr 29 08:50:20.278002 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 08:50:20.278264 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 08:50:20.278586 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 08:50:20.278999 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 08:50:20.279242 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 08:50:20.279556 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 08:50:20.279894 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 08:50:20.280224 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 08:50:20.280558 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 08:50:20.281292 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 08:50:20.281292 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 08:50:20.281497 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-839872-1-iscsi {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 08:50:20.281763 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 08:50:20.282072 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 08:50:20.282389 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 08:50:20.282705 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 08:50:20.283016 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 08:50:20.283339 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 08:50:20.283649 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 08:50:20.284172 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 08:50:20.284907 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 08:50:20.285224 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 08:50:20.285543 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 08:50:20.285888 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 08:50:20.286205 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 08:50:20.286519 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 08:50:20.286842 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 08:50:20.287155 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 08:50:20.287486 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 08:50:20.287796 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 08:50:20.288248 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-839872-1-iscsi {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 08:50:20.288552 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 08:50:20.288879 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 08:50:20.289195 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 08:50:20.289606 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 08:50:20.289923 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 08:50:20.290234 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 08:50:20.290559 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 08:50:20.290886 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 08:50:20.291199 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 08:50:20.291532 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 08:50:20.291858 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 08:50:20.292204 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 08:50:20.292534 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 08:50:20.292839 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 08:50:20.293152 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 08:50:20.294000 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 08:50:20.294328 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 08:50:20.294650 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 08:50:20.294946 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 08:50:20.295201 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 08:50:20.295511 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 08:50:20.295836 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 08:50:20.296184 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 08:50:20.296518 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 08:50:20.296773 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 08:50:20.297028 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 08:50:20.297354 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 08:50:20.297680 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 08:50:20.297999 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 08:50:20.298311 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 08:50:20.298621 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 08:50:20.298933 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 08:50:20.299241 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 08:50:20.299549 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 08:50:20.299857 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 08:50:20.300185 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 08:50:20.300512 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 08:50:20.300829 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 08:50:20.301153 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 08:50:20.301462 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 08:50:20.301785 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 08:50:20.302188 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.31 {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 08:50:20.302441 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.31 {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 08:50:20.302752 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 08:50:20.303095 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 08:50:20.303432 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 08:50:20.303728 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 08:50:20.304055 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 08:50:20.304405 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 08:50:20.304717 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 08:50:20.305028 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 08:50:20.305338 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 08:50:20.305661 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 08:50:20.305997 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 08:50:20.306304 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 08:50:20.306559 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 08:50:20.306864 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 08:50:20.307170 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 08:50:20.307491 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 08:50:20.307804 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 08:50:20.308110 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 08:50:20.308445 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 08:50:20.308749 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 08:50:20.309669 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 08:50:20.309996 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 08:50:20.310304 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 08:50:20.310615 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 08:50:20.310923 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 08:50:20.311230 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 08:50:20.311538 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 08:50:20.311850 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 08:50:20.312173 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 08:50:20.312500 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 08:50:20.312829 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 08:50:20.313135 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 08:50:20.313442 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 08:50:20.313751 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 08:50:20.314058 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 08:50:20.314447 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 08:50:20.314690 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 08:50:20.314998 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 08:50:20.315321 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 08:50:20.315629 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 08:50:20.315937 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 08:50:20.316282 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 08:50:20.316595 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 08:50:20.316907 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 08:50:20.317233 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 08:50:20.317417 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Apr 29 08:50:20.317902 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 08:50:20.317993 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Apr 29 08:50:20.318104 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 08:50:20.318191 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 08:50:20.318274 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Apr 29 08:50:20.318452 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 08:50:20.318573 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Apr 29 08:50:20.318763 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 08:50:20.318869 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Apr 29 08:50:20.319074 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 08:50:20.319188 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 08:50:20.319380 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 08:50:20.319484 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 08:50:20.319688 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 08:50:20.319823 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 08:50:20.319997 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 08:50:20.320161 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 08:50:20.320337 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 08:50:20.320505 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 08:50:20.320647 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 08:50:20.320823 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 08:50:20.320951 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 08:50:20.321151 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 08:50:20.321257 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 08:50:20.321480 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 08:50:20.321573 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 08:50:20.321826 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 08:50:20.321980 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 08:50:20.322079 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 08:50:20.322173 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 08:50:20.322390 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 08:50:20.322490 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 08:50:20.322720 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-839872-1-iscsi {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 08:50:20.322827 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 08:50:20.323048 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 08:50:20.323151 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.323364 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 08:50:20.323466 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.323681 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 08:50:20.323787 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.324008 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 08:50:20.324120 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.324344 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 08:50:20.324452 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.324710 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 08:50:20.324893 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.325181 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 08:50:20.325279 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.325529 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.325848 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.325949 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 08:50:20.326170 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 08:50:20.326268 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.326483 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.326581 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 08:50:20.326799 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.326906 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 08:50:20.327114 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.327214 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 08:50:20.327437 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.327528 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 08:50:20.327754 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 08:50:20.327854 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.328085 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 08:50:20.328207 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.328512 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.328632 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 08:50:20.328755 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.328883 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 08:50:20.329070 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 08:50:20.329187 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.329382 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.329496 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-839872-1-iscsi {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 08:50:20.329701 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.329800 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 08:50:20.330032 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.330138 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 08:50:20.330356 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.330465 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 08:50:20.330671 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.330806 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 08:50:20.331014 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.331127 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 08:50:20.331364 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.331469 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 08:50:20.331680 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.331778 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 08:50:20.332010 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.332104 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 08:50:20.332364 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.332480 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 08:50:20.332682 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.332773 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 08:50:20.333000 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.333093 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 08:50:20.333322 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.333442 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 08:50:20.333655 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.333764 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 08:50:20.333959 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 08:50:20.334085 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.334274 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 08:50:20.334406 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.334589 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 08:50:20.334778 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.334908 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.335021 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 08:50:20.335215 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 08:50:20.335308 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.335525 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 08:50:20.335625 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.335781 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 08:50:20.335873 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.336094 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 08:50:20.336229 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.336447 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 08:50:20.336546 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.336774 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 08:50:20.336883 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.337103 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.337194 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 08:50:20.337359 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 08:50:20.337450 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.337617 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 08:50:20.337732 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.337944 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 08:50:20.338043 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.338273 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 08:50:20.338372 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.338589 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 08:50:20.338687 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.338987 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 08:50:20.339101 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.339217 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 08:50:20.339321 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.339530 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 08:50:20.339630 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.339842 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 08:50:20.339947 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.340162 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.340292 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 08:50:20.340560 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 08:50:20.340651 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.340971 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.341118 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 08:50:20.341284 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.341399 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 08:50:20.341600 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 08:50:20.341714 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.341913 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.342020 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 08:50:20.342229 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 08:50:20.342354 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.342544 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.342656 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 08:50:20.342855 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.342948 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.31 {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 08:50:20.343168 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.343262 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.31 {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 08:50:20.343486 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 08:50:20.343586 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.343799 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.343966 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 08:50:20.344125 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.344241 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 08:50:20.344484 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.344587 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 08:50:20.344787 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.344902 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 08:50:20.345138 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 08:50:20.345247 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.345429 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 08:50:20.345537 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.345736 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.345836 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 08:50:20.346044 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.346144 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 08:50:20.346362 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.346461 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 08:50:20.346677 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.346845 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 08:50:20.346992 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 08:50:20.347083 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.347249 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 08:50:20.347349 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.347556 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 08:50:20.347662 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.347865 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 08:50:20.347966 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.348214 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 08:50:20.348325 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.348529 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 08:50:20.348634 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.348842 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 08:50:20.348944 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.349157 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 08:50:20.349260 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.349459 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 08:50:20.349559 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.349770 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 08:50:20.349863 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.350084 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 08:50:20.350186 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.350397 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 08:50:20.350499 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.350712 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 08:50:20.350828 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.351021 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 08:50:20.351113 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.351327 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.351418 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 08:50:20.351636 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 08:50:20.351727 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.351940 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.352031 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 08:50:20.352273 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 08:50:20.352386 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.352584 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.352683 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 08:50:20.352896 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.352991 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 08:50:20.353219 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 08:50:20.353353 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.353532 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 08:50:20.353728 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.353829 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 08:50:20.354046 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.354161 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 08:50:20.354423 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.354537 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 08:50:20.354755 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 08:50:20.354895 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.355068 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 08:50:20.355161 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.355397 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 08:50:20.355575 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.355709 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 08:50:20.356513 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.356679 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 08:50:20.356866 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.357098 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 08:50:20.357187 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 08:50:20.357294 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.357487 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 08:50:20.357616 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.357814 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 08:50:20.357963 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.358124 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 08:50:20.358295 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.358439 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 08:50:20.358627 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.358765 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 08:50:20.358948 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.359080 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 08:50:20.359526 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.359631 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 08:50:20.359842 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.359943 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 08:50:20.360182 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.360293 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 08:50:20.360505 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.360599 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 08:50:20.360823 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.360923 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 08:50:20.361149 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.361241 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 08:50:20.361468 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.361636 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 08:50:20.361776 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 08:50:20.361867 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.362097 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.362201 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 08:50:20.362423 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 08:50:20.362522 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.362738 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.362828 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 08:50:20.363520 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 08:50:20.363650 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.363739 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 08:50:20.363832 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.363926 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 08:50:20.364012 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.364096 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.364254 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.364342 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.364427 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.364666 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.364766 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.364995 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.365096 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.365314 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.365413 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.365634 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.365731 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.365951 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.366034 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.366268 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.366349 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.366585 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.366690 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.366903 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.366998 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.367220 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.367319 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.367533 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.367628 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.367848 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.367946 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.368188 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.368294 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.368514 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.368604 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.368826 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.368918 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.369151 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.369250 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.369461 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.369577 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.369782 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.369893 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.370093 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.370184 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.370418 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.370521 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.370736 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.370828 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.371051 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.371151 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.371375 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.371490 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.372267 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.372354 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.372586 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.372756 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.372904 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.373044 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.373214 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.373384 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.373526 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.373723 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.373846 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.374049 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.374164 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.374373 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.374472 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.374698 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.374860 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.375032 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.375128 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.375376 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.375468 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.375688 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.375791 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.375999 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.376098 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.376332 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.376426 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.376647 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.376748 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.376966 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.377063 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.377278 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.377375 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.377597 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.377696 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.377921 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.378091 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.378237 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.378328 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.378544 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.378668 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.378868 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.378968 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.379181 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.379274 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.379490 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.379590 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.379812 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.379935 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.380110 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.380246 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.380526 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.380632 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.380762 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.380854 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.381074 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.381167 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.381393 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.381484 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.381703 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.381804 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.382017 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.382117 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.382337 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.382440 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.382650 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.382742 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.382963 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.383068 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.383288 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.383387 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.383604 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.383695 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.383914 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.384015 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.384253 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.384355 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.384566 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.384668 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.384876 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.384977 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.385187 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.385288 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.385513 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.385620 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.385813 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.385913 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.386126 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.386224 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.386435 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.386581 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.386741 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.386879 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.387068 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.387212 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.387465 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.387596 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.387962 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.388061 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.388309 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.388404 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.388636 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.388737 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.388958 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.389059 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.389280 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.389371 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.389616 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.389717 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.389940 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.390067 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.390264 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.390376 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.390646 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.390753 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.390941 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.391048 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.391251 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.391351 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.391559 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.391649 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.391868 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.391968 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.392208 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.392316 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.392523 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.392615 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.392833 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.392930 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.393140 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.393233 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.393448 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.393581 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.393755 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.393847 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.394064 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.394157 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.394372 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.394464 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.394681 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.394771 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.394996 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.395133 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.395300 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.395399 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.395672 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.395792 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.395913 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.396013 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.396261 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.396370 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.396575 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.396680 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.396882 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.396982 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.397189 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.397280 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.397495 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.397597 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.397838 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.397939 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.398150 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.398249 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.398491 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.398598 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.398824 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.398917 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.399156 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.399247 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.399470 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.399562 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.399779 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.399879 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.400103 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.400267 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.400434 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.400535 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.400760 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.400908 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.401049 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.401245 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.401400 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.401497 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.401663 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.401763 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.401970 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.402062 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.402285 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.402379 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.402597 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.402697 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.403439 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.403630 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.403766 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.404057 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.404259 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.404387 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.404536 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.404689 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.404872 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.405008 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.405235 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.405340 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.405578 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.405707 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.405910 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.405993 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.406220 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.406308 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.406531 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.406627 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.406837 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.406919 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.407149 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.407231 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.407455 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.407545 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.407774 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.407863 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.408086 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.408192 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.408417 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.408507 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.408722 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.408811 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.409034 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.409123 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.409346 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.409436 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.409651 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.409734 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.409979 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.410061 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.410297 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.410390 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.410603 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.410695 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.410911 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.410991 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.411223 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.411312 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.411531 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.411626 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.411837 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.411934 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.412234 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.412322 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.412572 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.412653 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.412894 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.412990 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.413201 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.413282 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.413516 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.413604 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.413827 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.413917 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.414137 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.414218 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.414446 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.414528 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.414758 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.414847 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.415065 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.415154 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.415373 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.415454 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.415682 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.415771 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.416795 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.416909 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.416986 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.417057 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.417141 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.417215 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.417286 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.417356 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.417426 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.417495 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.417575 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.417646 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.417869 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.417950 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.418198 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.418285 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.418597 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.418683 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.418969 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.419266 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.419390 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.419619 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.419726 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.420511 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.420634 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.420841 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.420952 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.421160 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.421255 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.421480 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.421572 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.421799 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.421881 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.422123 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.422213 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.422443 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.422532 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.422766 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.422971 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.423080 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.423283 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.423415 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.423596 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.423741 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.423934 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.424064 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.424276 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.424431 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.424598 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.424752 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.424929 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.425089 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.425260 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.425418 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.425592 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.425736 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.425903 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.426059 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.426208 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.426382 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.426505 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.426701 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.426831 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.427021 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.427117 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.427355 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.427457 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.427674 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.427765 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.427993 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.428083 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.428361 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.428500 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.428675 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.428768 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.428987 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.429087 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.429299 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.429399 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.429613 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.429895 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.429988 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.430219 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.430310 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.430567 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.430714 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.430863 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.430982 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.431173 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.431265 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.431486 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.431586 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.431794 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.431894 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.432106 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.432232 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.432438 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.432539 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.432816 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.432916 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.433136 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.433230 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.433450 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.433543 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.433764 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.433867 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.434115 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.434215 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.434429 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.434521 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.434744 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.434959 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.435059 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.435363 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.435462 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.435675 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.435855 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.436032 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.436308 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.436450 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.436622 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.436748 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.436943 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.437053 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.437255 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.437380 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.437573 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.437717 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.437884 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.438052 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.438214 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.438391 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.438530 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.438750 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.438852 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.439080 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.439172 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.439408 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.439510 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.439736 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.439837 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.440073 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.440219 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.440430 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.440521 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.440774 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.440876 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.441126 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.441228 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.441491 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.441600 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.441753 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.441847 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.442086 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.442268 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.442399 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.442601 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.442707 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.442943 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.443138 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.443289 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.443426 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.443617 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.443728 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.443923 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.444014 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.444263 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.444373 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.444581 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.444687 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.444899 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.445002 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.445216 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.445310 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.445526 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.445619 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.445842 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.445933 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.446154 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.446246 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.446478 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.446605 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.446795 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.446914 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.447107 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.447240 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.447416 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.447584 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.447734 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.448056 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.448315 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.448441 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.448698 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.449003 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.449131 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.449332 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.449516 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.449740 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.449892 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.450029 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.450132 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.450273 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.450467 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.450690 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.450791 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.451015 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.451113 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.451328 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.451420 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.451667 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.451827 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.451987 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.452090 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.452325 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.452433 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.452639 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.452741 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.452957 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.453050 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.453271 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.453379 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.453586 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.453683 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.453906 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.454000 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.454241 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.454473 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.454570 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.454664 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.454865 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.454966 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.455185 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.455292 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.455497 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.455590 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.455811 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.455902 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = None {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.456760 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.456886 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.456976 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.457061 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.457145 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.457242 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.457337 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.457424 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.457503 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.457589 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.457731 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.457808 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.457947 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.458032 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.458280 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.458392 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.458599 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.458715 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.458912 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.459053 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.459225 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.459400 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.459539 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.459745 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.459895 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.460069 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.460254 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.460446 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.460629 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.460788 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.460946 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.461121 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.461270 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.461498 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.461592 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.461956 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.462136 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.462316 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.462455 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.462544 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.462679 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.462820 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.462930 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.463142 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.463304 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.463464 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.463707 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.466751 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.466919 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.467441 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.467633 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.467732 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.467831 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.467966 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.467966 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.468174 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.468263 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.468367 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.468455 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.468455 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.468455 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.468736 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.468876 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.469004 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.469124 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.469260 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.469351 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.469950 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.470114 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.470205 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.470286 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.470372 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.470464 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.470550 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.470647 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.470744 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.470833 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.470918 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.471445 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.471538 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.471644 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.471732 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.471817 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.471909 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.472002 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.472185 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.472292 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.472380 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.472465 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.472549 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.472633 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.472730 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.472816 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.472912 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.473004 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.473004 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.473252 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.473355 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.473443 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.473534 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.473630 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.473723 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.473821 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.473916 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.474011 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.474011 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.474165 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.474307 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.474409 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.474636 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.474739 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.474959 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.475059 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.475279 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.475550 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.475644 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.475899 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.475992 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.476257 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.476355 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.476593 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.476688 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.476924 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.477024 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.477254 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.477346 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.477583 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.477677 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.477913 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.478013 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.478237 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.478335 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.478550 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.478690 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.478867 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.479015 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.479199 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.479334 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.479512 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.479639 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.479824 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.479918 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.480181 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.480296 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.480493 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.480585 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.480806 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.481504 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.481751 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.481861 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.482170 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.482276 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.482491 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.482594 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.482808 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.482901 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.483168 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.483272 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.483498 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.483599 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.483829 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.483922 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.484419 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.484535 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.484759 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.484865 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.485086 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.485192 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.485397 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.485489 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.485720 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.485829 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.486037 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.486153 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.486357 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.486522 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.486685 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.486793 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.487000 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.487096 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.487323 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.487425 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.487636 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.487730 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.487967 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.488060 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.488322 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.488416 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.488645 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.488794 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.488972 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.489114 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.489392 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.489516 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.489724 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.489867 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.490043 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.490192 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.490373 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.490537 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.490710 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.490881 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.491025 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.491212 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.491339 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.491547 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.491640 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.491890 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.491993 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.492235 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.492344 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.492559 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.492653 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.492884 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.493024 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.493208 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.493315 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.493525 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.493626 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.493842 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.493942 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.494153 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.494246 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.494466 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.494560 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.494795 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.494896 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.495107 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.495215 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.495439 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.495660 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.495753 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.496022 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.496126 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = None {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.496377 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.496514 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.496730 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.496831 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.497061 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.497166 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.497382 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.497494 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.497695 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.497796 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.498008 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.498117 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.498320 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.498423 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.498671 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.498765 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.498986 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.499096 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.499314 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.499441 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.499654 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.499744 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.499974 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.500116 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.500324 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.500429 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.500647 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.500740 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.500964 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.501139 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.501287 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.501381 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.501602 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.501695 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.501932 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.502024 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.502245 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.502334 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.502558 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.502645 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.502873 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.502954 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.503185 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.503273 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.503498 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.503580 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.503810 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.503910 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.504125 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.504226 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.504456 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.504561 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.504768 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.504863 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.505079 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.505179 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.505400 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.505499 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.505711 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.505812 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.506032 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.506132 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.506347 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.506448 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.506667 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.506757 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.506960 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.507054 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.507271 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.507379 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.507621 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.507714 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.507932 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.508026 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.508294 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.508408 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.508622 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.508729 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.508952 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.509053 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.509288 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.509390 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.509607 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.509709 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.509940 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.510037 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.510266 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.510360 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.510595 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.510824 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.510918 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.511174 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.511285 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.511508 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.511609 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.511845 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.511945 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.512274 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.512436 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.512591 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.512687 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.512953 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.513059 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.513237 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.513344 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.513568 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.513659 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.513889 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.514133 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.514241 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.514472 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.514566 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.514796 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.514890 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.515118 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.515221 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.515439 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.515534 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.515757 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.515848 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.516075 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.516214 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.516421 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.516513 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.516742 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.516824 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.517057 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.517150 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.517380 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.517513 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.517698 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.517841 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.518029 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.518163 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.518365 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.518469 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.518690 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.518797 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.519017 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.519161 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.519342 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.519476 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.519663 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.519768 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.519982 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.520077 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.520346 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.520443 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.520668 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.520776 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.520983 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.521087 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.521310 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.521433 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.521632 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.521735 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.521946 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.522051 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.522264 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.522387 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.522583 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.522710 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.522904 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.523042 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.523226 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.523373 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.523544 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.523695 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.523860 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.524038 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.524201 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.524402 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.524528 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.524726 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.524859 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.525056 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.525202 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.525379 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.525532 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.525721 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.525856 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.526072 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.526178 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.526414 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.526507 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.526753 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.527008 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.527103 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.527333 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.527479 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.527679 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.528401 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.528625 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.528821 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.528976 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.529121 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.529353 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.529455 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.529539 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.529617 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.529855 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.530065 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.530174 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.530336 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.530487 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.530658 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.530805 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.530978 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.531126 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.531296 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.531440 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.531612 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.531772 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.531923 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.532092 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.532264 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.532430 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.532675 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.532774 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.532988 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.533096 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.533204 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.533519 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.533621 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.533832 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.533951 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.534278 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.534371 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.534618 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.534726 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.534936 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.535037 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.535258 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.535364 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.535568 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.535671 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.535884 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.535998 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.536226 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.536335 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.536545 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.536641 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.536903 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.537012 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.537190 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.537294 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.537502 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.537597 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.537814 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.537908 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.538132 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.538226 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.538449 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.538544 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.538761 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.538861 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.539079 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.539182 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.539389 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.539482 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.539726 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.539832 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.540033 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.540154 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.540369 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.540508 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.540681 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.540811 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.541048 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.541170 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.541316 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.541454 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.541626 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.541881 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.541979 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.542291 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.542510 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.542601 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.542695 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.542835 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.542944 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.543150 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.543244 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.544172 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.544299 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.544505 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.544644 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.544839 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.544979 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.545308 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.545443 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.545668 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.545778 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.546007 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.546112 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.546316 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.546413 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.546632 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.546740 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.546956 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.547058 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.547275 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.547376 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.547602 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.547739 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.547923 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.548030 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.548275 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.548382 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.548632 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.548772 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.548954 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.549064 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.549299 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.549508 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.549664 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.549846 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.549989 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.550177 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.550350 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.550523 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.550687 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.550868 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.551019 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.551195 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.551340 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.551513 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.551735 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.551828 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.552020 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=123458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Apr 29 08:50:20.552233 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.552551 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.552810 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.553129 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.553448 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.553766 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.554085 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.554404 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.554722 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.555039 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.555356 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.555672 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.555989 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.556336 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.556688 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.557015 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.557337 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.557661 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.557985 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.558303 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.558622 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.558938 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.559323 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.559648 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.559988 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.560338 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.560656 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.561095 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.561420 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.561749 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.562081 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.562400 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.562731 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.563064 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.563382 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.563711 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.564031 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.564396 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.564745 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.565084 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.565421 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.565744 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.566059 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.566373 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.566691 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.567019 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.567336 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.567650 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.567962 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.568302 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.568614 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.568927 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.569238 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.569548 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.569863 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.570177 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.570533 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.570793 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.571110 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.571417 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.571723 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.572044 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.572383 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.572698 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.572994 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.573307 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.573616 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.573960 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.574304 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.574667 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.575169 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.575494 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.575832 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.575972 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_db.sqlalchemy.engines [None req-029a712a-6dce-4528-80c7-710356475e97 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=123458) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Apr 29 08:50:20.576305 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.576501 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.576852 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.577166 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.577487 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.577829 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.578150 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.578471 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.578864 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.579116 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.579437 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.579758 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.580092 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.580470 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.580782 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.581118 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.581449 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.581779 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.582104 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.582422 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.582757 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.583077 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.583396 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.583718 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.584036 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.584380 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.584707 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.585031 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.585369 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.585720 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.586037 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.586374 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.586736 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.587060 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.587415 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.587753 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.588079 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.588424 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.588738 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 08:50:20.588998 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=123459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Apr 29 08:50:20.614309 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_db.sqlalchemy.engines [None req-72cdb1c4-869c-4ad3-a1cd-ce8a8d4f6ddb None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=123459) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Apr 29 08:50:20.644497 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.context [None req-029a712a-6dce-4528-80c7-710356475e97 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),57204a03-ce3c-49ae-ada5-166fc5c6d151(cell1) {{(pid=123458) load_cells /opt/stack/nova/nova/context.py:464}} Apr 29 08:50:20.649429 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-029a712a-6dce-4528-80c7-710356475e97 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:50:20.651043 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-029a712a-6dce-4528-80c7-710356475e97 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:50:20.651853 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-029a712a-6dce-4528-80c7-710356475e97 None None] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:50:20.654009 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-029a712a-6dce-4528-80c7-710356475e97 None None] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:50:20.666739 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_db.sqlalchemy.engines [None req-029a712a-6dce-4528-80c7-710356475e97 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=123458) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Apr 29 08:50:20.667611 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_db.sqlalchemy.engines [None req-029a712a-6dce-4528-80c7-710356475e97 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=123458) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Apr 29 08:50:20.681945 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.context [None req-72cdb1c4-869c-4ad3-a1cd-ce8a8d4f6ddb None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),57204a03-ce3c-49ae-ada5-166fc5c6d151(cell1) {{(pid=123459) load_cells /opt/stack/nova/nova/context.py:464}} Apr 29 08:50:20.686941 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-72cdb1c4-869c-4ad3-a1cd-ce8a8d4f6ddb None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:50:20.688586 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-72cdb1c4-869c-4ad3-a1cd-ce8a8d4f6ddb None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:50:20.689393 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-72cdb1c4-869c-4ad3-a1cd-ce8a8d4f6ddb None None] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:50:20.691617 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-72cdb1c4-869c-4ad3-a1cd-ce8a8d4f6ddb None None] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:50:20.703802 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_db.sqlalchemy.engines [None req-72cdb1c4-869c-4ad3-a1cd-ce8a8d4f6ddb None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=123459) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Apr 29 08:50:20.707631 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_db.sqlalchemy.engines [None req-72cdb1c4-869c-4ad3-a1cd-ce8a8d4f6ddb None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=123459) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Apr 29 08:50:20.838088 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_db.sqlalchemy.engines [None req-029a712a-6dce-4528-80c7-710356475e97 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=123458) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Apr 29 08:50:20.872404 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_db.sqlalchemy.engines [None req-72cdb1c4-869c-4ad3-a1cd-ce8a8d4f6ddb None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=123459) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Apr 29 08:50:21.169588 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: WARNING keystonemiddleware.auth_token [None req-029a712a-6dce-4528-80c7-710356475e97 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 29 08:50:21.176281 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: WARNING keystonemiddleware.auth_token [None req-029a712a-6dce-4528-80c7-710356475e97 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 29 08:50:21.198807 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: WARNING keystonemiddleware.auth_token [None req-72cdb1c4-869c-4ad3-a1cd-ce8a8d4f6ddb None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 29 08:50:21.206031 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: WARNING keystonemiddleware.auth_token [None req-72cdb1c4-869c-4ad3-a1cd-ce8a8d4f6ddb None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 29 08:50:21.534490 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: WARNING keystonemiddleware.auth_token [None req-029a712a-6dce-4528-80c7-710356475e97 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 29 08:50:21.539661 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: WARNING keystonemiddleware.auth_token [None req-029a712a-6dce-4528-80c7-710356475e97 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 29 08:50:21.545181 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55e0c9fce9c0 pid: 123458 (default app) Apr 29 08:50:21.554318 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: WARNING keystonemiddleware.auth_token [None req-72cdb1c4-869c-4ad3-a1cd-ce8a8d4f6ddb None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 29 08:50:21.559525 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: WARNING keystonemiddleware.auth_token [None req-72cdb1c4-869c-4ad3-a1cd-ce8a8d4f6ddb None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 29 08:50:21.564929 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55e0c9fce9c0 pid: 123459 (default app) Apr 29 08:51:05.066304 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-8c261774-c90b-49b8-a5a8-f41fa0473c74 tempest-VolumesSnapshotsTestJSON-965621728 tempest-VolumesSnapshotsTestJSON-965621728-project] Action: 'create', calling method: .version_select at 0x7f6239a55160>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1003815689"}} {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 29 08:51:05.874821 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-23e0a199-f152-49b6-bfef-bb17ab28205f tempest-DeleteServersTestJSON-126197053 tempest-DeleteServersTestJSON-126197053-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1761148363", "imageRef": "e0678f88-0b68-4453-b569-29fd065e544e", "flavorRef": "452", "networks": [{"uuid": "eed97806-4133-44f5-ad35-6c19199516d8"}]}} {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 29 08:51:07.588498 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.network.neutron [None req-23e0a199-f152-49b6-bfef-bb17ab28205f tempest-DeleteServersTestJSON-126197053 tempest-DeleteServersTestJSON-126197053-project] validate_networks() for [('eed97806-4133-44f5-ad35-6c19199516d8', None, None, None, None, None)] {{(pid=123459) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 29 08:51:08.040631 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-8c261774-c90b-49b8-a5a8-f41fa0473c74 tempest-VolumesSnapshotsTestJSON-965621728 tempest-VolumesSnapshotsTestJSON-965621728-project] 10.222.0.31 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 4.455653 Apr 29 08:51:08.041692 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 1/1] 10.222.0.31 () {60 vars in 1154 bytes} [Fri Apr 29 08:51:03 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 4459 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Apr 29 08:51:08.054819 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-e8a3944e-6d35-487a-a8cd-d3274603a4ac tempest-VolumesSnapshotsTestJSON-965621728 tempest-VolumesSnapshotsTestJSON-965621728-project] Calling method '.version_select at 0x7f62398b1160>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:51:08.182986 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-e8a3944e-6d35-487a-a8cd-d3274603a4ac tempest-VolumesSnapshotsTestJSON-965621728 tempest-VolumesSnapshotsTestJSON-965621728-project] 10.222.0.31 "GET /compute/v2.1/os-volumes/490f30b1-7f6f-4f40-9074-79b8256dabe2" status: 200 len: 345 microversion: 2.1 time: 0.132626 Apr 29 08:51:08.184553 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 2/2] 10.222.0.31 () {58 vars in 1244 bytes} [Fri Apr 29 08:51:08 2022] GET /compute/v2.1/os-volumes/490f30b1-7f6f-4f40-9074-79b8256dabe2 => generated 345 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 29 08:51:09.199413 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-55979e85-b092-4339-bfde-99f118e5e0f2 tempest-VolumesSnapshotsTestJSON-965621728 tempest-VolumesSnapshotsTestJSON-965621728-project] Calling method '.version_select at 0x7f62398b1280>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:51:09.305122 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-55979e85-b092-4339-bfde-99f118e5e0f2 tempest-VolumesSnapshotsTestJSON-965621728 tempest-VolumesSnapshotsTestJSON-965621728-project] 10.222.0.31 "GET /compute/v2.1/os-volumes/490f30b1-7f6f-4f40-9074-79b8256dabe2" status: 200 len: 346 microversion: 2.1 time: 0.112857 Apr 29 08:51:09.305896 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 3/3] 10.222.0.31 () {58 vars in 1244 bytes} [Fri Apr 29 08:51:09 2022] GET /compute/v2.1/os-volumes/490f30b1-7f6f-4f40-9074-79b8256dabe2 => generated 346 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 29 08:51:09.317894 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-7ae72e51-7178-40f7-b383-cbd02224d848 tempest-VolumesSnapshotsTestJSON-965621728 tempest-VolumesSnapshotsTestJSON-965621728-project] Action: 'create', calling method: .version_select at 0x7f62398b1820>, body: {"snapshot": {"volume_id": "490f30b1-7f6f-4f40-9074-79b8256dabe2", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-934084364"}} {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 29 08:51:09.757318 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-7ae72e51-7178-40f7-b383-cbd02224d848 tempest-VolumesSnapshotsTestJSON-965621728 tempest-VolumesSnapshotsTestJSON-965621728-project] 10.222.0.31 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 0.443064 Apr 29 08:51:09.758099 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 4/4] 10.222.0.31 () {60 vars in 1161 bytes} [Fri Apr 29 08:51:09 2022] POST /compute/v2.1/os-snapshots => generated 286 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 29 08:51:09.768659 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-fea33afc-5033-4aad-9b27-3806467be29e tempest-VolumesSnapshotsTestJSON-965621728 tempest-VolumesSnapshotsTestJSON-965621728-project] Calling method '.version_select at 0x7f62398ac4c0>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:51:09.845254 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-fea33afc-5033-4aad-9b27-3806467be29e tempest-VolumesSnapshotsTestJSON-965621728 tempest-VolumesSnapshotsTestJSON-965621728-project] 10.222.0.31 "GET /compute/v2.1/os-snapshots/3791f1ea-b188-422f-9a5e-242b628a64c4" status: 200 len: 286 microversion: 2.1 time: 0.080846 Apr 29 08:51:09.846550 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 5/5] 10.222.0.31 () {58 vars in 1250 bytes} [Fri Apr 29 08:51:09 2022] GET /compute/v2.1/os-snapshots/3791f1ea-b188-422f-9a5e-242b628a64c4 => generated 286 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 29 08:51:09.856853 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-64775b61-83b9-4aa7-bb13-b4f5df58bcf8 tempest-VolumesSnapshotsTestJSON-965621728 tempest-VolumesSnapshotsTestJSON-965621728-project] Calling method '.version_select at 0x7f62398b1dc0>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:51:09.927248 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-64775b61-83b9-4aa7-bb13-b4f5df58bcf8 tempest-VolumesSnapshotsTestJSON-965621728 tempest-VolumesSnapshotsTestJSON-965621728-project] 10.222.0.31 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.074892 Apr 29 08:51:09.936518 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 6/6] 10.222.0.31 () {58 vars in 1139 bytes} [Fri Apr 29 08:51:09 2022] GET /compute/v2.1/os-snapshots => generated 289 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 29 08:51:09.942024 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-fb1f652c-a47b-4e75-86cb-e18e08112dd3 tempest-VolumesSnapshotsTestJSON-965621728 tempest-VolumesSnapshotsTestJSON-965621728-project] Calling method '.version_select at 0x7f623991dee0>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:51:09.997797 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-fb1f652c-a47b-4e75-86cb-e18e08112dd3 tempest-VolumesSnapshotsTestJSON-965621728 tempest-VolumesSnapshotsTestJSON-965621728-project] 10.222.0.31 "GET /compute/v2.1/os-snapshots/3791f1ea-b188-422f-9a5e-242b628a64c4" status: 200 len: 286 microversion: 2.1 time: 0.059903 Apr 29 08:51:09.999007 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 7/7] 10.222.0.31 () {58 vars in 1250 bytes} [Fri Apr 29 08:51:09 2022] GET /compute/v2.1/os-snapshots/3791f1ea-b188-422f-9a5e-242b628a64c4 => generated 286 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 29 08:51:10.184468 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.virt.hardware [None req-23e0a199-f152-49b6-bfef-bb17ab28205f tempest-DeleteServersTestJSON-126197053 tempest-DeleteServersTestJSON-126197053-project] Flavor limits 0:0:0 {{(pid=123459) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 29 08:51:10.186734 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.virt.hardware [None req-23e0a199-f152-49b6-bfef-bb17ab28205f tempest-DeleteServersTestJSON-126197053 tempest-DeleteServersTestJSON-126197053-project] Image limits 0:0:0 {{(pid=123459) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 29 08:51:10.187717 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.virt.hardware [None req-23e0a199-f152-49b6-bfef-bb17ab28205f tempest-DeleteServersTestJSON-126197053 tempest-DeleteServersTestJSON-126197053-project] Flavor pref 0:0:0 {{(pid=123459) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 29 08:51:10.188396 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.virt.hardware [None req-23e0a199-f152-49b6-bfef-bb17ab28205f tempest-DeleteServersTestJSON-126197053 tempest-DeleteServersTestJSON-126197053-project] Image pref 0:0:0 {{(pid=123459) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 29 08:51:10.189050 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.virt.hardware [None req-23e0a199-f152-49b6-bfef-bb17ab28205f tempest-DeleteServersTestJSON-126197053 tempest-DeleteServersTestJSON-126197053-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123459) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 29 08:51:10.223316 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-23e0a199-f152-49b6-bfef-bb17ab28205f tempest-DeleteServersTestJSON-126197053 tempest-DeleteServersTestJSON-126197053-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:51:10.224034 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-23e0a199-f152-49b6-bfef-bb17ab28205f tempest-DeleteServersTestJSON-126197053 tempest-DeleteServersTestJSON-126197053-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:51:10.227083 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-23e0a199-f152-49b6-bfef-bb17ab28205f tempest-DeleteServersTestJSON-126197053 tempest-DeleteServersTestJSON-126197053-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:51:10.227808 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-23e0a199-f152-49b6-bfef-bb17ab28205f tempest-DeleteServersTestJSON-126197053 tempest-DeleteServersTestJSON-126197053-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:51:10.302902 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.quota [None req-23e0a199-f152-49b6-bfef-bb17ab28205f tempest-DeleteServersTestJSON-126197053 tempest-DeleteServersTestJSON-126197053-project] Getting quotas for project 5b69a8d69ede453aa373fca0a65bdedd. Resources: {'instances', 'cores', 'ram'} {{(pid=123459) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 29 08:51:10.320998 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.quota [None req-23e0a199-f152-49b6-bfef-bb17ab28205f tempest-DeleteServersTestJSON-126197053 tempest-DeleteServersTestJSON-126197053-project] Getting quotas for user 8aa040fad7754a4ba5752413fcfde807 and project 5b69a8d69ede453aa373fca0a65bdedd. Resources: {'instances', 'cores', 'ram'} {{(pid=123459) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 29 08:51:10.345833 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-23e0a199-f152-49b6-bfef-bb17ab28205f tempest-DeleteServersTestJSON-126197053 tempest-DeleteServersTestJSON-126197053-project] Going to run 1 instances... {{(pid=123459) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 29 08:51:10.351049 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-23e0a199-f152-49b6-bfef-bb17ab28205f tempest-DeleteServersTestJSON-126197053 tempest-DeleteServersTestJSON-126197053-project] [instance: 2f7df954-edb0-41b8-a3d9-a8a870d487c3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e0678f88-0b68-4453-b569-29fd065e544e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123459) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 29 08:51:10.560805 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-23e0a199-f152-49b6-bfef-bb17ab28205f tempest-DeleteServersTestJSON-126197053 tempest-DeleteServersTestJSON-126197053-project] 10.222.0.31 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 6.068158 Apr 29 08:51:10.561874 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 1/8] 10.222.0.31 () {60 vars in 1146 bytes} [Fri Apr 29 08:51:04 2022] POST /compute/v2.1/servers => generated 380 bytes in 6071 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Apr 29 08:51:10.575545 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-0f8598cc-ae9b-464a-961f-30c58954ab4d tempest-DeleteServersTestJSON-126197053 tempest-DeleteServersTestJSON-126197053-project] Calling method '>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:51:10.577188 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-0f8598cc-ae9b-464a-961f-30c58954ab4d tempest-DeleteServersTestJSON-126197053 tempest-DeleteServersTestJSON-126197053-project] [instance: 2f7df954-edb0-41b8-a3d9-a8a870d487c3] Fetching instance by UUID {{(pid=123458) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:51:10.764970 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-0f8598cc-ae9b-464a-961f-30c58954ab4d tempest-DeleteServersTestJSON-126197053 tempest-DeleteServersTestJSON-126197053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8aa040fad7754a4ba5752413fcfde807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b69a8d69ede453aa373fca0a65bdedd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:51:10.797642 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-0f8598cc-ae9b-464a-961f-30c58954ab4d tempest-DeleteServersTestJSON-126197053 tempest-DeleteServersTestJSON-126197053-project] 10.222.0.31 "GET /compute/v2.1/servers/2f7df954-edb0-41b8-a3d9-a8a870d487c3" status: 200 len: 1215 microversion: 2.1 time: 0.229123 Apr 29 08:51:10.810496 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 8/9] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 08:51:10 2022] GET /compute/v2.1/servers/2f7df954-edb0-41b8-a3d9-a8a870d487c3 => generated 1215 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 08:51:11.011111 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-cadbac87-e2e3-44c0-99a7-724c69bb8fd0 tempest-VolumesSnapshotsTestJSON-965621728 tempest-VolumesSnapshotsTestJSON-965621728-project] Calling method '.version_select at 0x7f6239063160>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:51:11.224687 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-cadbac87-e2e3-44c0-99a7-724c69bb8fd0 tempest-VolumesSnapshotsTestJSON-965621728 tempest-VolumesSnapshotsTestJSON-965621728-project] 10.222.0.31 "GET /compute/v2.1/os-snapshots/3791f1ea-b188-422f-9a5e-242b628a64c4" status: 200 len: 286 microversion: 2.1 time: 0.217933 Apr 29 08:51:11.225719 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 2/10] 10.222.0.31 () {58 vars in 1250 bytes} [Fri Apr 29 08:51:11 2022] GET /compute/v2.1/os-snapshots/3791f1ea-b188-422f-9a5e-242b628a64c4 => generated 286 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 29 08:51:11.815797 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-bf71c2d1-cd2e-4ae7-b562-9cf227fd1839 tempest-DeleteServersTestJSON-126197053 tempest-DeleteServersTestJSON-126197053-project] Calling method '>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:51:11.817492 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-bf71c2d1-cd2e-4ae7-b562-9cf227fd1839 tempest-DeleteServersTestJSON-126197053 tempest-DeleteServersTestJSON-126197053-project] [instance: 2f7df954-edb0-41b8-a3d9-a8a870d487c3] Fetching instance by UUID {{(pid=123458) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:51:12.075758 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-bf71c2d1-cd2e-4ae7-b562-9cf227fd1839 tempest-DeleteServersTestJSON-126197053 tempest-DeleteServersTestJSON-126197053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8aa040fad7754a4ba5752413fcfde807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b69a8d69ede453aa373fca0a65bdedd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:51:12.089614 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-bf71c2d1-cd2e-4ae7-b562-9cf227fd1839 tempest-DeleteServersTestJSON-126197053 tempest-DeleteServersTestJSON-126197053-project] 10.222.0.31 "GET /compute/v2.1/servers/2f7df954-edb0-41b8-a3d9-a8a870d487c3" status: 200 len: 1215 microversion: 2.1 time: 0.276679 Apr 29 08:51:12.104396 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 9/11] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 08:51:11 2022] GET /compute/v2.1/servers/2f7df954-edb0-41b8-a3d9-a8a870d487c3 => generated 1215 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 08:51:12.240514 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-aabc4ada-adbd-46e8-9766-31b4161243cc tempest-VolumesSnapshotsTestJSON-965621728 tempest-VolumesSnapshotsTestJSON-965621728-project] Calling method '.version_select at 0x7f62387b9a60>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:51:12.295365 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-aabc4ada-adbd-46e8-9766-31b4161243cc tempest-VolumesSnapshotsTestJSON-965621728 tempest-VolumesSnapshotsTestJSON-965621728-project] 10.222.0.31 "GET /compute/v2.1/os-snapshots/3791f1ea-b188-422f-9a5e-242b628a64c4" status: 200 len: 286 microversion: 2.1 time: 0.061622 Apr 29 08:51:12.296489 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 3/12] 10.222.0.31 () {58 vars in 1250 bytes} [Fri Apr 29 08:51:12 2022] GET /compute/v2.1/os-snapshots/3791f1ea-b188-422f-9a5e-242b628a64c4 => generated 286 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 29 08:51:13.107850 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-380753d6-4873-4a47-9f05-f27ef4fb8a2c tempest-DeleteServersTestJSON-126197053 tempest-DeleteServersTestJSON-126197053-project] Calling method '>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:51:13.108483 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-380753d6-4873-4a47-9f05-f27ef4fb8a2c tempest-DeleteServersTestJSON-126197053 tempest-DeleteServersTestJSON-126197053-project] [instance: 2f7df954-edb0-41b8-a3d9-a8a870d487c3] Fetching instance by UUID {{(pid=123458) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:51:13.123165 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-380753d6-4873-4a47-9f05-f27ef4fb8a2c tempest-DeleteServersTestJSON-126197053 tempest-DeleteServersTestJSON-126197053-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:51:13.124221 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-380753d6-4873-4a47-9f05-f27ef4fb8a2c tempest-DeleteServersTestJSON-126197053 tempest-DeleteServersTestJSON-126197053-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:51:13.126392 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-380753d6-4873-4a47-9f05-f27ef4fb8a2c tempest-DeleteServersTestJSON-126197053 tempest-DeleteServersTestJSON-126197053-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:51:13.130615 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-380753d6-4873-4a47-9f05-f27ef4fb8a2c tempest-DeleteServersTestJSON-126197053 tempest-DeleteServersTestJSON-126197053-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:51:13.308691 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-50e102fd-5c17-426d-9709-68735396e8e7 tempest-VolumesSnapshotsTestJSON-965621728 tempest-VolumesSnapshotsTestJSON-965621728-project] Calling method '.version_select at 0x7f62387c3160>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:51:13.371728 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-50e102fd-5c17-426d-9709-68735396e8e7 tempest-VolumesSnapshotsTestJSON-965621728 tempest-VolumesSnapshotsTestJSON-965621728-project] 10.222.0.31 "GET /compute/v2.1/os-snapshots/3791f1ea-b188-422f-9a5e-242b628a64c4" status: 200 len: 286 microversion: 2.1 time: 0.067708 Apr 29 08:51:13.373284 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 4/13] 10.222.0.31 () {58 vars in 1250 bytes} [Fri Apr 29 08:51:13 2022] GET /compute/v2.1/os-snapshots/3791f1ea-b188-422f-9a5e-242b628a64c4 => generated 286 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 29 08:51:13.612823 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-380753d6-4873-4a47-9f05-f27ef4fb8a2c tempest-DeleteServersTestJSON-126197053 tempest-DeleteServersTestJSON-126197053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8aa040fad7754a4ba5752413fcfde807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b69a8d69ede453aa373fca0a65bdedd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:51:13.662633 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-380753d6-4873-4a47-9f05-f27ef4fb8a2c tempest-DeleteServersTestJSON-126197053 tempest-DeleteServersTestJSON-126197053-project] 10.222.0.31 "GET /compute/v2.1/servers/2f7df954-edb0-41b8-a3d9-a8a870d487c3" status: 200 len: 1219 microversion: 2.1 time: 0.558939 Apr 29 08:51:13.676908 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 10/14] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 08:51:13 2022] GET /compute/v2.1/servers/2f7df954-edb0-41b8-a3d9-a8a870d487c3 => generated 1219 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 29 08:51:14.395303 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-6edfbf74-2e32-45bc-a4ac-8e001d70b1a2 tempest-VolumesSnapshotsTestJSON-965621728 tempest-VolumesSnapshotsTestJSON-965621728-project] Calling method '.version_select at 0x7f62387b9dc0>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:51:14.470893 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-6edfbf74-2e32-45bc-a4ac-8e001d70b1a2 tempest-VolumesSnapshotsTestJSON-965621728 tempest-VolumesSnapshotsTestJSON-965621728-project] 10.222.0.31 "GET /compute/v2.1/os-snapshots/3791f1ea-b188-422f-9a5e-242b628a64c4" status: 200 len: 286 microversion: 2.1 time: 0.085062 Apr 29 08:51:14.472229 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 5/15] 10.222.0.31 () {58 vars in 1250 bytes} [Fri Apr 29 08:51:14 2022] GET /compute/v2.1/os-snapshots/3791f1ea-b188-422f-9a5e-242b628a64c4 => generated 286 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 29 08:51:14.690128 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-e4462c80-5f6e-4378-bb3f-5299b9c03298 tempest-DeleteServersTestJSON-126197053 tempest-DeleteServersTestJSON-126197053-project] Calling method '>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:51:14.690755 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-e4462c80-5f6e-4378-bb3f-5299b9c03298 tempest-DeleteServersTestJSON-126197053 tempest-DeleteServersTestJSON-126197053-project] [instance: 2f7df954-edb0-41b8-a3d9-a8a870d487c3] Fetching instance by UUID {{(pid=123459) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:51:14.732030 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-e4462c80-5f6e-4378-bb3f-5299b9c03298 tempest-DeleteServersTestJSON-126197053 tempest-DeleteServersTestJSON-126197053-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:51:14.736347 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-e4462c80-5f6e-4378-bb3f-5299b9c03298 tempest-DeleteServersTestJSON-126197053 tempest-DeleteServersTestJSON-126197053-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:51:14.737488 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-e4462c80-5f6e-4378-bb3f-5299b9c03298 tempest-DeleteServersTestJSON-126197053 tempest-DeleteServersTestJSON-126197053-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:51:14.741218 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-e4462c80-5f6e-4378-bb3f-5299b9c03298 tempest-DeleteServersTestJSON-126197053 tempest-DeleteServersTestJSON-126197053-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:51:14.891091 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-8bed5c99-7c06-41cf-a535-bc35c5f1533c tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Action: 'create', calling method: .version_select at 0x7f62397ff3a0>, body: {"keypair": {"name": "tempest-keypair-2074566819"}} {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 29 08:51:15.000300 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.quota [None req-8bed5c99-7c06-41cf-a535-bc35c5f1533c tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Getting quotas for project 81c2c3d18ff34afe806e090aec002a4b. Resources: {'key_pairs'} {{(pid=123458) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 29 08:51:15.022801 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.quota [None req-8bed5c99-7c06-41cf-a535-bc35c5f1533c tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Getting quotas for user abdb65629422487fba47326d5971bb3f and project 81c2c3d18ff34afe806e090aec002a4b. Resources: {'key_pairs'} {{(pid=123458) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 29 08:51:15.174541 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-e4462c80-5f6e-4378-bb3f-5299b9c03298 tempest-DeleteServersTestJSON-126197053 tempest-DeleteServersTestJSON-126197053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8aa040fad7754a4ba5752413fcfde807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b69a8d69ede453aa373fca0a65bdedd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:51:15.218000 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-e4462c80-5f6e-4378-bb3f-5299b9c03298 tempest-DeleteServersTestJSON-126197053 tempest-DeleteServersTestJSON-126197053-project] 10.222.0.31 "GET /compute/v2.1/servers/2f7df954-edb0-41b8-a3d9-a8a870d487c3" status: 200 len: 1219 microversion: 2.1 time: 0.523959 Apr 29 08:51:15.218858 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 6/16] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 08:51:14 2022] GET /compute/v2.1/servers/2f7df954-edb0-41b8-a3d9-a8a870d487c3 => generated 1219 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 29 08:51:15.323645 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.quota [None req-8bed5c99-7c06-41cf-a535-bc35c5f1533c tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Getting quotas for project 81c2c3d18ff34afe806e090aec002a4b. Resources: {'key_pairs'} {{(pid=123458) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 29 08:51:15.334175 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.quota [None req-8bed5c99-7c06-41cf-a535-bc35c5f1533c tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Getting quotas for user abdb65629422487fba47326d5971bb3f and project 81c2c3d18ff34afe806e090aec002a4b. Resources: {'key_pairs'} {{(pid=123458) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 29 08:51:15.372436 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-8bed5c99-7c06-41cf-a535-bc35c5f1533c tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] 10.222.0.31 "POST /compute/v2.1/os-keypairs" status: 201 len: 2320 microversion: 2.20 time: 0.751791 Apr 29 08:51:15.381104 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 11/17] 10.222.0.31 () {62 vars in 1198 bytes} [Fri Apr 29 08:51:14 2022] POST /compute/v2.1/os-keypairs => generated 2320 bytes in 754 msecs (HTTP/1.1 201) 9 headers in 365 bytes (1 switches on core 0) Apr 29 08:51:15.483260 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-fc9bcfe8-ecfe-4b9b-bf18-d9cd057cbf36 tempest-VolumesSnapshotsTestJSON-965621728 tempest-VolumesSnapshotsTestJSON-965621728-project] Calling method '.version_select at 0x7f62387c3670>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:51:15.536323 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-fc9bcfe8-ecfe-4b9b-bf18-d9cd057cbf36 tempest-VolumesSnapshotsTestJSON-965621728 tempest-VolumesSnapshotsTestJSON-965621728-project] 10.222.0.31 "GET /compute/v2.1/os-snapshots/3791f1ea-b188-422f-9a5e-242b628a64c4" status: 200 len: 286 microversion: 2.1 time: 0.056810 Apr 29 08:51:15.540899 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 7/18] 10.222.0.31 () {58 vars in 1250 bytes} [Fri Apr 29 08:51:15 2022] GET /compute/v2.1/os-snapshots/3791f1ea-b188-422f-9a5e-242b628a64c4 => generated 286 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 29 08:51:16.236805 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-3e480161-05f4-4415-99d6-2f869a7fed5d tempest-DeleteServersTestJSON-126197053 tempest-DeleteServersTestJSON-126197053-project] Calling method '>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:51:16.237441 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-3e480161-05f4-4415-99d6-2f869a7fed5d tempest-DeleteServersTestJSON-126197053 tempest-DeleteServersTestJSON-126197053-project] [instance: 2f7df954-edb0-41b8-a3d9-a8a870d487c3] Fetching instance by UUID {{(pid=123458) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:51:16.252732 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-3e480161-05f4-4415-99d6-2f869a7fed5d tempest-DeleteServersTestJSON-126197053 tempest-DeleteServersTestJSON-126197053-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:51:16.253265 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-3e480161-05f4-4415-99d6-2f869a7fed5d tempest-DeleteServersTestJSON-126197053 tempest-DeleteServersTestJSON-126197053-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:51:16.254081 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-3e480161-05f4-4415-99d6-2f869a7fed5d tempest-DeleteServersTestJSON-126197053 tempest-DeleteServersTestJSON-126197053-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:51:16.254530 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-3e480161-05f4-4415-99d6-2f869a7fed5d tempest-DeleteServersTestJSON-126197053 tempest-DeleteServersTestJSON-126197053-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:51:16.515782 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-3e480161-05f4-4415-99d6-2f869a7fed5d tempest-DeleteServersTestJSON-126197053 tempest-DeleteServersTestJSON-126197053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8aa040fad7754a4ba5752413fcfde807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b69a8d69ede453aa373fca0a65bdedd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:51:16.534982 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-3e480161-05f4-4415-99d6-2f869a7fed5d tempest-DeleteServersTestJSON-126197053 tempest-DeleteServersTestJSON-126197053-project] 10.222.0.31 "GET /compute/v2.1/servers/2f7df954-edb0-41b8-a3d9-a8a870d487c3" status: 200 len: 1267 microversion: 2.1 time: 0.302567 Apr 29 08:51:16.536951 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 12/19] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 08:51:16 2022] GET /compute/v2.1/servers/2f7df954-edb0-41b8-a3d9-a8a870d487c3 => generated 1267 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 08:51:16.557063 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-f8da2d62-76b3-47b6-8571-b9cc7bc806b0 tempest-VolumesSnapshotsTestJSON-965621728 tempest-VolumesSnapshotsTestJSON-965621728-project] Calling method '.version_select at 0x7f6238701ee0>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:51:16.669841 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-f8da2d62-76b3-47b6-8571-b9cc7bc806b0 tempest-VolumesSnapshotsTestJSON-965621728 tempest-VolumesSnapshotsTestJSON-965621728-project] 10.222.0.31 "GET /compute/v2.1/os-snapshots/3791f1ea-b188-422f-9a5e-242b628a64c4" status: 200 len: 287 microversion: 2.1 time: 0.122270 Apr 29 08:51:16.670430 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 8/20] 10.222.0.31 () {58 vars in 1250 bytes} [Fri Apr 29 08:51:16 2022] GET /compute/v2.1/os-snapshots/3791f1ea-b188-422f-9a5e-242b628a64c4 => generated 287 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 29 08:51:16.682385 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-7f1cbb45-7504-44ae-9484-73639aafa647 tempest-VolumesSnapshotsTestJSON-965621728 tempest-VolumesSnapshotsTestJSON-965621728-project] Calling method '.version_select at 0x7f6238f62790>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:51:16.852390 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-7f1cbb45-7504-44ae-9484-73639aafa647 tempest-VolumesSnapshotsTestJSON-965621728 tempest-VolumesSnapshotsTestJSON-965621728-project] 10.222.0.31 "DELETE /compute/v2.1/os-snapshots/3791f1ea-b188-422f-9a5e-242b628a64c4" status: 202 len: 0 microversion: 2.1 time: 0.173812 Apr 29 08:51:16.853978 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 13/21] 10.222.0.31 () {58 vars in 1253 bytes} [Fri Apr 29 08:51:16 2022] DELETE /compute/v2.1/os-snapshots/3791f1ea-b188-422f-9a5e-242b628a64c4 => generated 0 bytes in 178 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Apr 29 08:51:16.863722 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-a37052bf-7e4a-4b17-9e6f-9826d6655bd1 tempest-VolumesSnapshotsTestJSON-965621728 tempest-VolumesSnapshotsTestJSON-965621728-project] Calling method '.version_select at 0x7f62387125e0>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:51:16.921968 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-a37052bf-7e4a-4b17-9e6f-9826d6655bd1 tempest-VolumesSnapshotsTestJSON-965621728 tempest-VolumesSnapshotsTestJSON-965621728-project] 10.222.0.31 "GET /compute/v2.1/os-snapshots/3791f1ea-b188-422f-9a5e-242b628a64c4" status: 200 len: 286 microversion: 2.1 time: 0.056765 Apr 29 08:51:16.930435 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 9/22] 10.222.0.31 () {58 vars in 1250 bytes} [Fri Apr 29 08:51:16 2022] GET /compute/v2.1/os-snapshots/3791f1ea-b188-422f-9a5e-242b628a64c4 => generated 286 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 29 08:51:17.555695 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-770a7049-210f-4573-8a8a-1330025aa8c4 tempest-DeleteServersTestJSON-126197053 tempest-DeleteServersTestJSON-126197053-project] Calling method '>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:51:17.556898 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-770a7049-210f-4573-8a8a-1330025aa8c4 tempest-DeleteServersTestJSON-126197053 tempest-DeleteServersTestJSON-126197053-project] [instance: 2f7df954-edb0-41b8-a3d9-a8a870d487c3] Fetching instance by UUID {{(pid=123458) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:51:17.581632 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-770a7049-210f-4573-8a8a-1330025aa8c4 tempest-DeleteServersTestJSON-126197053 tempest-DeleteServersTestJSON-126197053-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:51:17.583643 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-770a7049-210f-4573-8a8a-1330025aa8c4 tempest-DeleteServersTestJSON-126197053 tempest-DeleteServersTestJSON-126197053-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:51:17.584535 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-770a7049-210f-4573-8a8a-1330025aa8c4 tempest-DeleteServersTestJSON-126197053 tempest-DeleteServersTestJSON-126197053-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:51:17.584985 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-770a7049-210f-4573-8a8a-1330025aa8c4 tempest-DeleteServersTestJSON-126197053 tempest-DeleteServersTestJSON-126197053-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:51:17.938937 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-4c5eb860-0937-4d1f-a99f-602ff14b56f0 tempest-VolumesSnapshotsTestJSON-965621728 tempest-VolumesSnapshotsTestJSON-965621728-project] Calling method '.version_select at 0x7f623873daf0>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:51:18.060076 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.wsgi [None req-4c5eb860-0937-4d1f-a99f-602ff14b56f0 tempest-VolumesSnapshotsTestJSON-965621728 tempest-VolumesSnapshotsTestJSON-965621728-project] HTTP exception thrown: Snapshot 3791f1ea-b188-422f-9a5e-242b628a64c4 could not be found. Apr 29 08:51:18.060353 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-770a7049-210f-4573-8a8a-1330025aa8c4 tempest-DeleteServersTestJSON-126197053 tempest-DeleteServersTestJSON-126197053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8aa040fad7754a4ba5752413fcfde807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b69a8d69ede453aa373fca0a65bdedd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:51:18.061448 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-4c5eb860-0937-4d1f-a99f-602ff14b56f0 tempest-VolumesSnapshotsTestJSON-965621728 tempest-VolumesSnapshotsTestJSON-965621728-project] Returning 404 to user: Snapshot 3791f1ea-b188-422f-9a5e-242b628a64c4 could not be found. {{(pid=123459) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 29 08:51:18.062635 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-4c5eb860-0937-4d1f-a99f-602ff14b56f0 tempest-VolumesSnapshotsTestJSON-965621728 tempest-VolumesSnapshotsTestJSON-965621728-project] 10.222.0.31 "GET /compute/v2.1/os-snapshots/3791f1ea-b188-422f-9a5e-242b628a64c4" status: 404 len: 111 microversion: 2.1 time: 0.130309 Apr 29 08:51:18.063644 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 10/23] 10.222.0.31 () {58 vars in 1250 bytes} [Fri Apr 29 08:51:17 2022] GET /compute/v2.1/os-snapshots/3791f1ea-b188-422f-9a5e-242b628a64c4 => generated 111 bytes in 132 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 29 08:51:18.073407 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-23064d4d-2380-4537-b45c-4d8c689ccb1a tempest-VolumesSnapshotsTestJSON-965621728 tempest-VolumesSnapshotsTestJSON-965621728-project] Calling method '.version_select at 0x7f6239f54280>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:51:18.098018 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-770a7049-210f-4573-8a8a-1330025aa8c4 tempest-DeleteServersTestJSON-126197053 tempest-DeleteServersTestJSON-126197053-project] 10.222.0.31 "GET /compute/v2.1/servers/2f7df954-edb0-41b8-a3d9-a8a870d487c3" status: 200 len: 1273 microversion: 2.1 time: 0.546744 Apr 29 08:51:18.099770 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 14/24] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 08:51:17 2022] GET /compute/v2.1/servers/2f7df954-edb0-41b8-a3d9-a8a870d487c3 => generated 1273 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 08:51:18.282750 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-23064d4d-2380-4537-b45c-4d8c689ccb1a tempest-VolumesSnapshotsTestJSON-965621728 tempest-VolumesSnapshotsTestJSON-965621728-project] 10.222.0.31 "DELETE /compute/v2.1/os-volumes/490f30b1-7f6f-4f40-9074-79b8256dabe2" status: 202 len: 0 microversion: 2.1 time: 0.212952 Apr 29 08:51:18.287546 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 11/25] 10.222.0.31 () {58 vars in 1247 bytes} [Fri Apr 29 08:51:18 2022] DELETE /compute/v2.1/os-volumes/490f30b1-7f6f-4f40-9074-79b8256dabe2 => generated 0 bytes in 220 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Apr 29 08:51:18.294408 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-313f9f5b-9a26-468c-b8b3-1011e8ba7eb3 tempest-VolumesSnapshotsTestJSON-965621728 tempest-VolumesSnapshotsTestJSON-965621728-project] Calling method '.version_select at 0x7f6238701ee0>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:51:18.413668 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-03057f04-0b6b-4b06-885c-237d7cc03c61 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Action: 'create', calling method: .version_select at 0x7f6238f62670>, body: {"keypair": {"name": "tempest-keypair-1129396086"}} {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 29 08:51:18.437367 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-313f9f5b-9a26-468c-b8b3-1011e8ba7eb3 tempest-VolumesSnapshotsTestJSON-965621728 tempest-VolumesSnapshotsTestJSON-965621728-project] 10.222.0.31 "GET /compute/v2.1/os-volumes/490f30b1-7f6f-4f40-9074-79b8256dabe2" status: 200 len: 345 microversion: 2.1 time: 0.147963 Apr 29 08:51:18.445507 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 12/26] 10.222.0.31 () {58 vars in 1244 bytes} [Fri Apr 29 08:51:18 2022] GET /compute/v2.1/os-volumes/490f30b1-7f6f-4f40-9074-79b8256dabe2 => generated 345 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 29 08:51:18.454107 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.quota [None req-03057f04-0b6b-4b06-885c-237d7cc03c61 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Getting quotas for project 578e6a35974d4e5c8a0cd4e5fa994259. Resources: {'key_pairs'} {{(pid=123458) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 29 08:51:18.485861 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.quota [None req-03057f04-0b6b-4b06-885c-237d7cc03c61 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Getting quotas for user 8e47ecdfb01f447699275b13255c15d4 and project 578e6a35974d4e5c8a0cd4e5fa994259. Resources: {'key_pairs'} {{(pid=123458) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 29 08:51:19.119306 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-0c3f70fc-01b8-4be1-ad52-e7d2118cef87 tempest-DeleteServersTestJSON-126197053 tempest-DeleteServersTestJSON-126197053-project] Calling method '>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:51:19.119988 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-0c3f70fc-01b8-4be1-ad52-e7d2118cef87 tempest-DeleteServersTestJSON-126197053 tempest-DeleteServersTestJSON-126197053-project] [instance: 2f7df954-edb0-41b8-a3d9-a8a870d487c3] Fetching instance by UUID {{(pid=123459) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:51:19.151494 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-0c3f70fc-01b8-4be1-ad52-e7d2118cef87 tempest-DeleteServersTestJSON-126197053 tempest-DeleteServersTestJSON-126197053-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:51:19.151868 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-0c3f70fc-01b8-4be1-ad52-e7d2118cef87 tempest-DeleteServersTestJSON-126197053 tempest-DeleteServersTestJSON-126197053-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:51:19.153216 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-0c3f70fc-01b8-4be1-ad52-e7d2118cef87 tempest-DeleteServersTestJSON-126197053 tempest-DeleteServersTestJSON-126197053-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:51:19.153655 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-0c3f70fc-01b8-4be1-ad52-e7d2118cef87 tempest-DeleteServersTestJSON-126197053 tempest-DeleteServersTestJSON-126197053-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:51:19.416447 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-0c3f70fc-01b8-4be1-ad52-e7d2118cef87 tempest-DeleteServersTestJSON-126197053 tempest-DeleteServersTestJSON-126197053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8aa040fad7754a4ba5752413fcfde807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b69a8d69ede453aa373fca0a65bdedd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:51:19.429559 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-0c3f70fc-01b8-4be1-ad52-e7d2118cef87 tempest-DeleteServersTestJSON-126197053 tempest-DeleteServersTestJSON-126197053-project] 10.222.0.31 "GET /compute/v2.1/servers/2f7df954-edb0-41b8-a3d9-a8a870d487c3" status: 200 len: 1273 microversion: 2.1 time: 0.315801 Apr 29 08:51:19.431162 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 13/27] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 08:51:19 2022] GET /compute/v2.1/servers/2f7df954-edb0-41b8-a3d9-a8a870d487c3 => generated 1273 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 08:51:19.460600 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-1739c45b-7c10-4c08-b99e-0deb95e73687 tempest-VolumesSnapshotsTestJSON-965621728 tempest-VolumesSnapshotsTestJSON-965621728-project] Calling method '.version_select at 0x7f62386a7550>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:51:19.702982 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-1739c45b-7c10-4c08-b99e-0deb95e73687 tempest-VolumesSnapshotsTestJSON-965621728 tempest-VolumesSnapshotsTestJSON-965621728-project] 10.222.0.31 "GET /compute/v2.1/os-volumes/490f30b1-7f6f-4f40-9074-79b8256dabe2" status: 200 len: 345 microversion: 2.1 time: 0.255593 Apr 29 08:51:19.713078 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 14/28] 10.222.0.31 () {58 vars in 1244 bytes} [Fri Apr 29 08:51:19 2022] GET /compute/v2.1/os-volumes/490f30b1-7f6f-4f40-9074-79b8256dabe2 => generated 345 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 29 08:51:20.057156 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.quota [None req-03057f04-0b6b-4b06-885c-237d7cc03c61 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Getting quotas for project 578e6a35974d4e5c8a0cd4e5fa994259. Resources: {'key_pairs'} {{(pid=123458) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 29 08:51:20.067442 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.quota [None req-03057f04-0b6b-4b06-885c-237d7cc03c61 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Getting quotas for user 8e47ecdfb01f447699275b13255c15d4 and project 578e6a35974d4e5c8a0cd4e5fa994259. Resources: {'key_pairs'} {{(pid=123458) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 29 08:51:20.108497 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-03057f04-0b6b-4b06-885c-237d7cc03c61 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] 10.222.0.31 "POST /compute/v2.1/os-keypairs" status: 200 len: 2301 microversion: 2.1 time: 1.960381 Apr 29 08:51:20.109742 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 15/29] 10.222.0.31 () {60 vars in 1157 bytes} [Fri Apr 29 08:51:18 2022] POST /compute/v2.1/os-keypairs => generated 2301 bytes in 1963 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 29 08:51:20.456720 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-eddadf53-6114-44d1-93eb-f4fdca80d7f6 tempest-DeleteServersTestJSON-126197053 tempest-DeleteServersTestJSON-126197053-project] Calling method '>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:51:20.457585 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-eddadf53-6114-44d1-93eb-f4fdca80d7f6 tempest-DeleteServersTestJSON-126197053 tempest-DeleteServersTestJSON-126197053-project] [instance: 2f7df954-edb0-41b8-a3d9-a8a870d487c3] Fetching instance by UUID {{(pid=123459) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:51:20.474670 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-eddadf53-6114-44d1-93eb-f4fdca80d7f6 tempest-DeleteServersTestJSON-126197053 tempest-DeleteServersTestJSON-126197053-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:51:20.475137 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-eddadf53-6114-44d1-93eb-f4fdca80d7f6 tempest-DeleteServersTestJSON-126197053 tempest-DeleteServersTestJSON-126197053-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:51:20.475945 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-eddadf53-6114-44d1-93eb-f4fdca80d7f6 tempest-DeleteServersTestJSON-126197053 tempest-DeleteServersTestJSON-126197053-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:51:20.476416 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-eddadf53-6114-44d1-93eb-f4fdca80d7f6 tempest-DeleteServersTestJSON-126197053 tempest-DeleteServersTestJSON-126197053-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:51:20.720358 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-d700c08a-36a2-4866-ab81-ece3b5a55253 tempest-VolumesSnapshotsTestJSON-965621728 tempest-VolumesSnapshotsTestJSON-965621728-project] Calling method '.version_select at 0x7f6238efd160>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:51:20.882886 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-d700c08a-36a2-4866-ab81-ece3b5a55253 tempest-VolumesSnapshotsTestJSON-965621728 tempest-VolumesSnapshotsTestJSON-965621728-project] 10.222.0.31 "GET /compute/v2.1/os-volumes/490f30b1-7f6f-4f40-9074-79b8256dabe2" status: 200 len: 345 microversion: 2.1 time: 0.164693 Apr 29 08:51:20.888818 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 16/30] 10.222.0.31 () {58 vars in 1244 bytes} [Fri Apr 29 08:51:20 2022] GET /compute/v2.1/os-volumes/490f30b1-7f6f-4f40-9074-79b8256dabe2 => generated 345 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 29 08:51:21.252024 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-eddadf53-6114-44d1-93eb-f4fdca80d7f6 tempest-DeleteServersTestJSON-126197053 tempest-DeleteServersTestJSON-126197053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8aa040fad7754a4ba5752413fcfde807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b69a8d69ede453aa373fca0a65bdedd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:51:21.282691 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-eddadf53-6114-44d1-93eb-f4fdca80d7f6 tempest-DeleteServersTestJSON-126197053 tempest-DeleteServersTestJSON-126197053-project] 10.222.0.31 "GET /compute/v2.1/servers/2f7df954-edb0-41b8-a3d9-a8a870d487c3" status: 200 len: 1315 microversion: 2.1 time: 0.830788 Apr 29 08:51:21.296387 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 15/31] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 08:51:20 2022] GET /compute/v2.1/servers/2f7df954-edb0-41b8-a3d9-a8a870d487c3 => generated 1315 bytes in 845 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 08:51:21.905458 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-6491305a-8a6b-4383-88f1-75e6ad354a33 tempest-VolumesSnapshotsTestJSON-965621728 tempest-VolumesSnapshotsTestJSON-965621728-project] Calling method '.version_select at 0x7f6238efd820>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:51:22.115695 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-6491305a-8a6b-4383-88f1-75e6ad354a33 tempest-VolumesSnapshotsTestJSON-965621728 tempest-VolumesSnapshotsTestJSON-965621728-project] 10.222.0.31 "GET /compute/v2.1/os-volumes/490f30b1-7f6f-4f40-9074-79b8256dabe2" status: 200 len: 345 microversion: 2.1 time: 0.215788 Apr 29 08:51:22.117668 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 17/32] 10.222.0.31 () {58 vars in 1244 bytes} [Fri Apr 29 08:51:21 2022] GET /compute/v2.1/os-volumes/490f30b1-7f6f-4f40-9074-79b8256dabe2 => generated 345 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 29 08:51:22.324015 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-9f0ffda8-7e3e-4308-83e6-4805650afa4f tempest-DeleteServersTestJSON-126197053 tempest-DeleteServersTestJSON-126197053-project] Calling method '>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:51:22.325234 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-9f0ffda8-7e3e-4308-83e6-4805650afa4f tempest-DeleteServersTestJSON-126197053 tempest-DeleteServersTestJSON-126197053-project] [instance: 2f7df954-edb0-41b8-a3d9-a8a870d487c3] Fetching instance by UUID {{(pid=123458) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:51:22.336936 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-84a7a8a0-9a85-48b1-b9ad-12a677f2897e tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-2088834088", "imageRef": "e0678f88-0b68-4453-b569-29fd065e544e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "88e14c54-6fc1-4ee6-8dc1-d1927744d27d"}], "security_groups": [{"name": "tempest-securitygroup--1544912078"}], "key_name": "tempest-keypair-2074566819", "user_data": "}} {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 29 08:51:22.353206 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-9f0ffda8-7e3e-4308-83e6-4805650afa4f tempest-DeleteServersTestJSON-126197053 tempest-DeleteServersTestJSON-126197053-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:51:22.354357 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-9f0ffda8-7e3e-4308-83e6-4805650afa4f tempest-DeleteServersTestJSON-126197053 tempest-DeleteServersTestJSON-126197053-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:51:22.381108 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-9f0ffda8-7e3e-4308-83e6-4805650afa4f tempest-DeleteServersTestJSON-126197053 tempest-DeleteServersTestJSON-126197053-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:51:22.383889 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-9f0ffda8-7e3e-4308-83e6-4805650afa4f tempest-DeleteServersTestJSON-126197053 tempest-DeleteServersTestJSON-126197053-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:51:22.802544 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.network.neutron [None req-84a7a8a0-9a85-48b1-b9ad-12a677f2897e tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] validate_networks() for [('88e14c54-6fc1-4ee6-8dc1-d1927744d27d', None, None, None, None, None)] {{(pid=123459) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 29 08:51:23.241867 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-9f0ffda8-7e3e-4308-83e6-4805650afa4f tempest-DeleteServersTestJSON-126197053 tempest-DeleteServersTestJSON-126197053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8aa040fad7754a4ba5752413fcfde807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b69a8d69ede453aa373fca0a65bdedd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:51:23.253187 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-9f0ffda8-7e3e-4308-83e6-4805650afa4f tempest-DeleteServersTestJSON-126197053 tempest-DeleteServersTestJSON-126197053-project] 10.222.0.31 "GET /compute/v2.1/servers/2f7df954-edb0-41b8-a3d9-a8a870d487c3" status: 200 len: 1315 microversion: 2.1 time: 0.933351 Apr 29 08:51:23.254959 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 18/33] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 08:51:22 2022] GET /compute/v2.1/servers/2f7df954-edb0-41b8-a3d9-a8a870d487c3 => generated 1315 bytes in 936 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 08:51:23.261087 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-7b456baa-fe9b-4af0-a824-edc8f351c248 tempest-VolumesSnapshotsTestJSON-965621728 tempest-VolumesSnapshotsTestJSON-965621728-project] Calling method '.version_select at 0x7f6238f62670>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:51:23.351876 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-7b456baa-fe9b-4af0-a824-edc8f351c248 tempest-VolumesSnapshotsTestJSON-965621728 tempest-VolumesSnapshotsTestJSON-965621728-project] 10.222.0.31 "GET /compute/v2.1/os-volumes/490f30b1-7f6f-4f40-9074-79b8256dabe2" status: 200 len: 345 microversion: 2.1 time: 0.095753 Apr 29 08:51:23.357616 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 19/34] 10.222.0.31 () {58 vars in 1244 bytes} [Fri Apr 29 08:51:23 2022] GET /compute/v2.1/os-volumes/490f30b1-7f6f-4f40-9074-79b8256dabe2 => generated 345 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 29 08:51:24.275945 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-9fddef01-a9c4-4c82-b736-a10b45b370c6 tempest-DeleteServersTestJSON-126197053 tempest-DeleteServersTestJSON-126197053-project] Calling method '>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:51:24.276660 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-9fddef01-a9c4-4c82-b736-a10b45b370c6 tempest-DeleteServersTestJSON-126197053 tempest-DeleteServersTestJSON-126197053-project] [instance: 2f7df954-edb0-41b8-a3d9-a8a870d487c3] Fetching instance by UUID {{(pid=123458) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:51:24.290924 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-9fddef01-a9c4-4c82-b736-a10b45b370c6 tempest-DeleteServersTestJSON-126197053 tempest-DeleteServersTestJSON-126197053-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:51:24.291567 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-9fddef01-a9c4-4c82-b736-a10b45b370c6 tempest-DeleteServersTestJSON-126197053 tempest-DeleteServersTestJSON-126197053-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:51:24.293016 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-9fddef01-a9c4-4c82-b736-a10b45b370c6 tempest-DeleteServersTestJSON-126197053 tempest-DeleteServersTestJSON-126197053-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:51:24.293636 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-9fddef01-a9c4-4c82-b736-a10b45b370c6 tempest-DeleteServersTestJSON-126197053 tempest-DeleteServersTestJSON-126197053-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:51:24.592050 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.virt.hardware [None req-84a7a8a0-9a85-48b1-b9ad-12a677f2897e tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Flavor limits 0:0:0 {{(pid=123459) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 29 08:51:24.595733 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.virt.hardware [None req-84a7a8a0-9a85-48b1-b9ad-12a677f2897e tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Image limits 0:0:0 {{(pid=123459) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 29 08:51:24.597205 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.virt.hardware [None req-84a7a8a0-9a85-48b1-b9ad-12a677f2897e tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Flavor pref 0:0:0 {{(pid=123459) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 29 08:51:24.598521 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.virt.hardware [None req-84a7a8a0-9a85-48b1-b9ad-12a677f2897e tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Image pref 0:0:0 {{(pid=123459) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 29 08:51:24.600262 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.virt.hardware [None req-84a7a8a0-9a85-48b1-b9ad-12a677f2897e tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123459) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 29 08:51:24.638350 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-84a7a8a0-9a85-48b1-b9ad-12a677f2897e tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:51:24.639143 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-84a7a8a0-9a85-48b1-b9ad-12a677f2897e tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:51:24.640448 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-84a7a8a0-9a85-48b1-b9ad-12a677f2897e tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:51:24.641286 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-84a7a8a0-9a85-48b1-b9ad-12a677f2897e tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:51:24.695485 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-9fddef01-a9c4-4c82-b736-a10b45b370c6 tempest-DeleteServersTestJSON-126197053 tempest-DeleteServersTestJSON-126197053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8aa040fad7754a4ba5752413fcfde807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b69a8d69ede453aa373fca0a65bdedd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:51:24.700914 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.quota [None req-84a7a8a0-9a85-48b1-b9ad-12a677f2897e tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Getting quotas for project 81c2c3d18ff34afe806e090aec002a4b. Resources: {'instances', 'cores', 'ram'} {{(pid=123459) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 29 08:51:24.704448 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-9fddef01-a9c4-4c82-b736-a10b45b370c6 tempest-DeleteServersTestJSON-126197053 tempest-DeleteServersTestJSON-126197053-project] 10.222.0.31 "GET /compute/v2.1/servers/2f7df954-edb0-41b8-a3d9-a8a870d487c3" status: 200 len: 1315 microversion: 2.1 time: 0.437067 Apr 29 08:51:24.709298 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 20/35] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 08:51:24 2022] GET /compute/v2.1/servers/2f7df954-edb0-41b8-a3d9-a8a870d487c3 => generated 1315 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 29 08:51:24.726004 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.quota [None req-84a7a8a0-9a85-48b1-b9ad-12a677f2897e tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Getting quotas for user abdb65629422487fba47326d5971bb3f and project 81c2c3d18ff34afe806e090aec002a4b. Resources: {'instances', 'cores', 'ram'} {{(pid=123459) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 29 08:51:24.729868 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-3c2ce54c-3b85-46c0-8fdb-c1a7d5e03ade tempest-VolumesSnapshotsTestJSON-965621728 tempest-VolumesSnapshotsTestJSON-965621728-project] Calling method '.version_select at 0x7f6238f62160>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:51:24.771455 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-84a7a8a0-9a85-48b1-b9ad-12a677f2897e tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Going to run 1 instances... {{(pid=123459) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 29 08:51:24.774550 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-84a7a8a0-9a85-48b1-b9ad-12a677f2897e tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] [instance: 406b5ad6-698e-457f-93f4-cdfd45fb3e8e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e0678f88-0b68-4453-b569-29fd065e544e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123459) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 29 08:51:24.922499 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-3c2ce54c-3b85-46c0-8fdb-c1a7d5e03ade tempest-VolumesSnapshotsTestJSON-965621728 tempest-VolumesSnapshotsTestJSON-965621728-project] 10.222.0.31 "GET /compute/v2.1/os-volumes/490f30b1-7f6f-4f40-9074-79b8256dabe2" status: 200 len: 345 microversion: 2.1 time: 0.211960 Apr 29 08:51:24.929276 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 21/36] 10.222.0.31 () {58 vars in 1244 bytes} [Fri Apr 29 08:51:24 2022] GET /compute/v2.1/os-volumes/490f30b1-7f6f-4f40-9074-79b8256dabe2 => generated 345 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 29 08:51:24.954722 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-84a7a8a0-9a85-48b1-b9ad-12a677f2897e tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] 10.222.0.31 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 2.639203 Apr 29 08:51:24.956364 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 16/37] 10.222.0.31 () {62 vars in 1187 bytes} [Fri Apr 29 08:51:22 2022] POST /compute/v2.1/servers => generated 402 bytes in 2645 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Apr 29 08:51:24.969247 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-6ec65be8-ff6b-46d2-bbbd-cd30f6218149 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Calling method '>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:51:24.970631 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-6ec65be8-ff6b-46d2-bbbd-cd30f6218149 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] [instance: 406b5ad6-698e-457f-93f4-cdfd45fb3e8e] Fetching instance by UUID {{(pid=123458) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:51:25.173330 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-6ec65be8-ff6b-46d2-bbbd-cd30f6218149 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:51:25.193666 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-6ec65be8-ff6b-46d2-bbbd-cd30f6218149 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:51:25.199501 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-6ec65be8-ff6b-46d2-bbbd-cd30f6218149 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:51:25.205742 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-6ec65be8-ff6b-46d2-bbbd-cd30f6218149 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] 10.222.0.31 "GET /compute/v2.1/servers/406b5ad6-698e-457f-93f4-cdfd45fb3e8e" status: 200 len: 1282 microversion: 2.20 time: 0.240878 Apr 29 08:51:25.206940 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 22/38] 10.222.0.31 () {60 vars in 1276 bytes} [Fri Apr 29 08:51:24 2022] GET /compute/v2.1/servers/406b5ad6-698e-457f-93f4-cdfd45fb3e8e => generated 1282 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 29 08:51:25.713567 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-fd3e3a9b-4af2-4cc6-bec6-cd9aeec11093 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-2066327339", "imageRef": "e0678f88-0b68-4453-b569-29fd065e544e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "b24838f8-74fc-43df-860b-f0934d3ce2df"}], "security_groups": [{"name": "tempest-securitygroup--1730123817"}], "key_name": "tempest-keypair-1129396086", "user_data": "}} {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 29 08:51:25.732052 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-b3fa91cf-807d-43ba-b91f-d94b92349009 tempest-DeleteServersTestJSON-126197053 tempest-DeleteServersTestJSON-126197053-project] Calling method '>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:51:25.733205 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-b3fa91cf-807d-43ba-b91f-d94b92349009 tempest-DeleteServersTestJSON-126197053 tempest-DeleteServersTestJSON-126197053-project] [instance: 2f7df954-edb0-41b8-a3d9-a8a870d487c3] Fetching instance by UUID {{(pid=123458) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:51:25.742458 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-b3fa91cf-807d-43ba-b91f-d94b92349009 tempest-DeleteServersTestJSON-126197053 tempest-DeleteServersTestJSON-126197053-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:51:25.742924 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-b3fa91cf-807d-43ba-b91f-d94b92349009 tempest-DeleteServersTestJSON-126197053 tempest-DeleteServersTestJSON-126197053-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:51:25.743737 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-b3fa91cf-807d-43ba-b91f-d94b92349009 tempest-DeleteServersTestJSON-126197053 tempest-DeleteServersTestJSON-126197053-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:51:25.744232 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-b3fa91cf-807d-43ba-b91f-d94b92349009 tempest-DeleteServersTestJSON-126197053 tempest-DeleteServersTestJSON-126197053-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:51:26.131902 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.network.neutron [None req-fd3e3a9b-4af2-4cc6-bec6-cd9aeec11093 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] validate_networks() for [('b24838f8-74fc-43df-860b-f0934d3ce2df', None, None, None, None, None)] {{(pid=123459) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 29 08:51:26.424617 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-b3fa91cf-807d-43ba-b91f-d94b92349009 tempest-DeleteServersTestJSON-126197053 tempest-DeleteServersTestJSON-126197053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8aa040fad7754a4ba5752413fcfde807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b69a8d69ede453aa373fca0a65bdedd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:51:26.444287 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-b3fa91cf-807d-43ba-b91f-d94b92349009 tempest-DeleteServersTestJSON-126197053 tempest-DeleteServersTestJSON-126197053-project] 10.222.0.31 "GET /compute/v2.1/servers/2f7df954-edb0-41b8-a3d9-a8a870d487c3" status: 200 len: 1315 microversion: 2.1 time: 0.716006 Apr 29 08:51:26.446354 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 23/39] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 08:51:25 2022] GET /compute/v2.1/servers/2f7df954-edb0-41b8-a3d9-a8a870d487c3 => generated 1315 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 08:51:26.467902 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-33336088-a8c4-4873-81c6-70b1f6346ab3 tempest-VolumesSnapshotsTestJSON-965621728 tempest-VolumesSnapshotsTestJSON-965621728-project] Calling method '.version_select at 0x7f6238f62790>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:51:26.570983 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-33336088-a8c4-4873-81c6-70b1f6346ab3 tempest-VolumesSnapshotsTestJSON-965621728 tempest-VolumesSnapshotsTestJSON-965621728-project] 10.222.0.31 "GET /compute/v2.1/os-volumes/490f30b1-7f6f-4f40-9074-79b8256dabe2" status: 200 len: 345 microversion: 2.1 time: 0.120506 Apr 29 08:51:26.581542 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 24/40] 10.222.0.31 () {58 vars in 1244 bytes} [Fri Apr 29 08:51:26 2022] GET /compute/v2.1/os-volumes/490f30b1-7f6f-4f40-9074-79b8256dabe2 => generated 345 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 29 08:51:26.592369 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-330e08a9-0b74-46e4-ae1a-86195063fb15 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Calling method '>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:51:26.593646 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-330e08a9-0b74-46e4-ae1a-86195063fb15 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] [instance: 406b5ad6-698e-457f-93f4-cdfd45fb3e8e] Fetching instance by UUID {{(pid=123458) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:51:26.860959 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-330e08a9-0b74-46e4-ae1a-86195063fb15 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:51:26.874927 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-330e08a9-0b74-46e4-ae1a-86195063fb15 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:51:26.879920 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-330e08a9-0b74-46e4-ae1a-86195063fb15 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:51:26.882036 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-330e08a9-0b74-46e4-ae1a-86195063fb15 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] 10.222.0.31 "GET /compute/v2.1/servers/406b5ad6-698e-457f-93f4-cdfd45fb3e8e" status: 200 len: 1282 microversion: 2.20 time: 0.298548 Apr 29 08:51:26.882913 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 25/41] 10.222.0.31 () {60 vars in 1276 bytes} [Fri Apr 29 08:51:26 2022] GET /compute/v2.1/servers/406b5ad6-698e-457f-93f4-cdfd45fb3e8e => generated 1282 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 29 08:51:26.962826 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.virt.hardware [None req-fd3e3a9b-4af2-4cc6-bec6-cd9aeec11093 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Flavor limits 0:0:0 {{(pid=123459) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 29 08:51:26.963488 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.virt.hardware [None req-fd3e3a9b-4af2-4cc6-bec6-cd9aeec11093 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Image limits 0:0:0 {{(pid=123459) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 29 08:51:26.963718 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.virt.hardware [None req-fd3e3a9b-4af2-4cc6-bec6-cd9aeec11093 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Flavor pref 0:0:0 {{(pid=123459) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 29 08:51:26.964165 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.virt.hardware [None req-fd3e3a9b-4af2-4cc6-bec6-cd9aeec11093 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Image pref 0:0:0 {{(pid=123459) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 29 08:51:26.965264 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.virt.hardware [None req-fd3e3a9b-4af2-4cc6-bec6-cd9aeec11093 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123459) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 29 08:51:26.978848 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-fd3e3a9b-4af2-4cc6-bec6-cd9aeec11093 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:51:26.979402 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-fd3e3a9b-4af2-4cc6-bec6-cd9aeec11093 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:51:26.980834 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-fd3e3a9b-4af2-4cc6-bec6-cd9aeec11093 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:51:26.981326 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-fd3e3a9b-4af2-4cc6-bec6-cd9aeec11093 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:51:27.002171 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.quota [None req-fd3e3a9b-4af2-4cc6-bec6-cd9aeec11093 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Getting quotas for project 578e6a35974d4e5c8a0cd4e5fa994259. Resources: {'instances', 'cores', 'ram'} {{(pid=123459) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 29 08:51:27.007450 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.quota [None req-fd3e3a9b-4af2-4cc6-bec6-cd9aeec11093 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Getting quotas for user 8e47ecdfb01f447699275b13255c15d4 and project 578e6a35974d4e5c8a0cd4e5fa994259. Resources: {'instances', 'cores', 'ram'} {{(pid=123459) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 29 08:51:27.023138 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-fd3e3a9b-4af2-4cc6-bec6-cd9aeec11093 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Going to run 1 instances... {{(pid=123459) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 29 08:51:27.025452 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-fd3e3a9b-4af2-4cc6-bec6-cd9aeec11093 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] [instance: 0f9c17b6-b1a2-4ec6-ba8c-2097a8c8ccb7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e0678f88-0b68-4453-b569-29fd065e544e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123459) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 29 08:51:27.081619 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-fd3e3a9b-4af2-4cc6-bec6-cd9aeec11093 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] 10.222.0.31 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.374596 Apr 29 08:51:27.083023 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 17/42] 10.222.0.31 () {60 vars in 1146 bytes} [Fri Apr 29 08:51:25 2022] POST /compute/v2.1/servers => generated 402 bytes in 1377 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 29 08:51:27.094145 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-84699618-f359-47d1-b3fc-b48b7b44c556 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Calling method '>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:51:27.095146 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-84699618-f359-47d1-b3fc-b48b7b44c556 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] [instance: 0f9c17b6-b1a2-4ec6-ba8c-2097a8c8ccb7] Fetching instance by UUID {{(pid=123458) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:51:27.237483 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-84699618-f359-47d1-b3fc-b48b7b44c556 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e47ecdfb01f447699275b13255c15d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578e6a35974d4e5c8a0cd4e5fa994259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:51:27.250006 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-84699618-f359-47d1-b3fc-b48b7b44c556 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] 10.222.0.31 "GET /compute/v2.1/servers/0f9c17b6-b1a2-4ec6-ba8c-2097a8c8ccb7" status: 200 len: 1242 microversion: 2.1 time: 0.160110 Apr 29 08:51:27.251686 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 26/43] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 08:51:27 2022] GET /compute/v2.1/servers/0f9c17b6-b1a2-4ec6-ba8c-2097a8c8ccb7 => generated 1242 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 08:51:27.473430 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-5648338c-1645-47d1-9afc-eacfd1a5fef3 tempest-DeleteServersTestJSON-126197053 tempest-DeleteServersTestJSON-126197053-project] Calling method '>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:51:27.474630 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-5648338c-1645-47d1-9afc-eacfd1a5fef3 tempest-DeleteServersTestJSON-126197053 tempest-DeleteServersTestJSON-126197053-project] [instance: 2f7df954-edb0-41b8-a3d9-a8a870d487c3] Fetching instance by UUID {{(pid=123459) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:51:27.489489 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-5648338c-1645-47d1-9afc-eacfd1a5fef3 tempest-DeleteServersTestJSON-126197053 tempest-DeleteServersTestJSON-126197053-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:51:27.490472 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-5648338c-1645-47d1-9afc-eacfd1a5fef3 tempest-DeleteServersTestJSON-126197053 tempest-DeleteServersTestJSON-126197053-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:51:27.493906 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-5648338c-1645-47d1-9afc-eacfd1a5fef3 tempest-DeleteServersTestJSON-126197053 tempest-DeleteServersTestJSON-126197053-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:51:27.494712 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-5648338c-1645-47d1-9afc-eacfd1a5fef3 tempest-DeleteServersTestJSON-126197053 tempest-DeleteServersTestJSON-126197053-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:51:27.587654 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-4d4e9620-5749-47f3-a2e0-fd340fdc8147 tempest-VolumesSnapshotsTestJSON-965621728 tempest-VolumesSnapshotsTestJSON-965621728-project] Calling method '.version_select at 0x7f6238f62040>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:51:27.727859 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-4d4e9620-5749-47f3-a2e0-fd340fdc8147 tempest-VolumesSnapshotsTestJSON-965621728 tempest-VolumesSnapshotsTestJSON-965621728-project] 10.222.0.31 "GET /compute/v2.1/os-volumes/490f30b1-7f6f-4f40-9074-79b8256dabe2" status: 200 len: 345 microversion: 2.1 time: 0.146481 Apr 29 08:51:27.728606 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 27/44] 10.222.0.31 () {58 vars in 1244 bytes} [Fri Apr 29 08:51:27 2022] GET /compute/v2.1/os-volumes/490f30b1-7f6f-4f40-9074-79b8256dabe2 => generated 345 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 29 08:51:27.907032 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-c06bbe4c-5cd9-4114-8295-0f568be68c31 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Calling method '>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:51:27.908662 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-c06bbe4c-5cd9-4114-8295-0f568be68c31 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] [instance: 406b5ad6-698e-457f-93f4-cdfd45fb3e8e] Fetching instance by UUID {{(pid=123458) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:51:27.921968 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-c06bbe4c-5cd9-4114-8295-0f568be68c31 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:51:27.924909 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-c06bbe4c-5cd9-4114-8295-0f568be68c31 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:51:27.926072 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-c06bbe4c-5cd9-4114-8295-0f568be68c31 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:51:27.929580 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-c06bbe4c-5cd9-4114-8295-0f568be68c31 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:51:27.976995 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-5648338c-1645-47d1-9afc-eacfd1a5fef3 tempest-DeleteServersTestJSON-126197053 tempest-DeleteServersTestJSON-126197053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8aa040fad7754a4ba5752413fcfde807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b69a8d69ede453aa373fca0a65bdedd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:51:28.016704 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-5648338c-1645-47d1-9afc-eacfd1a5fef3 tempest-DeleteServersTestJSON-126197053 tempest-DeleteServersTestJSON-126197053-project] 10.222.0.31 "GET /compute/v2.1/servers/2f7df954-edb0-41b8-a3d9-a8a870d487c3" status: 200 len: 1315 microversion: 2.1 time: 0.549708 Apr 29 08:51:28.025387 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 18/45] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 08:51:27 2022] GET /compute/v2.1/servers/2f7df954-edb0-41b8-a3d9-a8a870d487c3 => generated 1315 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 08:51:28.155635 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-c06bbe4c-5cd9-4114-8295-0f568be68c31 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:51:28.189239 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-c06bbe4c-5cd9-4114-8295-0f568be68c31 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:51:28.197426 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-c06bbe4c-5cd9-4114-8295-0f568be68c31 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:51:28.206220 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-c06bbe4c-5cd9-4114-8295-0f568be68c31 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] 10.222.0.31 "GET /compute/v2.1/servers/406b5ad6-698e-457f-93f4-cdfd45fb3e8e" status: 200 len: 1286 microversion: 2.20 time: 0.305516 Apr 29 08:51:28.213941 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 28/46] 10.222.0.31 () {60 vars in 1276 bytes} [Fri Apr 29 08:51:27 2022] GET /compute/v2.1/servers/406b5ad6-698e-457f-93f4-cdfd45fb3e8e => generated 1286 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 29 08:51:28.283195 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-a9820e10-3bf7-4c5e-ad6d-951296f85e20 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Calling method '>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:51:28.287801 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-a9820e10-3bf7-4c5e-ad6d-951296f85e20 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] [instance: 0f9c17b6-b1a2-4ec6-ba8c-2097a8c8ccb7] Fetching instance by UUID {{(pid=123459) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:51:28.322142 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-a9820e10-3bf7-4c5e-ad6d-951296f85e20 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:51:28.324567 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-a9820e10-3bf7-4c5e-ad6d-951296f85e20 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:51:28.329506 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-a9820e10-3bf7-4c5e-ad6d-951296f85e20 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:51:28.330718 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-a9820e10-3bf7-4c5e-ad6d-951296f85e20 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:51:28.490769 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-a9820e10-3bf7-4c5e-ad6d-951296f85e20 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e47ecdfb01f447699275b13255c15d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578e6a35974d4e5c8a0cd4e5fa994259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:51:28.502856 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-a9820e10-3bf7-4c5e-ad6d-951296f85e20 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] 10.222.0.31 "GET /compute/v2.1/servers/0f9c17b6-b1a2-4ec6-ba8c-2097a8c8ccb7" status: 200 len: 1246 microversion: 2.1 time: 0.238281 Apr 29 08:51:28.510612 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 19/47] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 08:51:28 2022] GET /compute/v2.1/servers/0f9c17b6-b1a2-4ec6-ba8c-2097a8c8ccb7 => generated 1246 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 08:51:28.744852 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-1793bb10-43a6-4dd7-81d9-8ac41db74783 tempest-VolumesSnapshotsTestJSON-965621728 tempest-VolumesSnapshotsTestJSON-965621728-project] Calling method '.version_select at 0x7f6238f621f0>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:51:28.804180 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.wsgi [None req-1793bb10-43a6-4dd7-81d9-8ac41db74783 tempest-VolumesSnapshotsTestJSON-965621728 tempest-VolumesSnapshotsTestJSON-965621728-project] HTTP exception thrown: Volume 490f30b1-7f6f-4f40-9074-79b8256dabe2 could not be found. Apr 29 08:51:28.805093 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-1793bb10-43a6-4dd7-81d9-8ac41db74783 tempest-VolumesSnapshotsTestJSON-965621728 tempest-VolumesSnapshotsTestJSON-965621728-project] Returning 404 to user: Volume 490f30b1-7f6f-4f40-9074-79b8256dabe2 could not be found. {{(pid=123458) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 29 08:51:28.806311 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-1793bb10-43a6-4dd7-81d9-8ac41db74783 tempest-VolumesSnapshotsTestJSON-965621728 tempest-VolumesSnapshotsTestJSON-965621728-project] 10.222.0.31 "GET /compute/v2.1/os-volumes/490f30b1-7f6f-4f40-9074-79b8256dabe2" status: 404 len: 109 microversion: 2.1 time: 0.066627 Apr 29 08:51:28.807502 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 29/48] 10.222.0.31 () {58 vars in 1244 bytes} [Fri Apr 29 08:51:28 2022] GET /compute/v2.1/os-volumes/490f30b1-7f6f-4f40-9074-79b8256dabe2 => generated 109 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 29 08:51:28.829724 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-38723c79-5cff-4157-83bc-bf23f911bdbd tempest-VolumesSnapshotsTestJSON-965621728 tempest-VolumesSnapshotsTestJSON-965621728-project] Calling method '.version_select at 0x7f62386c3a60>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:51:28.869921 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.wsgi [None req-38723c79-5cff-4157-83bc-bf23f911bdbd tempest-VolumesSnapshotsTestJSON-965621728 tempest-VolumesSnapshotsTestJSON-965621728-project] HTTP exception thrown: Volume 490f30b1-7f6f-4f40-9074-79b8256dabe2 could not be found. Apr 29 08:51:28.871193 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-38723c79-5cff-4157-83bc-bf23f911bdbd tempest-VolumesSnapshotsTestJSON-965621728 tempest-VolumesSnapshotsTestJSON-965621728-project] Returning 404 to user: Volume 490f30b1-7f6f-4f40-9074-79b8256dabe2 could not be found. {{(pid=123459) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 29 08:51:28.872449 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-38723c79-5cff-4157-83bc-bf23f911bdbd tempest-VolumesSnapshotsTestJSON-965621728 tempest-VolumesSnapshotsTestJSON-965621728-project] 10.222.0.31 "DELETE /compute/v2.1/os-volumes/490f30b1-7f6f-4f40-9074-79b8256dabe2" status: 404 len: 109 microversion: 2.1 time: 0.048995 Apr 29 08:51:28.877413 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 20/49] 10.222.0.31 () {58 vars in 1247 bytes} [Fri Apr 29 08:51:28 2022] DELETE /compute/v2.1/os-volumes/490f30b1-7f6f-4f40-9074-79b8256dabe2 => generated 109 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 29 08:51:28.885803 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-72cfea28-f9aa-4e2a-8604-38d3f1fb96fe tempest-VolumesSnapshotsTestJSON-965621728 tempest-VolumesSnapshotsTestJSON-965621728-project] Calling method '.version_select at 0x7f62397959d0>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:51:28.940991 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.wsgi [None req-72cfea28-f9aa-4e2a-8604-38d3f1fb96fe tempest-VolumesSnapshotsTestJSON-965621728 tempest-VolumesSnapshotsTestJSON-965621728-project] HTTP exception thrown: Volume 490f30b1-7f6f-4f40-9074-79b8256dabe2 could not be found. Apr 29 08:51:28.941589 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-72cfea28-f9aa-4e2a-8604-38d3f1fb96fe tempest-VolumesSnapshotsTestJSON-965621728 tempest-VolumesSnapshotsTestJSON-965621728-project] Returning 404 to user: Volume 490f30b1-7f6f-4f40-9074-79b8256dabe2 could not be found. {{(pid=123458) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 29 08:51:28.942435 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-72cfea28-f9aa-4e2a-8604-38d3f1fb96fe tempest-VolumesSnapshotsTestJSON-965621728 tempest-VolumesSnapshotsTestJSON-965621728-project] 10.222.0.31 "GET /compute/v2.1/os-volumes/490f30b1-7f6f-4f40-9074-79b8256dabe2" status: 404 len: 109 microversion: 2.1 time: 0.064038 Apr 29 08:51:28.948110 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 30/50] 10.222.0.31 () {58 vars in 1244 bytes} [Fri Apr 29 08:51:28 2022] GET /compute/v2.1/os-volumes/490f30b1-7f6f-4f40-9074-79b8256dabe2 => generated 109 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 29 08:51:29.048954 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-15ffed63-8348-4a29-a2eb-fc6526668c29 tempest-DeleteServersTestJSON-126197053 tempest-DeleteServersTestJSON-126197053-project] Calling method '>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:51:29.049580 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-15ffed63-8348-4a29-a2eb-fc6526668c29 tempest-DeleteServersTestJSON-126197053 tempest-DeleteServersTestJSON-126197053-project] [instance: 2f7df954-edb0-41b8-a3d9-a8a870d487c3] Fetching instance by UUID {{(pid=123458) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:51:29.072734 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-15ffed63-8348-4a29-a2eb-fc6526668c29 tempest-DeleteServersTestJSON-126197053 tempest-DeleteServersTestJSON-126197053-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:51:29.074969 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-15ffed63-8348-4a29-a2eb-fc6526668c29 tempest-DeleteServersTestJSON-126197053 tempest-DeleteServersTestJSON-126197053-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:51:29.076977 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-15ffed63-8348-4a29-a2eb-fc6526668c29 tempest-DeleteServersTestJSON-126197053 tempest-DeleteServersTestJSON-126197053-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:51:29.077471 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-15ffed63-8348-4a29-a2eb-fc6526668c29 tempest-DeleteServersTestJSON-126197053 tempest-DeleteServersTestJSON-126197053-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:51:29.117927 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [req-1ce42b0d-7703-4ca4-b64b-4af26edeff8f req-c5a55ea7-73a6-4bf3-affc-f915efb4621e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2f7df954-edb0-41b8-a3d9-a8a870d487c3", "tag": "028eab3d-f19b-4591-b8b2-199e74d95dfe"}]} {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 29 08:51:29.134644 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [req-1ce42b0d-7703-4ca4-b64b-4af26edeff8f req-c5a55ea7-73a6-4bf3-affc-f915efb4621e service nova] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:51:29.135383 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [req-1ce42b0d-7703-4ca4-b64b-4af26edeff8f req-c5a55ea7-73a6-4bf3-affc-f915efb4621e service nova] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:51:29.172906 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.compute.server_external_events [req-1ce42b0d-7703-4ca4-b64b-4af26edeff8f req-c5a55ea7-73a6-4bf3-affc-f915efb4621e service nova] Creating event network-changed:028eab3d-f19b-4591-b8b2-199e74d95dfe for instance 2f7df954-edb0-41b8-a3d9-a8a870d487c3 on hv-cinder-83987 Apr 29 08:51:29.173492 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [req-1ce42b0d-7703-4ca4-b64b-4af26edeff8f req-c5a55ea7-73a6-4bf3-affc-f915efb4621e service nova] Acquired lock "compute-rpcapi-router" {{(pid=123459) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Apr 29 08:51:29.174974 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-c72051a9-360e-4c5c-973a-a0321d9ba562 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:51:29.175455 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-c72051a9-360e-4c5c-973a-a0321d9ba562 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:51:29.176372 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-c72051a9-360e-4c5c-973a-a0321d9ba562 None None] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:51:29.176819 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-c72051a9-360e-4c5c-973a-a0321d9ba562 None None] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:51:29.188622 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.compute.rpcapi [None req-c72051a9-360e-4c5c-973a-a0321d9ba562 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Apr 29 08:51:29.189858 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-c72051a9-360e-4c5c-973a-a0321d9ba562 None None] Releasing lock "compute-rpcapi-router" {{(pid=123459) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Apr 29 08:51:29.228841 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-c72051a9-360e-4c5c-973a-a0321d9ba562 None None] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.337893 Apr 29 08:51:29.239291 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 21/51] 10.222.0.31 () {64 vars in 1317 bytes} [Fri Apr 29 08:51:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 29 08:51:29.248568 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-ac51d2cd-22cc-4aeb-97cd-b0c366c5f4de tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Calling method '>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:51:29.249712 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-ac51d2cd-22cc-4aeb-97cd-b0c366c5f4de tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] [instance: 406b5ad6-698e-457f-93f4-cdfd45fb3e8e] Fetching instance by UUID {{(pid=123459) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:51:29.269759 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-ac51d2cd-22cc-4aeb-97cd-b0c366c5f4de tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:51:29.270538 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-ac51d2cd-22cc-4aeb-97cd-b0c366c5f4de tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:51:29.272492 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-ac51d2cd-22cc-4aeb-97cd-b0c366c5f4de tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:51:29.273649 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-ac51d2cd-22cc-4aeb-97cd-b0c366c5f4de tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:51:29.522531 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-ac51d2cd-22cc-4aeb-97cd-b0c366c5f4de tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:51:29.541452 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-ac51d2cd-22cc-4aeb-97cd-b0c366c5f4de tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:51:29.543999 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-ac51d2cd-22cc-4aeb-97cd-b0c366c5f4de tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:51:29.545740 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-ac51d2cd-22cc-4aeb-97cd-b0c366c5f4de tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] 10.222.0.31 "GET /compute/v2.1/servers/406b5ad6-698e-457f-93f4-cdfd45fb3e8e" status: 200 len: 1334 microversion: 2.20 time: 0.304519 Apr 29 08:51:29.547025 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 22/52] 10.222.0.31 () {60 vars in 1276 bytes} [Fri Apr 29 08:51:29 2022] GET /compute/v2.1/servers/406b5ad6-698e-457f-93f4-cdfd45fb3e8e => generated 1334 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 29 08:51:29.551700 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-9ab76c60-bf66-4e3a-a8f4-3b52b60127b7 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Calling method '>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:51:29.552370 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-9ab76c60-bf66-4e3a-a8f4-3b52b60127b7 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] [instance: 0f9c17b6-b1a2-4ec6-ba8c-2097a8c8ccb7] Fetching instance by UUID {{(pid=123459) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:51:29.561389 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-9ab76c60-bf66-4e3a-a8f4-3b52b60127b7 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:51:29.561534 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-9ab76c60-bf66-4e3a-a8f4-3b52b60127b7 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:51:29.562322 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-9ab76c60-bf66-4e3a-a8f4-3b52b60127b7 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:51:29.562810 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-9ab76c60-bf66-4e3a-a8f4-3b52b60127b7 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:51:29.581003 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-15ffed63-8348-4a29-a2eb-fc6526668c29 tempest-DeleteServersTestJSON-126197053 tempest-DeleteServersTestJSON-126197053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8aa040fad7754a4ba5752413fcfde807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b69a8d69ede453aa373fca0a65bdedd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:51:29.599387 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-15ffed63-8348-4a29-a2eb-fc6526668c29 tempest-DeleteServersTestJSON-126197053 tempest-DeleteServersTestJSON-126197053-project] 10.222.0.31 "GET /compute/v2.1/servers/2f7df954-edb0-41b8-a3d9-a8a870d487c3" status: 200 len: 1315 microversion: 2.1 time: 0.561130 Apr 29 08:51:29.599975 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 31/53] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 08:51:29 2022] GET /compute/v2.1/servers/2f7df954-edb0-41b8-a3d9-a8a870d487c3 => generated 1315 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 08:51:29.699762 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-9ab76c60-bf66-4e3a-a8f4-3b52b60127b7 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e47ecdfb01f447699275b13255c15d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578e6a35974d4e5c8a0cd4e5fa994259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:51:29.710554 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-9ab76c60-bf66-4e3a-a8f4-3b52b60127b7 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] 10.222.0.31 "GET /compute/v2.1/servers/0f9c17b6-b1a2-4ec6-ba8c-2097a8c8ccb7" status: 200 len: 1246 microversion: 2.1 time: 0.162591 Apr 29 08:51:29.711164 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 23/54] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 08:51:29 2022] GET /compute/v2.1/servers/0f9c17b6-b1a2-4ec6-ba8c-2097a8c8ccb7 => generated 1246 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 08:51:30.581559 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-98c20326-c785-4597-b48c-7a902012ea9f tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Calling method '>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:51:30.582554 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-98c20326-c785-4597-b48c-7a902012ea9f tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] [instance: 406b5ad6-698e-457f-93f4-cdfd45fb3e8e] Fetching instance by UUID {{(pid=123458) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:51:30.618071 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-c022bd8d-2211-4b72-886e-fea487bb916f tempest-DeleteServersTestJSON-126197053 tempest-DeleteServersTestJSON-126197053-project] Calling method '>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:51:30.618751 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-c022bd8d-2211-4b72-886e-fea487bb916f tempest-DeleteServersTestJSON-126197053 tempest-DeleteServersTestJSON-126197053-project] [instance: 2f7df954-edb0-41b8-a3d9-a8a870d487c3] Fetching instance by UUID {{(pid=123459) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:51:30.628274 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-98c20326-c785-4597-b48c-7a902012ea9f tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:51:30.630168 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-98c20326-c785-4597-b48c-7a902012ea9f tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:51:30.631740 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-c022bd8d-2211-4b72-886e-fea487bb916f tempest-DeleteServersTestJSON-126197053 tempest-DeleteServersTestJSON-126197053-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:51:30.632123 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-98c20326-c785-4597-b48c-7a902012ea9f tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:51:30.632884 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-98c20326-c785-4597-b48c-7a902012ea9f tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:51:30.633806 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-c022bd8d-2211-4b72-886e-fea487bb916f tempest-DeleteServersTestJSON-126197053 tempest-DeleteServersTestJSON-126197053-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:51:30.637323 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-c022bd8d-2211-4b72-886e-fea487bb916f tempest-DeleteServersTestJSON-126197053 tempest-DeleteServersTestJSON-126197053-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:51:30.638009 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-c022bd8d-2211-4b72-886e-fea487bb916f tempest-DeleteServersTestJSON-126197053 tempest-DeleteServersTestJSON-126197053-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:51:30.776054 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-98c20326-c785-4597-b48c-7a902012ea9f tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:51:30.786803 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-98c20326-c785-4597-b48c-7a902012ea9f tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:51:30.799814 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-98c20326-c785-4597-b48c-7a902012ea9f tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:51:30.801634 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-98c20326-c785-4597-b48c-7a902012ea9f tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] 10.222.0.31 "GET /compute/v2.1/servers/406b5ad6-698e-457f-93f4-cdfd45fb3e8e" status: 200 len: 1334 microversion: 2.20 time: 0.225126 Apr 29 08:51:30.802602 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 32/55] 10.222.0.31 () {60 vars in 1276 bytes} [Fri Apr 29 08:51:30 2022] GET /compute/v2.1/servers/406b5ad6-698e-457f-93f4-cdfd45fb3e8e => generated 1334 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 29 08:51:30.822225 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-3ab7b361-73b1-4ca1-a89d-56ba4ebd3af6 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Calling method '>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:51:30.822967 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-3ab7b361-73b1-4ca1-a89d-56ba4ebd3af6 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] [instance: 0f9c17b6-b1a2-4ec6-ba8c-2097a8c8ccb7] Fetching instance by UUID {{(pid=123458) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:51:30.851660 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-3ab7b361-73b1-4ca1-a89d-56ba4ebd3af6 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:51:30.852165 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-3ab7b361-73b1-4ca1-a89d-56ba4ebd3af6 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:51:30.854581 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-3ab7b361-73b1-4ca1-a89d-56ba4ebd3af6 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:51:30.857537 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-3ab7b361-73b1-4ca1-a89d-56ba4ebd3af6 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:51:30.923415 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-c022bd8d-2211-4b72-886e-fea487bb916f tempest-DeleteServersTestJSON-126197053 tempest-DeleteServersTestJSON-126197053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8aa040fad7754a4ba5752413fcfde807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b69a8d69ede453aa373fca0a65bdedd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:51:30.934481 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-c022bd8d-2211-4b72-886e-fea487bb916f tempest-DeleteServersTestJSON-126197053 tempest-DeleteServersTestJSON-126197053-project] 10.222.0.31 "GET /compute/v2.1/servers/2f7df954-edb0-41b8-a3d9-a8a870d487c3" status: 200 len: 1315 microversion: 2.1 time: 0.320118 Apr 29 08:51:30.936112 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 24/56] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 08:51:30 2022] GET /compute/v2.1/servers/2f7df954-edb0-41b8-a3d9-a8a870d487c3 => generated 1315 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 08:51:31.070381 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-3ab7b361-73b1-4ca1-a89d-56ba4ebd3af6 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e47ecdfb01f447699275b13255c15d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578e6a35974d4e5c8a0cd4e5fa994259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:51:31.094814 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-3ab7b361-73b1-4ca1-a89d-56ba4ebd3af6 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] 10.222.0.31 "GET /compute/v2.1/servers/0f9c17b6-b1a2-4ec6-ba8c-2097a8c8ccb7" status: 200 len: 1238 microversion: 2.1 time: 0.283721 Apr 29 08:51:31.096115 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 33/57] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 08:51:30 2022] GET /compute/v2.1/servers/0f9c17b6-b1a2-4ec6-ba8c-2097a8c8ccb7 => generated 1238 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 08:51:31.825364 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-18bbfc94-45ad-4d96-87f2-eed40a945248 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Calling method '>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:51:31.826725 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-18bbfc94-45ad-4d96-87f2-eed40a945248 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] [instance: 406b5ad6-698e-457f-93f4-cdfd45fb3e8e] Fetching instance by UUID {{(pid=123459) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:51:31.841593 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-18bbfc94-45ad-4d96-87f2-eed40a945248 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:51:31.845655 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-18bbfc94-45ad-4d96-87f2-eed40a945248 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:51:31.851199 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-18bbfc94-45ad-4d96-87f2-eed40a945248 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:51:31.851542 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-18bbfc94-45ad-4d96-87f2-eed40a945248 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:51:31.954638 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-147ccbce-8b71-4ef7-baae-0bde0632b7ee tempest-DeleteServersTestJSON-126197053 tempest-DeleteServersTestJSON-126197053-project] Calling method '>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:51:31.955284 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-147ccbce-8b71-4ef7-baae-0bde0632b7ee tempest-DeleteServersTestJSON-126197053 tempest-DeleteServersTestJSON-126197053-project] [instance: 2f7df954-edb0-41b8-a3d9-a8a870d487c3] Fetching instance by UUID {{(pid=123458) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:51:31.969347 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-147ccbce-8b71-4ef7-baae-0bde0632b7ee tempest-DeleteServersTestJSON-126197053 tempest-DeleteServersTestJSON-126197053-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:51:31.969836 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-147ccbce-8b71-4ef7-baae-0bde0632b7ee tempest-DeleteServersTestJSON-126197053 tempest-DeleteServersTestJSON-126197053-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:51:31.970689 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-147ccbce-8b71-4ef7-baae-0bde0632b7ee tempest-DeleteServersTestJSON-126197053 tempest-DeleteServersTestJSON-126197053-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:51:31.971130 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-147ccbce-8b71-4ef7-baae-0bde0632b7ee tempest-DeleteServersTestJSON-126197053 tempest-DeleteServersTestJSON-126197053-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:51:32.000603 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-18bbfc94-45ad-4d96-87f2-eed40a945248 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:51:32.021372 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-18bbfc94-45ad-4d96-87f2-eed40a945248 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:51:32.023015 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-18bbfc94-45ad-4d96-87f2-eed40a945248 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:51:32.024193 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-18bbfc94-45ad-4d96-87f2-eed40a945248 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] 10.222.0.31 "GET /compute/v2.1/servers/406b5ad6-698e-457f-93f4-cdfd45fb3e8e" status: 200 len: 1340 microversion: 2.20 time: 0.203285 Apr 29 08:51:32.026259 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 25/58] 10.222.0.31 () {60 vars in 1276 bytes} [Fri Apr 29 08:51:31 2022] GET /compute/v2.1/servers/406b5ad6-698e-457f-93f4-cdfd45fb3e8e => generated 1340 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 29 08:51:32.115224 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-4b0fce63-c80c-416d-92da-f02bb2b6c164 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Calling method '>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:51:32.116094 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-4b0fce63-c80c-416d-92da-f02bb2b6c164 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] [instance: 0f9c17b6-b1a2-4ec6-ba8c-2097a8c8ccb7] Fetching instance by UUID {{(pid=123459) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:51:32.129550 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-4b0fce63-c80c-416d-92da-f02bb2b6c164 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:51:32.130044 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-4b0fce63-c80c-416d-92da-f02bb2b6c164 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:51:32.130900 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-4b0fce63-c80c-416d-92da-f02bb2b6c164 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:51:32.131348 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-4b0fce63-c80c-416d-92da-f02bb2b6c164 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:51:32.245497 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-4b0fce63-c80c-416d-92da-f02bb2b6c164 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e47ecdfb01f447699275b13255c15d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578e6a35974d4e5c8a0cd4e5fa994259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:51:32.265513 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-4b0fce63-c80c-416d-92da-f02bb2b6c164 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] 10.222.0.31 "GET /compute/v2.1/servers/0f9c17b6-b1a2-4ec6-ba8c-2097a8c8ccb7" status: 200 len: 1294 microversion: 2.1 time: 0.155128 Apr 29 08:51:32.278689 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 26/59] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 08:51:32 2022] GET /compute/v2.1/servers/0f9c17b6-b1a2-4ec6-ba8c-2097a8c8ccb7 => generated 1294 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 29 08:51:32.390484 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-147ccbce-8b71-4ef7-baae-0bde0632b7ee tempest-DeleteServersTestJSON-126197053 tempest-DeleteServersTestJSON-126197053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8aa040fad7754a4ba5752413fcfde807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b69a8d69ede453aa373fca0a65bdedd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:51:32.408865 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-147ccbce-8b71-4ef7-baae-0bde0632b7ee tempest-DeleteServersTestJSON-126197053 tempest-DeleteServersTestJSON-126197053-project] 10.222.0.31 "GET /compute/v2.1/servers/2f7df954-edb0-41b8-a3d9-a8a870d487c3" status: 200 len: 1315 microversion: 2.1 time: 0.456903 Apr 29 08:51:32.421678 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 34/60] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 08:51:31 2022] GET /compute/v2.1/servers/2f7df954-edb0-41b8-a3d9-a8a870d487c3 => generated 1315 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 29 08:51:33.045696 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-2088aa4d-7938-4d80-ae1f-6c9213b2306d tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Calling method '>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:51:33.046397 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-2088aa4d-7938-4d80-ae1f-6c9213b2306d tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] [instance: 406b5ad6-698e-457f-93f4-cdfd45fb3e8e] Fetching instance by UUID {{(pid=123459) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:51:33.059189 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-2088aa4d-7938-4d80-ae1f-6c9213b2306d tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:51:33.059421 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-2088aa4d-7938-4d80-ae1f-6c9213b2306d tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:51:33.060861 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-2088aa4d-7938-4d80-ae1f-6c9213b2306d tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:51:33.061857 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-2088aa4d-7938-4d80-ae1f-6c9213b2306d tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:51:33.158013 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-2088aa4d-7938-4d80-ae1f-6c9213b2306d tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:51:33.174065 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-2088aa4d-7938-4d80-ae1f-6c9213b2306d tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:51:33.177643 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-2088aa4d-7938-4d80-ae1f-6c9213b2306d tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:51:33.179998 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-2088aa4d-7938-4d80-ae1f-6c9213b2306d tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] 10.222.0.31 "GET /compute/v2.1/servers/406b5ad6-698e-457f-93f4-cdfd45fb3e8e" status: 200 len: 1340 microversion: 2.20 time: 0.138473 Apr 29 08:51:33.191711 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 27/61] 10.222.0.31 () {60 vars in 1276 bytes} [Fri Apr 29 08:51:33 2022] GET /compute/v2.1/servers/406b5ad6-698e-457f-93f4-cdfd45fb3e8e => generated 1340 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 29 08:51:33.288085 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-f86150a1-0eda-4f65-8988-6095892530e0 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Calling method '>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:51:33.288915 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-f86150a1-0eda-4f65-8988-6095892530e0 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] [instance: 0f9c17b6-b1a2-4ec6-ba8c-2097a8c8ccb7] Fetching instance by UUID {{(pid=123458) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:51:33.307196 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-f86150a1-0eda-4f65-8988-6095892530e0 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:51:33.307827 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-f86150a1-0eda-4f65-8988-6095892530e0 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:51:33.309564 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-f86150a1-0eda-4f65-8988-6095892530e0 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:51:33.310263 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-f86150a1-0eda-4f65-8988-6095892530e0 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:51:33.429468 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-c67488a0-4cbc-4eff-8f35-759e8bc45a62 tempest-DeleteServersTestJSON-126197053 tempest-DeleteServersTestJSON-126197053-project] Calling method '>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:51:33.430481 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-c67488a0-4cbc-4eff-8f35-759e8bc45a62 tempest-DeleteServersTestJSON-126197053 tempest-DeleteServersTestJSON-126197053-project] [instance: 2f7df954-edb0-41b8-a3d9-a8a870d487c3] Fetching instance by UUID {{(pid=123459) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:51:33.435133 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-f86150a1-0eda-4f65-8988-6095892530e0 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e47ecdfb01f447699275b13255c15d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578e6a35974d4e5c8a0cd4e5fa994259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:51:33.438935 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-c67488a0-4cbc-4eff-8f35-759e8bc45a62 tempest-DeleteServersTestJSON-126197053 tempest-DeleteServersTestJSON-126197053-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:51:33.439603 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-c67488a0-4cbc-4eff-8f35-759e8bc45a62 tempest-DeleteServersTestJSON-126197053 tempest-DeleteServersTestJSON-126197053-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:51:33.440765 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-c67488a0-4cbc-4eff-8f35-759e8bc45a62 tempest-DeleteServersTestJSON-126197053 tempest-DeleteServersTestJSON-126197053-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:51:33.441537 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-c67488a0-4cbc-4eff-8f35-759e8bc45a62 tempest-DeleteServersTestJSON-126197053 tempest-DeleteServersTestJSON-126197053-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:51:33.448175 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-f86150a1-0eda-4f65-8988-6095892530e0 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] 10.222.0.31 "GET /compute/v2.1/servers/0f9c17b6-b1a2-4ec6-ba8c-2097a8c8ccb7" status: 200 len: 1294 microversion: 2.1 time: 0.161151 Apr 29 08:51:33.452300 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 35/62] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 08:51:33 2022] GET /compute/v2.1/servers/0f9c17b6-b1a2-4ec6-ba8c-2097a8c8ccb7 => generated 1294 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 08:51:33.685523 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-c67488a0-4cbc-4eff-8f35-759e8bc45a62 tempest-DeleteServersTestJSON-126197053 tempest-DeleteServersTestJSON-126197053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8aa040fad7754a4ba5752413fcfde807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b69a8d69ede453aa373fca0a65bdedd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:51:33.699533 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-c67488a0-4cbc-4eff-8f35-759e8bc45a62 tempest-DeleteServersTestJSON-126197053 tempest-DeleteServersTestJSON-126197053-project] 10.222.0.31 "GET /compute/v2.1/servers/2f7df954-edb0-41b8-a3d9-a8a870d487c3" status: 200 len: 1315 microversion: 2.1 time: 0.274431 Apr 29 08:51:33.701748 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 28/63] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 08:51:33 2022] GET /compute/v2.1/servers/2f7df954-edb0-41b8-a3d9-a8a870d487c3 => generated 1315 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 08:51:34.200501 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-cae380cd-65aa-471a-8263-d55747d6134d tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Calling method '>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:51:34.201609 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-cae380cd-65aa-471a-8263-d55747d6134d tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] [instance: 406b5ad6-698e-457f-93f4-cdfd45fb3e8e] Fetching instance by UUID {{(pid=123458) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:51:34.224665 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-cae380cd-65aa-471a-8263-d55747d6134d tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:51:34.224980 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-cae380cd-65aa-471a-8263-d55747d6134d tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:51:34.225739 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-cae380cd-65aa-471a-8263-d55747d6134d tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:51:34.226186 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-cae380cd-65aa-471a-8263-d55747d6134d tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:51:34.441858 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-cae380cd-65aa-471a-8263-d55747d6134d tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:51:34.454809 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-cae380cd-65aa-471a-8263-d55747d6134d tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:51:34.456763 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-cae380cd-65aa-471a-8263-d55747d6134d tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:51:34.458175 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-cae380cd-65aa-471a-8263-d55747d6134d tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] 10.222.0.31 "GET /compute/v2.1/servers/406b5ad6-698e-457f-93f4-cdfd45fb3e8e" status: 200 len: 1340 microversion: 2.20 time: 0.262970 Apr 29 08:51:34.458691 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 36/64] 10.222.0.31 () {60 vars in 1276 bytes} [Fri Apr 29 08:51:34 2022] GET /compute/v2.1/servers/406b5ad6-698e-457f-93f4-cdfd45fb3e8e => generated 1340 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 29 08:51:34.467874 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-a75bc638-2de6-4c0c-8f81-589de0c12540 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Calling method '>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:51:34.469237 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-a75bc638-2de6-4c0c-8f81-589de0c12540 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] [instance: 0f9c17b6-b1a2-4ec6-ba8c-2097a8c8ccb7] Fetching instance by UUID {{(pid=123459) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:51:34.482866 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-a75bc638-2de6-4c0c-8f81-589de0c12540 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:51:34.483325 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-a75bc638-2de6-4c0c-8f81-589de0c12540 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:51:34.484159 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-a75bc638-2de6-4c0c-8f81-589de0c12540 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:51:34.484614 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-a75bc638-2de6-4c0c-8f81-589de0c12540 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:51:34.626061 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-a75bc638-2de6-4c0c-8f81-589de0c12540 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e47ecdfb01f447699275b13255c15d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578e6a35974d4e5c8a0cd4e5fa994259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:51:34.642319 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-a75bc638-2de6-4c0c-8f81-589de0c12540 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] 10.222.0.31 "GET /compute/v2.1/servers/0f9c17b6-b1a2-4ec6-ba8c-2097a8c8ccb7" status: 200 len: 1302 microversion: 2.1 time: 0.177079 Apr 29 08:51:34.647276 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 29/65] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 08:51:34 2022] GET /compute/v2.1/servers/0f9c17b6-b1a2-4ec6-ba8c-2097a8c8ccb7 => generated 1302 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 08:51:34.726313 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-25764410-4f5c-42c9-8dcd-835dbdf28e70 tempest-DeleteServersTestJSON-126197053 tempest-DeleteServersTestJSON-126197053-project] Calling method '>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:51:34.726313 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-25764410-4f5c-42c9-8dcd-835dbdf28e70 tempest-DeleteServersTestJSON-126197053 tempest-DeleteServersTestJSON-126197053-project] [instance: 2f7df954-edb0-41b8-a3d9-a8a870d487c3] Fetching instance by UUID {{(pid=123458) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:51:34.736845 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-25764410-4f5c-42c9-8dcd-835dbdf28e70 tempest-DeleteServersTestJSON-126197053 tempest-DeleteServersTestJSON-126197053-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:51:34.737294 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-25764410-4f5c-42c9-8dcd-835dbdf28e70 tempest-DeleteServersTestJSON-126197053 tempest-DeleteServersTestJSON-126197053-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:51:34.742862 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-25764410-4f5c-42c9-8dcd-835dbdf28e70 tempest-DeleteServersTestJSON-126197053 tempest-DeleteServersTestJSON-126197053-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:51:34.745979 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-25764410-4f5c-42c9-8dcd-835dbdf28e70 tempest-DeleteServersTestJSON-126197053 tempest-DeleteServersTestJSON-126197053-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:51:34.950135 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-25764410-4f5c-42c9-8dcd-835dbdf28e70 tempest-DeleteServersTestJSON-126197053 tempest-DeleteServersTestJSON-126197053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8aa040fad7754a4ba5752413fcfde807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b69a8d69ede453aa373fca0a65bdedd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:51:34.958038 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-25764410-4f5c-42c9-8dcd-835dbdf28e70 tempest-DeleteServersTestJSON-126197053 tempest-DeleteServersTestJSON-126197053-project] 10.222.0.31 "GET /compute/v2.1/servers/2f7df954-edb0-41b8-a3d9-a8a870d487c3" status: 200 len: 1315 microversion: 2.1 time: 0.239365 Apr 29 08:51:34.958710 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 37/66] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 08:51:34 2022] GET /compute/v2.1/servers/2f7df954-edb0-41b8-a3d9-a8a870d487c3 => generated 1315 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 08:51:35.479418 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-7e8e3468-48ca-4a42-b7d1-e04e82be5a5f tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Calling method '>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:51:35.480763 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-7e8e3468-48ca-4a42-b7d1-e04e82be5a5f tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] [instance: 406b5ad6-698e-457f-93f4-cdfd45fb3e8e] Fetching instance by UUID {{(pid=123459) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:51:35.488911 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-7e8e3468-48ca-4a42-b7d1-e04e82be5a5f tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:51:35.489890 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-7e8e3468-48ca-4a42-b7d1-e04e82be5a5f tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:51:35.491502 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-7e8e3468-48ca-4a42-b7d1-e04e82be5a5f tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:51:35.492185 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-7e8e3468-48ca-4a42-b7d1-e04e82be5a5f tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:51:35.570472 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-7e8e3468-48ca-4a42-b7d1-e04e82be5a5f tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:51:35.582338 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-7e8e3468-48ca-4a42-b7d1-e04e82be5a5f tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:51:35.583877 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-7e8e3468-48ca-4a42-b7d1-e04e82be5a5f tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:51:35.585050 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-7e8e3468-48ca-4a42-b7d1-e04e82be5a5f tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] 10.222.0.31 "GET /compute/v2.1/servers/406b5ad6-698e-457f-93f4-cdfd45fb3e8e" status: 200 len: 1340 microversion: 2.20 time: 0.110867 Apr 29 08:51:35.597746 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 30/67] 10.222.0.31 () {60 vars in 1276 bytes} [Fri Apr 29 08:51:35 2022] GET /compute/v2.1/servers/406b5ad6-698e-457f-93f4-cdfd45fb3e8e => generated 1340 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 29 08:51:35.672334 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-0eb61b8b-c58c-43d2-9aa6-c66363513cbb tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Calling method '>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:51:35.674215 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-0eb61b8b-c58c-43d2-9aa6-c66363513cbb tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] [instance: 0f9c17b6-b1a2-4ec6-ba8c-2097a8c8ccb7] Fetching instance by UUID {{(pid=123458) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:51:35.687065 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-0eb61b8b-c58c-43d2-9aa6-c66363513cbb tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:51:35.687445 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-0eb61b8b-c58c-43d2-9aa6-c66363513cbb tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:51:35.688470 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-0eb61b8b-c58c-43d2-9aa6-c66363513cbb tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:51:35.688977 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-0eb61b8b-c58c-43d2-9aa6-c66363513cbb tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:51:35.791605 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-0eb61b8b-c58c-43d2-9aa6-c66363513cbb tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e47ecdfb01f447699275b13255c15d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578e6a35974d4e5c8a0cd4e5fa994259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:51:35.806744 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-0eb61b8b-c58c-43d2-9aa6-c66363513cbb tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] 10.222.0.31 "GET /compute/v2.1/servers/0f9c17b6-b1a2-4ec6-ba8c-2097a8c8ccb7" status: 200 len: 1302 microversion: 2.1 time: 0.144464 Apr 29 08:51:35.810066 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 38/68] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 08:51:35 2022] GET /compute/v2.1/servers/0f9c17b6-b1a2-4ec6-ba8c-2097a8c8ccb7 => generated 1302 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 08:51:35.982940 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-7554e687-c47b-4b86-8723-1c9702c1b5b8 tempest-DeleteServersTestJSON-126197053 tempest-DeleteServersTestJSON-126197053-project] Calling method '>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:51:35.983811 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-7554e687-c47b-4b86-8723-1c9702c1b5b8 tempest-DeleteServersTestJSON-126197053 tempest-DeleteServersTestJSON-126197053-project] [instance: 2f7df954-edb0-41b8-a3d9-a8a870d487c3] Fetching instance by UUID {{(pid=123459) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:51:35.994985 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-7554e687-c47b-4b86-8723-1c9702c1b5b8 tempest-DeleteServersTestJSON-126197053 tempest-DeleteServersTestJSON-126197053-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:51:35.995360 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-7554e687-c47b-4b86-8723-1c9702c1b5b8 tempest-DeleteServersTestJSON-126197053 tempest-DeleteServersTestJSON-126197053-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:51:35.997397 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-7554e687-c47b-4b86-8723-1c9702c1b5b8 tempest-DeleteServersTestJSON-126197053 tempest-DeleteServersTestJSON-126197053-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:51:35.997990 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-7554e687-c47b-4b86-8723-1c9702c1b5b8 tempest-DeleteServersTestJSON-126197053 tempest-DeleteServersTestJSON-126197053-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:51:36.193596 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-7554e687-c47b-4b86-8723-1c9702c1b5b8 tempest-DeleteServersTestJSON-126197053 tempest-DeleteServersTestJSON-126197053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8aa040fad7754a4ba5752413fcfde807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b69a8d69ede453aa373fca0a65bdedd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:51:36.204718 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-7554e687-c47b-4b86-8723-1c9702c1b5b8 tempest-DeleteServersTestJSON-126197053 tempest-DeleteServersTestJSON-126197053-project] 10.222.0.31 "GET /compute/v2.1/servers/2f7df954-edb0-41b8-a3d9-a8a870d487c3" status: 200 len: 1315 microversion: 2.1 time: 0.230165 Apr 29 08:51:36.207415 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 31/69] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 08:51:35 2022] GET /compute/v2.1/servers/2f7df954-edb0-41b8-a3d9-a8a870d487c3 => generated 1315 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 08:51:36.607401 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-7c7a7269-2179-41c8-acc5-48118c5d01f5 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Calling method '>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:51:36.607926 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-7c7a7269-2179-41c8-acc5-48118c5d01f5 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] [instance: 406b5ad6-698e-457f-93f4-cdfd45fb3e8e] Fetching instance by UUID {{(pid=123458) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:51:36.617054 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-7c7a7269-2179-41c8-acc5-48118c5d01f5 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:51:36.617829 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-7c7a7269-2179-41c8-acc5-48118c5d01f5 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:51:36.619496 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-7c7a7269-2179-41c8-acc5-48118c5d01f5 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:51:36.620635 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-7c7a7269-2179-41c8-acc5-48118c5d01f5 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:51:36.785248 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-7c7a7269-2179-41c8-acc5-48118c5d01f5 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:51:36.799389 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-7c7a7269-2179-41c8-acc5-48118c5d01f5 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:51:36.801286 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-7c7a7269-2179-41c8-acc5-48118c5d01f5 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:51:36.802717 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-7c7a7269-2179-41c8-acc5-48118c5d01f5 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] 10.222.0.31 "GET /compute/v2.1/servers/406b5ad6-698e-457f-93f4-cdfd45fb3e8e" status: 200 len: 1340 microversion: 2.20 time: 0.199939 Apr 29 08:51:36.803769 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 39/70] 10.222.0.31 () {60 vars in 1276 bytes} [Fri Apr 29 08:51:36 2022] GET /compute/v2.1/servers/406b5ad6-698e-457f-93f4-cdfd45fb3e8e => generated 1340 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 29 08:51:36.828420 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-ed0a8b20-a606-43ab-af9f-0f0c35e23e26 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Calling method '>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:51:36.829040 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-ed0a8b20-a606-43ab-af9f-0f0c35e23e26 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] [instance: 0f9c17b6-b1a2-4ec6-ba8c-2097a8c8ccb7] Fetching instance by UUID {{(pid=123459) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:51:36.843981 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-ed0a8b20-a606-43ab-af9f-0f0c35e23e26 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:51:36.844697 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-ed0a8b20-a606-43ab-af9f-0f0c35e23e26 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:51:36.845726 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-ed0a8b20-a606-43ab-af9f-0f0c35e23e26 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:51:36.846401 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-ed0a8b20-a606-43ab-af9f-0f0c35e23e26 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:51:36.992764 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-ed0a8b20-a606-43ab-af9f-0f0c35e23e26 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e47ecdfb01f447699275b13255c15d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578e6a35974d4e5c8a0cd4e5fa994259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:51:37.005078 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-ed0a8b20-a606-43ab-af9f-0f0c35e23e26 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] 10.222.0.31 "GET /compute/v2.1/servers/0f9c17b6-b1a2-4ec6-ba8c-2097a8c8ccb7" status: 200 len: 1302 microversion: 2.1 time: 0.181516 Apr 29 08:51:37.017379 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 32/71] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 08:51:36 2022] GET /compute/v2.1/servers/0f9c17b6-b1a2-4ec6-ba8c-2097a8c8ccb7 => generated 1302 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 08:51:37.227503 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-df4fc83a-8c60-4b00-8d6a-3dbe57b11ff4 tempest-DeleteServersTestJSON-126197053 tempest-DeleteServersTestJSON-126197053-project] Calling method '>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:51:37.228603 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-df4fc83a-8c60-4b00-8d6a-3dbe57b11ff4 tempest-DeleteServersTestJSON-126197053 tempest-DeleteServersTestJSON-126197053-project] [instance: 2f7df954-edb0-41b8-a3d9-a8a870d487c3] Fetching instance by UUID {{(pid=123458) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:51:37.236475 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-df4fc83a-8c60-4b00-8d6a-3dbe57b11ff4 tempest-DeleteServersTestJSON-126197053 tempest-DeleteServersTestJSON-126197053-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:51:37.237191 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-df4fc83a-8c60-4b00-8d6a-3dbe57b11ff4 tempest-DeleteServersTestJSON-126197053 tempest-DeleteServersTestJSON-126197053-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:51:37.238211 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-df4fc83a-8c60-4b00-8d6a-3dbe57b11ff4 tempest-DeleteServersTestJSON-126197053 tempest-DeleteServersTestJSON-126197053-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:51:37.239694 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-df4fc83a-8c60-4b00-8d6a-3dbe57b11ff4 tempest-DeleteServersTestJSON-126197053 tempest-DeleteServersTestJSON-126197053-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:51:37.589637 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-df4fc83a-8c60-4b00-8d6a-3dbe57b11ff4 tempest-DeleteServersTestJSON-126197053 tempest-DeleteServersTestJSON-126197053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8aa040fad7754a4ba5752413fcfde807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b69a8d69ede453aa373fca0a65bdedd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:51:37.600064 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-df4fc83a-8c60-4b00-8d6a-3dbe57b11ff4 tempest-DeleteServersTestJSON-126197053 tempest-DeleteServersTestJSON-126197053-project] 10.222.0.31 "GET /compute/v2.1/servers/2f7df954-edb0-41b8-a3d9-a8a870d487c3" status: 200 len: 1315 microversion: 2.1 time: 0.379173 Apr 29 08:51:37.612456 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 40/72] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 08:51:37 2022] GET /compute/v2.1/servers/2f7df954-edb0-41b8-a3d9-a8a870d487c3 => generated 1315 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 08:51:37.823335 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-1f8ae27e-7aad-4b24-9d25-fcc7ed937242 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Calling method '>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:51:37.824087 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-1f8ae27e-7aad-4b24-9d25-fcc7ed937242 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] [instance: 406b5ad6-698e-457f-93f4-cdfd45fb3e8e] Fetching instance by UUID {{(pid=123459) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:51:37.835269 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-1f8ae27e-7aad-4b24-9d25-fcc7ed937242 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:51:37.835980 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-1f8ae27e-7aad-4b24-9d25-fcc7ed937242 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:51:37.836600 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-1f8ae27e-7aad-4b24-9d25-fcc7ed937242 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:51:37.837115 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-1f8ae27e-7aad-4b24-9d25-fcc7ed937242 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:51:38.032668 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-b472986f-ddd4-41d5-a58a-8d470e55ba09 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Calling method '>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:51:38.033671 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-b472986f-ddd4-41d5-a58a-8d470e55ba09 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] [instance: 0f9c17b6-b1a2-4ec6-ba8c-2097a8c8ccb7] Fetching instance by UUID {{(pid=123458) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:51:38.048610 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-b472986f-ddd4-41d5-a58a-8d470e55ba09 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:51:38.049641 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-b472986f-ddd4-41d5-a58a-8d470e55ba09 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:51:38.050820 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-b472986f-ddd4-41d5-a58a-8d470e55ba09 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:51:38.051533 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-b472986f-ddd4-41d5-a58a-8d470e55ba09 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:51:38.206548 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-b472986f-ddd4-41d5-a58a-8d470e55ba09 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e47ecdfb01f447699275b13255c15d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578e6a35974d4e5c8a0cd4e5fa994259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:51:38.218425 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-b472986f-ddd4-41d5-a58a-8d470e55ba09 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] 10.222.0.31 "GET /compute/v2.1/servers/0f9c17b6-b1a2-4ec6-ba8c-2097a8c8ccb7" status: 200 len: 1300 microversion: 2.1 time: 0.194097 Apr 29 08:51:38.231794 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 41/73] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 08:51:38 2022] GET /compute/v2.1/servers/0f9c17b6-b1a2-4ec6-ba8c-2097a8c8ccb7 => generated 1300 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 08:51:38.293472 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-1f8ae27e-7aad-4b24-9d25-fcc7ed937242 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:51:38.296344 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-1f8ae27e-7aad-4b24-9d25-fcc7ed937242 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:51:38.298097 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-1f8ae27e-7aad-4b24-9d25-fcc7ed937242 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:51:38.299334 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-1f8ae27e-7aad-4b24-9d25-fcc7ed937242 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] 10.222.0.31 "GET /compute/v2.1/servers/406b5ad6-698e-457f-93f4-cdfd45fb3e8e" status: 200 len: 1408 microversion: 2.20 time: 0.480262 Apr 29 08:51:38.300295 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 33/74] 10.222.0.31 () {60 vars in 1276 bytes} [Fri Apr 29 08:51:37 2022] GET /compute/v2.1/servers/406b5ad6-698e-457f-93f4-cdfd45fb3e8e => generated 1408 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 29 08:51:38.634094 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-e31b4173-99f1-4294-90a5-aeace3a887d0 tempest-DeleteServersTestJSON-126197053 tempest-DeleteServersTestJSON-126197053-project] Calling method '>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:51:38.634726 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-e31b4173-99f1-4294-90a5-aeace3a887d0 tempest-DeleteServersTestJSON-126197053 tempest-DeleteServersTestJSON-126197053-project] [instance: 2f7df954-edb0-41b8-a3d9-a8a870d487c3] Fetching instance by UUID {{(pid=123458) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:51:38.645422 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-e31b4173-99f1-4294-90a5-aeace3a887d0 tempest-DeleteServersTestJSON-126197053 tempest-DeleteServersTestJSON-126197053-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:51:38.645422 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-e31b4173-99f1-4294-90a5-aeace3a887d0 tempest-DeleteServersTestJSON-126197053 tempest-DeleteServersTestJSON-126197053-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:51:38.646674 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-e31b4173-99f1-4294-90a5-aeace3a887d0 tempest-DeleteServersTestJSON-126197053 tempest-DeleteServersTestJSON-126197053-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:51:38.648088 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-e31b4173-99f1-4294-90a5-aeace3a887d0 tempest-DeleteServersTestJSON-126197053 tempest-DeleteServersTestJSON-126197053-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:51:38.900304 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-e31b4173-99f1-4294-90a5-aeace3a887d0 tempest-DeleteServersTestJSON-126197053 tempest-DeleteServersTestJSON-126197053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8aa040fad7754a4ba5752413fcfde807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b69a8d69ede453aa373fca0a65bdedd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:51:38.916481 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-e31b4173-99f1-4294-90a5-aeace3a887d0 tempest-DeleteServersTestJSON-126197053 tempest-DeleteServersTestJSON-126197053-project] 10.222.0.31 "GET /compute/v2.1/servers/2f7df954-edb0-41b8-a3d9-a8a870d487c3" status: 200 len: 1315 microversion: 2.1 time: 0.286690 Apr 29 08:51:38.918248 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 42/75] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 08:51:38 2022] GET /compute/v2.1/servers/2f7df954-edb0-41b8-a3d9-a8a870d487c3 => generated 1315 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 08:51:39.253470 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-46ffa9e0-14fe-4b0c-9212-8303f3d195a9 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Calling method '>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:51:39.254403 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-46ffa9e0-14fe-4b0c-9212-8303f3d195a9 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] [instance: 0f9c17b6-b1a2-4ec6-ba8c-2097a8c8ccb7] Fetching instance by UUID {{(pid=123459) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:51:39.266160 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-46ffa9e0-14fe-4b0c-9212-8303f3d195a9 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:51:39.266937 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-46ffa9e0-14fe-4b0c-9212-8303f3d195a9 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:51:39.267894 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-46ffa9e0-14fe-4b0c-9212-8303f3d195a9 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:51:39.268390 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-46ffa9e0-14fe-4b0c-9212-8303f3d195a9 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:51:39.319490 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-7e52fa71-5e4c-422e-ab73-e98197b5e6a8 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Calling method '>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:51:39.320864 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-7e52fa71-5e4c-422e-ab73-e98197b5e6a8 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] [instance: 406b5ad6-698e-457f-93f4-cdfd45fb3e8e] Fetching instance by UUID {{(pid=123458) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:51:39.330111 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-7e52fa71-5e4c-422e-ab73-e98197b5e6a8 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:51:39.332917 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-7e52fa71-5e4c-422e-ab73-e98197b5e6a8 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:51:39.334057 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-7e52fa71-5e4c-422e-ab73-e98197b5e6a8 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:51:39.346017 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-7e52fa71-5e4c-422e-ab73-e98197b5e6a8 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:51:39.540151 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-46ffa9e0-14fe-4b0c-9212-8303f3d195a9 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e47ecdfb01f447699275b13255c15d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578e6a35974d4e5c8a0cd4e5fa994259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:51:39.555766 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-46ffa9e0-14fe-4b0c-9212-8303f3d195a9 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] 10.222.0.31 "GET /compute/v2.1/servers/0f9c17b6-b1a2-4ec6-ba8c-2097a8c8ccb7" status: 200 len: 1368 microversion: 2.1 time: 0.311439 Apr 29 08:51:39.557215 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 34/76] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 08:51:39 2022] GET /compute/v2.1/servers/0f9c17b6-b1a2-4ec6-ba8c-2097a8c8ccb7 => generated 1368 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 08:51:39.653864 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-7e52fa71-5e4c-422e-ab73-e98197b5e6a8 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:51:39.662593 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-7e52fa71-5e4c-422e-ab73-e98197b5e6a8 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:51:39.664927 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-7e52fa71-5e4c-422e-ab73-e98197b5e6a8 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:51:39.666365 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-7e52fa71-5e4c-422e-ab73-e98197b5e6a8 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] 10.222.0.31 "GET /compute/v2.1/servers/406b5ad6-698e-457f-93f4-cdfd45fb3e8e" status: 200 len: 1408 microversion: 2.20 time: 0.352629 Apr 29 08:51:39.667159 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 43/77] 10.222.0.31 () {60 vars in 1276 bytes} [Fri Apr 29 08:51:39 2022] GET /compute/v2.1/servers/406b5ad6-698e-457f-93f4-cdfd45fb3e8e => generated 1408 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 29 08:51:39.937201 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-952b2468-4d52-41e5-8dbc-e8a8abf7283c tempest-DeleteServersTestJSON-126197053 tempest-DeleteServersTestJSON-126197053-project] Calling method '>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:51:39.937983 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-952b2468-4d52-41e5-8dbc-e8a8abf7283c tempest-DeleteServersTestJSON-126197053 tempest-DeleteServersTestJSON-126197053-project] [instance: 2f7df954-edb0-41b8-a3d9-a8a870d487c3] Fetching instance by UUID {{(pid=123459) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:51:39.948847 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-952b2468-4d52-41e5-8dbc-e8a8abf7283c tempest-DeleteServersTestJSON-126197053 tempest-DeleteServersTestJSON-126197053-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:51:39.949849 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-952b2468-4d52-41e5-8dbc-e8a8abf7283c tempest-DeleteServersTestJSON-126197053 tempest-DeleteServersTestJSON-126197053-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:51:39.950965 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-952b2468-4d52-41e5-8dbc-e8a8abf7283c tempest-DeleteServersTestJSON-126197053 tempest-DeleteServersTestJSON-126197053-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:51:39.951573 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-952b2468-4d52-41e5-8dbc-e8a8abf7283c tempest-DeleteServersTestJSON-126197053 tempest-DeleteServersTestJSON-126197053-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:51:40.119608 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-952b2468-4d52-41e5-8dbc-e8a8abf7283c tempest-DeleteServersTestJSON-126197053 tempest-DeleteServersTestJSON-126197053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8aa040fad7754a4ba5752413fcfde807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b69a8d69ede453aa373fca0a65bdedd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:51:40.129650 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-952b2468-4d52-41e5-8dbc-e8a8abf7283c tempest-DeleteServersTestJSON-126197053 tempest-DeleteServersTestJSON-126197053-project] 10.222.0.31 "GET /compute/v2.1/servers/2f7df954-edb0-41b8-a3d9-a8a870d487c3" status: 200 len: 1315 microversion: 2.1 time: 0.198397 Apr 29 08:51:40.132045 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 35/78] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 08:51:39 2022] GET /compute/v2.1/servers/2f7df954-edb0-41b8-a3d9-a8a870d487c3 => generated 1315 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 08:51:40.589266 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-75316af3-26e3-4220-becb-73707faa16be tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Calling method '>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:51:40.590500 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-75316af3-26e3-4220-becb-73707faa16be tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] [instance: 0f9c17b6-b1a2-4ec6-ba8c-2097a8c8ccb7] Fetching instance by UUID {{(pid=123458) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:51:40.598507 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-75316af3-26e3-4220-becb-73707faa16be tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:51:40.599348 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-75316af3-26e3-4220-becb-73707faa16be tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:51:40.601137 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-75316af3-26e3-4220-becb-73707faa16be tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:51:40.601878 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-75316af3-26e3-4220-becb-73707faa16be tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:51:40.688320 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-822db45e-8017-4465-aa22-7c3f36ad48f5 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Calling method '>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:51:40.689125 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-822db45e-8017-4465-aa22-7c3f36ad48f5 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] [instance: 406b5ad6-698e-457f-93f4-cdfd45fb3e8e] Fetching instance by UUID {{(pid=123459) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:51:40.703386 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-822db45e-8017-4465-aa22-7c3f36ad48f5 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:51:40.703824 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-822db45e-8017-4465-aa22-7c3f36ad48f5 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:51:40.706235 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-822db45e-8017-4465-aa22-7c3f36ad48f5 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:51:40.706857 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-822db45e-8017-4465-aa22-7c3f36ad48f5 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:51:40.961192 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-75316af3-26e3-4220-becb-73707faa16be tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e47ecdfb01f447699275b13255c15d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578e6a35974d4e5c8a0cd4e5fa994259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:51:40.975134 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-75316af3-26e3-4220-becb-73707faa16be tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] 10.222.0.31 "GET /compute/v2.1/servers/0f9c17b6-b1a2-4ec6-ba8c-2097a8c8ccb7" status: 200 len: 1368 microversion: 2.1 time: 0.402261 Apr 29 08:51:40.988693 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 44/79] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 08:51:40 2022] GET /compute/v2.1/servers/0f9c17b6-b1a2-4ec6-ba8c-2097a8c8ccb7 => generated 1368 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 29 08:51:41.154859 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-07c64dcb-5c42-4fd7-a5d5-1ef8c22802a6 tempest-DeleteServersTestJSON-126197053 tempest-DeleteServersTestJSON-126197053-project] Calling method '>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:51:41.155471 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-07c64dcb-5c42-4fd7-a5d5-1ef8c22802a6 tempest-DeleteServersTestJSON-126197053 tempest-DeleteServersTestJSON-126197053-project] [instance: 2f7df954-edb0-41b8-a3d9-a8a870d487c3] Fetching instance by UUID {{(pid=123458) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:51:41.166826 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-07c64dcb-5c42-4fd7-a5d5-1ef8c22802a6 tempest-DeleteServersTestJSON-126197053 tempest-DeleteServersTestJSON-126197053-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:51:41.167296 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-07c64dcb-5c42-4fd7-a5d5-1ef8c22802a6 tempest-DeleteServersTestJSON-126197053 tempest-DeleteServersTestJSON-126197053-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:51:41.173225 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-07c64dcb-5c42-4fd7-a5d5-1ef8c22802a6 tempest-DeleteServersTestJSON-126197053 tempest-DeleteServersTestJSON-126197053-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:51:41.173842 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-07c64dcb-5c42-4fd7-a5d5-1ef8c22802a6 tempest-DeleteServersTestJSON-126197053 tempest-DeleteServersTestJSON-126197053-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:51:41.239762 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-822db45e-8017-4465-aa22-7c3f36ad48f5 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:51:41.253254 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-822db45e-8017-4465-aa22-7c3f36ad48f5 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:51:41.254783 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-822db45e-8017-4465-aa22-7c3f36ad48f5 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:51:41.255977 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-822db45e-8017-4465-aa22-7c3f36ad48f5 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] 10.222.0.31 "GET /compute/v2.1/servers/406b5ad6-698e-457f-93f4-cdfd45fb3e8e" status: 200 len: 1408 microversion: 2.20 time: 0.572696 Apr 29 08:51:41.270902 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 36/80] 10.222.0.31 () {60 vars in 1276 bytes} [Fri Apr 29 08:51:40 2022] GET /compute/v2.1/servers/406b5ad6-698e-457f-93f4-cdfd45fb3e8e => generated 1408 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 29 08:51:41.654474 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-07c64dcb-5c42-4fd7-a5d5-1ef8c22802a6 tempest-DeleteServersTestJSON-126197053 tempest-DeleteServersTestJSON-126197053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8aa040fad7754a4ba5752413fcfde807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b69a8d69ede453aa373fca0a65bdedd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:51:41.674857 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-07c64dcb-5c42-4fd7-a5d5-1ef8c22802a6 tempest-DeleteServersTestJSON-126197053 tempest-DeleteServersTestJSON-126197053-project] 10.222.0.31 "GET /compute/v2.1/servers/2f7df954-edb0-41b8-a3d9-a8a870d487c3" status: 200 len: 1315 microversion: 2.1 time: 0.524666 Apr 29 08:51:41.676683 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 45/81] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 08:51:41 2022] GET /compute/v2.1/servers/2f7df954-edb0-41b8-a3d9-a8a870d487c3 => generated 1315 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 29 08:51:41.994687 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-1d4b481e-96c5-436b-849c-7b7fa7d6f4f2 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Calling method '>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:51:41.996162 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-1d4b481e-96c5-436b-849c-7b7fa7d6f4f2 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] [instance: 0f9c17b6-b1a2-4ec6-ba8c-2097a8c8ccb7] Fetching instance by UUID {{(pid=123459) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:51:42.010918 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-1d4b481e-96c5-436b-849c-7b7fa7d6f4f2 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:51:42.013129 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-1d4b481e-96c5-436b-849c-7b7fa7d6f4f2 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:51:42.014173 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-1d4b481e-96c5-436b-849c-7b7fa7d6f4f2 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:51:42.024267 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-1d4b481e-96c5-436b-849c-7b7fa7d6f4f2 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:51:42.187175 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [req-f0776b61-3e40-4a21-a12c-037790058915 req-7ded44f1-4e0d-4c56-9c3a-0da55c17b6c6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0f9c17b6-b1a2-4ec6-ba8c-2097a8c8ccb7", "tag": "3b21bf13-34c3-4eab-b46e-1fddbe0106a8"}]} {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 29 08:51:42.213395 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [req-f0776b61-3e40-4a21-a12c-037790058915 req-7ded44f1-4e0d-4c56-9c3a-0da55c17b6c6 service nova] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:51:42.213884 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [req-f0776b61-3e40-4a21-a12c-037790058915 req-7ded44f1-4e0d-4c56-9c3a-0da55c17b6c6 service nova] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:51:42.249285 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.compute.server_external_events [req-f0776b61-3e40-4a21-a12c-037790058915 req-7ded44f1-4e0d-4c56-9c3a-0da55c17b6c6 service nova] Creating event network-changed:3b21bf13-34c3-4eab-b46e-1fddbe0106a8 for instance 0f9c17b6-b1a2-4ec6-ba8c-2097a8c8ccb7 on hv-cinder-83987 Apr 29 08:51:42.250102 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [req-f0776b61-3e40-4a21-a12c-037790058915 req-7ded44f1-4e0d-4c56-9c3a-0da55c17b6c6 service nova] Acquired lock "compute-rpcapi-router" {{(pid=123458) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Apr 29 08:51:42.252124 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-040d14bd-3f9b-4511-8421-9971d08016cc None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:51:42.252853 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-040d14bd-3f9b-4511-8421-9971d08016cc None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:51:42.253942 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-040d14bd-3f9b-4511-8421-9971d08016cc None None] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:51:42.254675 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-040d14bd-3f9b-4511-8421-9971d08016cc None None] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:51:42.267486 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.compute.rpcapi [None req-040d14bd-3f9b-4511-8421-9971d08016cc None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Apr 29 08:51:42.269313 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-040d14bd-3f9b-4511-8421-9971d08016cc None None] Releasing lock "compute-rpcapi-router" {{(pid=123458) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Apr 29 08:51:42.333386 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-040d14bd-3f9b-4511-8421-9971d08016cc None None] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.150670 Apr 29 08:51:42.334073 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 46/82] 10.222.0.31 () {64 vars in 1317 bytes} [Fri Apr 29 08:51:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (3 switches on core 0) Apr 29 08:51:42.341449 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-0512cf11-6e7c-4903-8166-cdf242b39820 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Calling method '>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:51:42.342195 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-0512cf11-6e7c-4903-8166-cdf242b39820 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] [instance: 406b5ad6-698e-457f-93f4-cdfd45fb3e8e] Fetching instance by UUID {{(pid=123458) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:51:42.366318 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-0512cf11-6e7c-4903-8166-cdf242b39820 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:51:42.366783 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-0512cf11-6e7c-4903-8166-cdf242b39820 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:51:42.367597 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-0512cf11-6e7c-4903-8166-cdf242b39820 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:51:42.368046 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-0512cf11-6e7c-4903-8166-cdf242b39820 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:51:42.432292 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-1d4b481e-96c5-436b-849c-7b7fa7d6f4f2 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e47ecdfb01f447699275b13255c15d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578e6a35974d4e5c8a0cd4e5fa994259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:51:42.448646 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-1d4b481e-96c5-436b-849c-7b7fa7d6f4f2 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] 10.222.0.31 "GET /compute/v2.1/servers/0f9c17b6-b1a2-4ec6-ba8c-2097a8c8ccb7" status: 200 len: 1368 microversion: 2.1 time: 0.457479 Apr 29 08:51:42.459933 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 37/83] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 08:51:41 2022] GET /compute/v2.1/servers/0f9c17b6-b1a2-4ec6-ba8c-2097a8c8ccb7 => generated 1368 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 08:51:42.708270 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-9b87c03b-0c2a-4824-8883-d5613e374eb5 tempest-DeleteServersTestJSON-126197053 tempest-DeleteServersTestJSON-126197053-project] Calling method '>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:51:42.708901 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-9b87c03b-0c2a-4824-8883-d5613e374eb5 tempest-DeleteServersTestJSON-126197053 tempest-DeleteServersTestJSON-126197053-project] [instance: 2f7df954-edb0-41b8-a3d9-a8a870d487c3] Fetching instance by UUID {{(pid=123459) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:51:42.742532 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-9b87c03b-0c2a-4824-8883-d5613e374eb5 tempest-DeleteServersTestJSON-126197053 tempest-DeleteServersTestJSON-126197053-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:51:42.743664 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-9b87c03b-0c2a-4824-8883-d5613e374eb5 tempest-DeleteServersTestJSON-126197053 tempest-DeleteServersTestJSON-126197053-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:51:42.745932 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-9b87c03b-0c2a-4824-8883-d5613e374eb5 tempest-DeleteServersTestJSON-126197053 tempest-DeleteServersTestJSON-126197053-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:51:42.746389 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-9b87c03b-0c2a-4824-8883-d5613e374eb5 tempest-DeleteServersTestJSON-126197053 tempest-DeleteServersTestJSON-126197053-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:51:43.153378 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-0512cf11-6e7c-4903-8166-cdf242b39820 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:51:43.169001 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-0512cf11-6e7c-4903-8166-cdf242b39820 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:51:43.169571 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-9b87c03b-0c2a-4824-8883-d5613e374eb5 tempest-DeleteServersTestJSON-126197053 tempest-DeleteServersTestJSON-126197053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8aa040fad7754a4ba5752413fcfde807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b69a8d69ede453aa373fca0a65bdedd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:51:43.172756 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-0512cf11-6e7c-4903-8166-cdf242b39820 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:51:43.176415 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-0512cf11-6e7c-4903-8166-cdf242b39820 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] 10.222.0.31 "GET /compute/v2.1/servers/406b5ad6-698e-457f-93f4-cdfd45fb3e8e" status: 200 len: 1408 microversion: 2.20 time: 0.840185 Apr 29 08:51:43.177749 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 47/84] 10.222.0.31 () {60 vars in 1276 bytes} [Fri Apr 29 08:51:42 2022] GET /compute/v2.1/servers/406b5ad6-698e-457f-93f4-cdfd45fb3e8e => generated 1408 bytes in 843 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 29 08:51:43.187035 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-9b87c03b-0c2a-4824-8883-d5613e374eb5 tempest-DeleteServersTestJSON-126197053 tempest-DeleteServersTestJSON-126197053-project] 10.222.0.31 "GET /compute/v2.1/servers/2f7df954-edb0-41b8-a3d9-a8a870d487c3" status: 200 len: 1315 microversion: 2.1 time: 0.482722 Apr 29 08:51:43.187701 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 38/85] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 08:51:42 2022] GET /compute/v2.1/servers/2f7df954-edb0-41b8-a3d9-a8a870d487c3 => generated 1315 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 29 08:51:43.274397 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [req-ccc02240-3424-4a11-9ccf-fff0f1402284 req-ebdc01d6-1f9e-4ad1-8765-cda4dca30b2c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "406b5ad6-698e-457f-93f4-cdfd45fb3e8e", "tag": "afdeb60c-c7b1-441b-90f4-293273965fad"}]} {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 29 08:51:43.291458 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [req-ccc02240-3424-4a11-9ccf-fff0f1402284 req-ebdc01d6-1f9e-4ad1-8765-cda4dca30b2c service nova] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:51:43.291905 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [req-ccc02240-3424-4a11-9ccf-fff0f1402284 req-ebdc01d6-1f9e-4ad1-8765-cda4dca30b2c service nova] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:51:43.316017 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.compute.server_external_events [req-ccc02240-3424-4a11-9ccf-fff0f1402284 req-ebdc01d6-1f9e-4ad1-8765-cda4dca30b2c service nova] Creating event network-changed:afdeb60c-c7b1-441b-90f4-293273965fad for instance 406b5ad6-698e-457f-93f4-cdfd45fb3e8e on hv-cinder-83987 Apr 29 08:51:43.325771 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [req-ccc02240-3424-4a11-9ccf-fff0f1402284 req-ebdc01d6-1f9e-4ad1-8765-cda4dca30b2c service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.145355 Apr 29 08:51:43.330385 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 48/86] 10.222.0.31 () {64 vars in 1317 bytes} [Fri Apr 29 08:51:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 29 08:51:43.468666 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-2b616cd0-f496-49d8-91ed-cc5436d37ba7 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Calling method '>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:51:43.470019 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-2b616cd0-f496-49d8-91ed-cc5436d37ba7 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] [instance: 0f9c17b6-b1a2-4ec6-ba8c-2097a8c8ccb7] Fetching instance by UUID {{(pid=123459) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:51:43.477856 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-2b616cd0-f496-49d8-91ed-cc5436d37ba7 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:51:43.478608 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-2b616cd0-f496-49d8-91ed-cc5436d37ba7 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:51:43.481927 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-2b616cd0-f496-49d8-91ed-cc5436d37ba7 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:51:43.482628 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-2b616cd0-f496-49d8-91ed-cc5436d37ba7 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:51:43.695150 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-2b616cd0-f496-49d8-91ed-cc5436d37ba7 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e47ecdfb01f447699275b13255c15d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578e6a35974d4e5c8a0cd4e5fa994259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:51:43.703719 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-2b616cd0-f496-49d8-91ed-cc5436d37ba7 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] 10.222.0.31 "GET /compute/v2.1/servers/0f9c17b6-b1a2-4ec6-ba8c-2097a8c8ccb7" status: 200 len: 1368 microversion: 2.1 time: 0.241186 Apr 29 08:51:43.713064 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 39/87] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 08:51:43 2022] GET /compute/v2.1/servers/0f9c17b6-b1a2-4ec6-ba8c-2097a8c8ccb7 => generated 1368 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 08:51:44.196064 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-0516ffeb-da47-4004-9532-857e0b6d7df1 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Calling method '>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:51:44.196789 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-0516ffeb-da47-4004-9532-857e0b6d7df1 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] [instance: 406b5ad6-698e-457f-93f4-cdfd45fb3e8e] Fetching instance by UUID {{(pid=123458) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:51:44.205269 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-0516ffeb-da47-4004-9532-857e0b6d7df1 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:51:44.206273 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-0516ffeb-da47-4004-9532-857e0b6d7df1 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:51:44.207149 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-463f87c7-c066-4ed5-8db2-466a30bf5b80 tempest-DeleteServersTestJSON-126197053 tempest-DeleteServersTestJSON-126197053-project] Calling method '>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:51:44.207786 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-463f87c7-c066-4ed5-8db2-466a30bf5b80 tempest-DeleteServersTestJSON-126197053 tempest-DeleteServersTestJSON-126197053-project] [instance: 2f7df954-edb0-41b8-a3d9-a8a870d487c3] Fetching instance by UUID {{(pid=123459) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:51:44.208379 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-0516ffeb-da47-4004-9532-857e0b6d7df1 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:51:44.209677 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-0516ffeb-da47-4004-9532-857e0b6d7df1 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:51:44.216733 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-463f87c7-c066-4ed5-8db2-466a30bf5b80 tempest-DeleteServersTestJSON-126197053 tempest-DeleteServersTestJSON-126197053-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:51:44.217225 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-463f87c7-c066-4ed5-8db2-466a30bf5b80 tempest-DeleteServersTestJSON-126197053 tempest-DeleteServersTestJSON-126197053-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:51:44.218113 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-463f87c7-c066-4ed5-8db2-466a30bf5b80 tempest-DeleteServersTestJSON-126197053 tempest-DeleteServersTestJSON-126197053-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:51:44.218604 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-463f87c7-c066-4ed5-8db2-466a30bf5b80 tempest-DeleteServersTestJSON-126197053 tempest-DeleteServersTestJSON-126197053-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:51:44.379122 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-0516ffeb-da47-4004-9532-857e0b6d7df1 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:51:44.391065 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-0516ffeb-da47-4004-9532-857e0b6d7df1 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:51:44.393223 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-0516ffeb-da47-4004-9532-857e0b6d7df1 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:51:44.394467 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-0516ffeb-da47-4004-9532-857e0b6d7df1 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] 10.222.0.31 "GET /compute/v2.1/servers/406b5ad6-698e-457f-93f4-cdfd45fb3e8e" status: 200 len: 1408 microversion: 2.20 time: 0.202675 Apr 29 08:51:44.395032 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 49/88] 10.222.0.31 () {60 vars in 1276 bytes} [Fri Apr 29 08:51:44 2022] GET /compute/v2.1/servers/406b5ad6-698e-457f-93f4-cdfd45fb3e8e => generated 1408 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 29 08:51:44.431618 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-463f87c7-c066-4ed5-8db2-466a30bf5b80 tempest-DeleteServersTestJSON-126197053 tempest-DeleteServersTestJSON-126197053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8aa040fad7754a4ba5752413fcfde807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b69a8d69ede453aa373fca0a65bdedd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:51:44.440879 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-463f87c7-c066-4ed5-8db2-466a30bf5b80 tempest-DeleteServersTestJSON-126197053 tempest-DeleteServersTestJSON-126197053-project] 10.222.0.31 "GET /compute/v2.1/servers/2f7df954-edb0-41b8-a3d9-a8a870d487c3" status: 200 len: 1315 microversion: 2.1 time: 0.238809 Apr 29 08:51:44.441472 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 40/89] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 08:51:44 2022] GET /compute/v2.1/servers/2f7df954-edb0-41b8-a3d9-a8a870d487c3 => generated 1315 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 29 08:51:44.721768 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-88f0e18e-d5cd-4475-ad05-f5a1c62effe0 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Calling method '>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:51:44.722657 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-88f0e18e-d5cd-4475-ad05-f5a1c62effe0 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] [instance: 0f9c17b6-b1a2-4ec6-ba8c-2097a8c8ccb7] Fetching instance by UUID {{(pid=123458) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:51:44.729039 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-88f0e18e-d5cd-4475-ad05-f5a1c62effe0 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:51:44.729489 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-88f0e18e-d5cd-4475-ad05-f5a1c62effe0 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:51:44.731268 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-88f0e18e-d5cd-4475-ad05-f5a1c62effe0 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:51:44.731710 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-88f0e18e-d5cd-4475-ad05-f5a1c62effe0 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:51:44.895018 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-88f0e18e-d5cd-4475-ad05-f5a1c62effe0 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e47ecdfb01f447699275b13255c15d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578e6a35974d4e5c8a0cd4e5fa994259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:51:44.903197 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-88f0e18e-d5cd-4475-ad05-f5a1c62effe0 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] 10.222.0.31 "GET /compute/v2.1/servers/0f9c17b6-b1a2-4ec6-ba8c-2097a8c8ccb7" status: 200 len: 1368 microversion: 2.1 time: 0.185465 Apr 29 08:51:44.903923 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 50/90] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 08:51:44 2022] GET /compute/v2.1/servers/0f9c17b6-b1a2-4ec6-ba8c-2097a8c8ccb7 => generated 1368 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 08:51:45.417412 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-f3840491-1b4f-45d3-8242-7d4b6327305d tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Calling method '>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:51:45.419116 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-f3840491-1b4f-45d3-8242-7d4b6327305d tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] [instance: 406b5ad6-698e-457f-93f4-cdfd45fb3e8e] Fetching instance by UUID {{(pid=123459) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:51:45.425500 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-f3840491-1b4f-45d3-8242-7d4b6327305d tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:51:45.426112 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-f3840491-1b4f-45d3-8242-7d4b6327305d tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:51:45.427180 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-f3840491-1b4f-45d3-8242-7d4b6327305d tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:51:45.427634 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-f3840491-1b4f-45d3-8242-7d4b6327305d tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:51:45.463316 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-fe8db730-c6e1-4fbf-b35b-33002e6c3b12 tempest-DeleteServersTestJSON-126197053 tempest-DeleteServersTestJSON-126197053-project] Calling method '>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:51:45.464018 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-fe8db730-c6e1-4fbf-b35b-33002e6c3b12 tempest-DeleteServersTestJSON-126197053 tempest-DeleteServersTestJSON-126197053-project] [instance: 2f7df954-edb0-41b8-a3d9-a8a870d487c3] Fetching instance by UUID {{(pid=123458) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:51:45.472208 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-fe8db730-c6e1-4fbf-b35b-33002e6c3b12 tempest-DeleteServersTestJSON-126197053 tempest-DeleteServersTestJSON-126197053-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:51:45.472877 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-fe8db730-c6e1-4fbf-b35b-33002e6c3b12 tempest-DeleteServersTestJSON-126197053 tempest-DeleteServersTestJSON-126197053-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:51:45.473966 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-fe8db730-c6e1-4fbf-b35b-33002e6c3b12 tempest-DeleteServersTestJSON-126197053 tempest-DeleteServersTestJSON-126197053-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:51:45.474557 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-fe8db730-c6e1-4fbf-b35b-33002e6c3b12 tempest-DeleteServersTestJSON-126197053 tempest-DeleteServersTestJSON-126197053-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:51:45.575235 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-f3840491-1b4f-45d3-8242-7d4b6327305d tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:51:45.585049 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-f3840491-1b4f-45d3-8242-7d4b6327305d tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:51:45.586654 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-f3840491-1b4f-45d3-8242-7d4b6327305d tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:51:45.587668 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-f3840491-1b4f-45d3-8242-7d4b6327305d tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] 10.222.0.31 "GET /compute/v2.1/servers/406b5ad6-698e-457f-93f4-cdfd45fb3e8e" status: 200 len: 1408 microversion: 2.20 time: 0.175523 Apr 29 08:51:45.588238 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 41/91] 10.222.0.31 () {60 vars in 1276 bytes} [Fri Apr 29 08:51:45 2022] GET /compute/v2.1/servers/406b5ad6-698e-457f-93f4-cdfd45fb3e8e => generated 1408 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 29 08:51:45.634248 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-fe8db730-c6e1-4fbf-b35b-33002e6c3b12 tempest-DeleteServersTestJSON-126197053 tempest-DeleteServersTestJSON-126197053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8aa040fad7754a4ba5752413fcfde807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b69a8d69ede453aa373fca0a65bdedd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:51:45.643087 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-fe8db730-c6e1-4fbf-b35b-33002e6c3b12 tempest-DeleteServersTestJSON-126197053 tempest-DeleteServersTestJSON-126197053-project] 10.222.0.31 "GET /compute/v2.1/servers/2f7df954-edb0-41b8-a3d9-a8a870d487c3" status: 200 len: 1315 microversion: 2.1 time: 0.185073 Apr 29 08:51:45.643764 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 51/92] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 08:51:45 2022] GET /compute/v2.1/servers/2f7df954-edb0-41b8-a3d9-a8a870d487c3 => generated 1315 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 08:51:45.921560 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-094ce52c-b778-4132-884c-a31c75ebb15e tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Calling method '>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:51:45.922307 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-094ce52c-b778-4132-884c-a31c75ebb15e tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] [instance: 0f9c17b6-b1a2-4ec6-ba8c-2097a8c8ccb7] Fetching instance by UUID {{(pid=123459) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:51:45.938328 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-094ce52c-b778-4132-884c-a31c75ebb15e tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:51:45.938870 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-094ce52c-b778-4132-884c-a31c75ebb15e tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:51:45.940212 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-094ce52c-b778-4132-884c-a31c75ebb15e tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:51:45.940858 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-094ce52c-b778-4132-884c-a31c75ebb15e tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:51:46.097861 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-094ce52c-b778-4132-884c-a31c75ebb15e tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e47ecdfb01f447699275b13255c15d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578e6a35974d4e5c8a0cd4e5fa994259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:51:46.107535 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-094ce52c-b778-4132-884c-a31c75ebb15e tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] 10.222.0.31 "GET /compute/v2.1/servers/0f9c17b6-b1a2-4ec6-ba8c-2097a8c8ccb7" status: 200 len: 1368 microversion: 2.1 time: 0.190712 Apr 29 08:51:46.112560 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 42/93] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 08:51:45 2022] GET /compute/v2.1/servers/0f9c17b6-b1a2-4ec6-ba8c-2097a8c8ccb7 => generated 1368 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 08:51:46.607150 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-e5037640-2b75-4ed2-ae91-356b3c61dbe6 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Calling method '>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:51:46.608548 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-e5037640-2b75-4ed2-ae91-356b3c61dbe6 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] [instance: 406b5ad6-698e-457f-93f4-cdfd45fb3e8e] Fetching instance by UUID {{(pid=123458) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:51:46.616498 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-e5037640-2b75-4ed2-ae91-356b3c61dbe6 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:51:46.616943 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-e5037640-2b75-4ed2-ae91-356b3c61dbe6 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:51:46.618015 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-e5037640-2b75-4ed2-ae91-356b3c61dbe6 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:51:46.618381 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-e5037640-2b75-4ed2-ae91-356b3c61dbe6 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:51:46.660289 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-475a2102-3ad9-4c39-a755-be5deb5bfe9c tempest-DeleteServersTestJSON-126197053 tempest-DeleteServersTestJSON-126197053-project] Calling method '>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:51:46.661053 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-475a2102-3ad9-4c39-a755-be5deb5bfe9c tempest-DeleteServersTestJSON-126197053 tempest-DeleteServersTestJSON-126197053-project] [instance: 2f7df954-edb0-41b8-a3d9-a8a870d487c3] Fetching instance by UUID {{(pid=123459) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:51:46.668115 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-475a2102-3ad9-4c39-a755-be5deb5bfe9c tempest-DeleteServersTestJSON-126197053 tempest-DeleteServersTestJSON-126197053-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:51:46.668577 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-475a2102-3ad9-4c39-a755-be5deb5bfe9c tempest-DeleteServersTestJSON-126197053 tempest-DeleteServersTestJSON-126197053-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:51:46.669355 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-475a2102-3ad9-4c39-a755-be5deb5bfe9c tempest-DeleteServersTestJSON-126197053 tempest-DeleteServersTestJSON-126197053-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:51:46.669926 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-475a2102-3ad9-4c39-a755-be5deb5bfe9c tempest-DeleteServersTestJSON-126197053 tempest-DeleteServersTestJSON-126197053-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:51:46.766343 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-e5037640-2b75-4ed2-ae91-356b3c61dbe6 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:51:46.774975 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-e5037640-2b75-4ed2-ae91-356b3c61dbe6 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:51:46.776523 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-e5037640-2b75-4ed2-ae91-356b3c61dbe6 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:51:46.778731 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-e5037640-2b75-4ed2-ae91-356b3c61dbe6 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] 10.222.0.31 "GET /compute/v2.1/servers/406b5ad6-698e-457f-93f4-cdfd45fb3e8e" status: 200 len: 1408 microversion: 2.20 time: 0.175897 Apr 29 08:51:46.779288 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 52/94] 10.222.0.31 () {60 vars in 1276 bytes} [Fri Apr 29 08:51:46 2022] GET /compute/v2.1/servers/406b5ad6-698e-457f-93f4-cdfd45fb3e8e => generated 1408 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 29 08:51:46.812285 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-475a2102-3ad9-4c39-a755-be5deb5bfe9c tempest-DeleteServersTestJSON-126197053 tempest-DeleteServersTestJSON-126197053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8aa040fad7754a4ba5752413fcfde807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b69a8d69ede453aa373fca0a65bdedd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:51:46.819658 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-475a2102-3ad9-4c39-a755-be5deb5bfe9c tempest-DeleteServersTestJSON-126197053 tempest-DeleteServersTestJSON-126197053-project] 10.222.0.31 "GET /compute/v2.1/servers/2f7df954-edb0-41b8-a3d9-a8a870d487c3" status: 200 len: 1315 microversion: 2.1 time: 0.163193 Apr 29 08:51:46.820241 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 43/95] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 08:51:46 2022] GET /compute/v2.1/servers/2f7df954-edb0-41b8-a3d9-a8a870d487c3 => generated 1315 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 29 08:51:47.125583 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-6f1ab276-6636-457b-97a8-27f21319e59e tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Calling method '>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:51:47.126223 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-6f1ab276-6636-457b-97a8-27f21319e59e tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] [instance: 0f9c17b6-b1a2-4ec6-ba8c-2097a8c8ccb7] Fetching instance by UUID {{(pid=123458) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:51:47.131992 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-6f1ab276-6636-457b-97a8-27f21319e59e tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:51:47.132548 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-6f1ab276-6636-457b-97a8-27f21319e59e tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:51:47.133305 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-6f1ab276-6636-457b-97a8-27f21319e59e tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:51:47.133735 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-6f1ab276-6636-457b-97a8-27f21319e59e tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:51:47.271545 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-6f1ab276-6636-457b-97a8-27f21319e59e tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e47ecdfb01f447699275b13255c15d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578e6a35974d4e5c8a0cd4e5fa994259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:51:47.280324 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-6f1ab276-6636-457b-97a8-27f21319e59e tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] 10.222.0.31 "GET /compute/v2.1/servers/0f9c17b6-b1a2-4ec6-ba8c-2097a8c8ccb7" status: 200 len: 1368 microversion: 2.1 time: 0.158583 Apr 29 08:51:47.280923 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 53/96] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 08:51:47 2022] GET /compute/v2.1/servers/0f9c17b6-b1a2-4ec6-ba8c-2097a8c8ccb7 => generated 1368 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 08:51:47.796858 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-44433b61-4eb6-409e-8481-75efc71321d6 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Calling method '>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:51:47.797473 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-44433b61-4eb6-409e-8481-75efc71321d6 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] [instance: 406b5ad6-698e-457f-93f4-cdfd45fb3e8e] Fetching instance by UUID {{(pid=123459) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:51:47.803299 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-44433b61-4eb6-409e-8481-75efc71321d6 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:51:47.803749 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-44433b61-4eb6-409e-8481-75efc71321d6 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:51:47.804613 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-44433b61-4eb6-409e-8481-75efc71321d6 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:51:47.805046 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-44433b61-4eb6-409e-8481-75efc71321d6 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:51:47.836995 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-bab536be-a0d5-4734-b2b8-f681bf68fd0b tempest-DeleteServersTestJSON-126197053 tempest-DeleteServersTestJSON-126197053-project] Calling method '>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:51:47.837629 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-bab536be-a0d5-4734-b2b8-f681bf68fd0b tempest-DeleteServersTestJSON-126197053 tempest-DeleteServersTestJSON-126197053-project] [instance: 2f7df954-edb0-41b8-a3d9-a8a870d487c3] Fetching instance by UUID {{(pid=123458) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:51:47.845050 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-bab536be-a0d5-4734-b2b8-f681bf68fd0b tempest-DeleteServersTestJSON-126197053 tempest-DeleteServersTestJSON-126197053-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:51:47.845491 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-bab536be-a0d5-4734-b2b8-f681bf68fd0b tempest-DeleteServersTestJSON-126197053 tempest-DeleteServersTestJSON-126197053-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:51:47.846324 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-bab536be-a0d5-4734-b2b8-f681bf68fd0b tempest-DeleteServersTestJSON-126197053 tempest-DeleteServersTestJSON-126197053-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:51:47.846755 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-bab536be-a0d5-4734-b2b8-f681bf68fd0b tempest-DeleteServersTestJSON-126197053 tempest-DeleteServersTestJSON-126197053-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:51:47.946917 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-44433b61-4eb6-409e-8481-75efc71321d6 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:51:47.957493 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-44433b61-4eb6-409e-8481-75efc71321d6 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:51:47.959183 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-44433b61-4eb6-409e-8481-75efc71321d6 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:51:47.960514 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-44433b61-4eb6-409e-8481-75efc71321d6 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] 10.222.0.31 "GET /compute/v2.1/servers/406b5ad6-698e-457f-93f4-cdfd45fb3e8e" status: 200 len: 1408 microversion: 2.20 time: 0.167820 Apr 29 08:51:47.961075 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 44/97] 10.222.0.31 () {60 vars in 1276 bytes} [Fri Apr 29 08:51:47 2022] GET /compute/v2.1/servers/406b5ad6-698e-457f-93f4-cdfd45fb3e8e => generated 1408 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 29 08:51:47.994790 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-bab536be-a0d5-4734-b2b8-f681bf68fd0b tempest-DeleteServersTestJSON-126197053 tempest-DeleteServersTestJSON-126197053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8aa040fad7754a4ba5752413fcfde807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b69a8d69ede453aa373fca0a65bdedd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:51:48.002169 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-bab536be-a0d5-4734-b2b8-f681bf68fd0b tempest-DeleteServersTestJSON-126197053 tempest-DeleteServersTestJSON-126197053-project] 10.222.0.31 "GET /compute/v2.1/servers/2f7df954-edb0-41b8-a3d9-a8a870d487c3" status: 200 len: 1315 microversion: 2.1 time: 0.169101 Apr 29 08:51:48.002739 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 54/98] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 08:51:47 2022] GET /compute/v2.1/servers/2f7df954-edb0-41b8-a3d9-a8a870d487c3 => generated 1315 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 29 08:51:48.298946 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-5db45bd3-c716-4273-9560-516ebb41da9b tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Calling method '>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:51:48.299835 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-5db45bd3-c716-4273-9560-516ebb41da9b tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] [instance: 0f9c17b6-b1a2-4ec6-ba8c-2097a8c8ccb7] Fetching instance by UUID {{(pid=123458) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:51:48.306095 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-5db45bd3-c716-4273-9560-516ebb41da9b tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:51:48.306552 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-5db45bd3-c716-4273-9560-516ebb41da9b tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:51:48.306656 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [req-51a14ff7-5726-496d-9eac-3715355cb31f req-5a2d0300-4811-4cd3-b2c9-a7d36b27d44b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2f7df954-edb0-41b8-a3d9-a8a870d487c3", "name": "network-vif-plugged", "status": "completed", "tag": "028eab3d-f19b-4591-b8b2-199e74d95dfe"}]} {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 29 08:51:48.307344 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-5db45bd3-c716-4273-9560-516ebb41da9b tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:51:48.307778 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-5db45bd3-c716-4273-9560-516ebb41da9b tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:51:48.316526 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [req-51a14ff7-5726-496d-9eac-3715355cb31f req-5a2d0300-4811-4cd3-b2c9-a7d36b27d44b service nova] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:51:48.316799 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [req-51a14ff7-5726-496d-9eac-3715355cb31f req-5a2d0300-4811-4cd3-b2c9-a7d36b27d44b service nova] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:51:48.333144 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.compute.server_external_events [req-51a14ff7-5726-496d-9eac-3715355cb31f req-5a2d0300-4811-4cd3-b2c9-a7d36b27d44b service nova] Creating event network-vif-plugged:028eab3d-f19b-4591-b8b2-199e74d95dfe for instance 2f7df954-edb0-41b8-a3d9-a8a870d487c3 on hv-cinder-83987 Apr 29 08:51:48.340266 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [req-51a14ff7-5726-496d-9eac-3715355cb31f req-5a2d0300-4811-4cd3-b2c9-a7d36b27d44b service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093519 Apr 29 08:51:48.341040 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 45/99] 10.222.0.31 () {64 vars in 1317 bytes} [Fri Apr 29 08:51:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 29 08:51:48.466980 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-5db45bd3-c716-4273-9560-516ebb41da9b tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e47ecdfb01f447699275b13255c15d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578e6a35974d4e5c8a0cd4e5fa994259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:51:48.474639 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-5db45bd3-c716-4273-9560-516ebb41da9b tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] 10.222.0.31 "GET /compute/v2.1/servers/0f9c17b6-b1a2-4ec6-ba8c-2097a8c8ccb7" status: 200 len: 1368 microversion: 2.1 time: 0.180459 Apr 29 08:51:48.475222 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 55/100] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 08:51:48 2022] GET /compute/v2.1/servers/0f9c17b6-b1a2-4ec6-ba8c-2097a8c8ccb7 => generated 1368 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 08:51:48.980475 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-18a8cbb2-1f27-4363-9902-50820e8ef28a tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Calling method '>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:51:48.981751 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-18a8cbb2-1f27-4363-9902-50820e8ef28a tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] [instance: 406b5ad6-698e-457f-93f4-cdfd45fb3e8e] Fetching instance by UUID {{(pid=123459) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:51:48.988662 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-18a8cbb2-1f27-4363-9902-50820e8ef28a tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:51:48.989291 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-18a8cbb2-1f27-4363-9902-50820e8ef28a tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:51:48.990052 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-18a8cbb2-1f27-4363-9902-50820e8ef28a tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:51:48.990482 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-18a8cbb2-1f27-4363-9902-50820e8ef28a tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:51:49.018998 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-374a278b-cb26-482e-b063-5bf1d5efca40 tempest-DeleteServersTestJSON-126197053 tempest-DeleteServersTestJSON-126197053-project] Calling method '>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:51:49.019703 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-374a278b-cb26-482e-b063-5bf1d5efca40 tempest-DeleteServersTestJSON-126197053 tempest-DeleteServersTestJSON-126197053-project] [instance: 2f7df954-edb0-41b8-a3d9-a8a870d487c3] Fetching instance by UUID {{(pid=123458) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:51:49.025969 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-374a278b-cb26-482e-b063-5bf1d5efca40 tempest-DeleteServersTestJSON-126197053 tempest-DeleteServersTestJSON-126197053-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:51:49.026455 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-374a278b-cb26-482e-b063-5bf1d5efca40 tempest-DeleteServersTestJSON-126197053 tempest-DeleteServersTestJSON-126197053-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:51:49.028397 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-374a278b-cb26-482e-b063-5bf1d5efca40 tempest-DeleteServersTestJSON-126197053 tempest-DeleteServersTestJSON-126197053-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:51:49.028844 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-374a278b-cb26-482e-b063-5bf1d5efca40 tempest-DeleteServersTestJSON-126197053 tempest-DeleteServersTestJSON-126197053-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:51:49.141637 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-18a8cbb2-1f27-4363-9902-50820e8ef28a tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:51:49.149804 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-18a8cbb2-1f27-4363-9902-50820e8ef28a tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:51:49.151319 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-18a8cbb2-1f27-4363-9902-50820e8ef28a tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:51:49.153181 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-18a8cbb2-1f27-4363-9902-50820e8ef28a tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] 10.222.0.31 "GET /compute/v2.1/servers/406b5ad6-698e-457f-93f4-cdfd45fb3e8e" status: 200 len: 1408 microversion: 2.20 time: 0.177799 Apr 29 08:51:49.153751 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 46/101] 10.222.0.31 () {60 vars in 1276 bytes} [Fri Apr 29 08:51:48 2022] GET /compute/v2.1/servers/406b5ad6-698e-457f-93f4-cdfd45fb3e8e => generated 1408 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 29 08:51:49.169553 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-374a278b-cb26-482e-b063-5bf1d5efca40 tempest-DeleteServersTestJSON-126197053 tempest-DeleteServersTestJSON-126197053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8aa040fad7754a4ba5752413fcfde807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b69a8d69ede453aa373fca0a65bdedd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:51:49.176905 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-374a278b-cb26-482e-b063-5bf1d5efca40 tempest-DeleteServersTestJSON-126197053 tempest-DeleteServersTestJSON-126197053-project] 10.222.0.31 "GET /compute/v2.1/servers/2f7df954-edb0-41b8-a3d9-a8a870d487c3" status: 200 len: 1315 microversion: 2.1 time: 0.161919 Apr 29 08:51:49.177482 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 56/102] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 08:51:49 2022] GET /compute/v2.1/servers/2f7df954-edb0-41b8-a3d9-a8a870d487c3 => generated 1315 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 29 08:51:49.492276 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-bff43d99-78dc-481e-aa6f-0bd98255ba2a tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Calling method '>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:51:49.492895 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-bff43d99-78dc-481e-aa6f-0bd98255ba2a tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] [instance: 0f9c17b6-b1a2-4ec6-ba8c-2097a8c8ccb7] Fetching instance by UUID {{(pid=123459) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:51:49.499061 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-bff43d99-78dc-481e-aa6f-0bd98255ba2a tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:51:49.499511 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-bff43d99-78dc-481e-aa6f-0bd98255ba2a tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:51:49.500333 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-bff43d99-78dc-481e-aa6f-0bd98255ba2a tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:51:49.500803 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-bff43d99-78dc-481e-aa6f-0bd98255ba2a tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:51:49.639502 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-bff43d99-78dc-481e-aa6f-0bd98255ba2a tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e47ecdfb01f447699275b13255c15d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578e6a35974d4e5c8a0cd4e5fa994259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:51:49.647228 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-bff43d99-78dc-481e-aa6f-0bd98255ba2a tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] 10.222.0.31 "GET /compute/v2.1/servers/0f9c17b6-b1a2-4ec6-ba8c-2097a8c8ccb7" status: 200 len: 1368 microversion: 2.1 time: 0.158983 Apr 29 08:51:49.647788 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 47/103] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 08:51:49 2022] GET /compute/v2.1/servers/0f9c17b6-b1a2-4ec6-ba8c-2097a8c8ccb7 => generated 1368 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 08:51:50.173803 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-f0573245-1132-4b60-94ca-aab82cd3e95b tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Calling method '>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:51:50.174459 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-f0573245-1132-4b60-94ca-aab82cd3e95b tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] [instance: 406b5ad6-698e-457f-93f4-cdfd45fb3e8e] Fetching instance by UUID {{(pid=123458) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:51:50.181084 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-f0573245-1132-4b60-94ca-aab82cd3e95b tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:51:50.182274 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-f0573245-1132-4b60-94ca-aab82cd3e95b tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:51:50.183761 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-f0573245-1132-4b60-94ca-aab82cd3e95b tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:51:50.184622 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-f0573245-1132-4b60-94ca-aab82cd3e95b tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:51:50.194647 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-8780cb70-f3c5-4439-ba78-af2c5970c95b tempest-DeleteServersTestJSON-126197053 tempest-DeleteServersTestJSON-126197053-project] Calling method '>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:51:50.195366 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-8780cb70-f3c5-4439-ba78-af2c5970c95b tempest-DeleteServersTestJSON-126197053 tempest-DeleteServersTestJSON-126197053-project] [instance: 2f7df954-edb0-41b8-a3d9-a8a870d487c3] Fetching instance by UUID {{(pid=123459) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:51:50.217931 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-8780cb70-f3c5-4439-ba78-af2c5970c95b tempest-DeleteServersTestJSON-126197053 tempest-DeleteServersTestJSON-126197053-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:51:50.220715 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-8780cb70-f3c5-4439-ba78-af2c5970c95b tempest-DeleteServersTestJSON-126197053 tempest-DeleteServersTestJSON-126197053-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:51:50.221808 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-8780cb70-f3c5-4439-ba78-af2c5970c95b tempest-DeleteServersTestJSON-126197053 tempest-DeleteServersTestJSON-126197053-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:51:50.222358 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-8780cb70-f3c5-4439-ba78-af2c5970c95b tempest-DeleteServersTestJSON-126197053 tempest-DeleteServersTestJSON-126197053-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:51:50.338344 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-f0573245-1132-4b60-94ca-aab82cd3e95b tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:51:50.355730 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-f0573245-1132-4b60-94ca-aab82cd3e95b tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:51:50.358418 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-f0573245-1132-4b60-94ca-aab82cd3e95b tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:51:50.360191 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-f0573245-1132-4b60-94ca-aab82cd3e95b tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] 10.222.0.31 "GET /compute/v2.1/servers/406b5ad6-698e-457f-93f4-cdfd45fb3e8e" status: 200 len: 1408 microversion: 2.20 time: 0.190440 Apr 29 08:51:50.376368 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 57/104] 10.222.0.31 () {60 vars in 1276 bytes} [Fri Apr 29 08:51:50 2022] GET /compute/v2.1/servers/406b5ad6-698e-457f-93f4-cdfd45fb3e8e => generated 1408 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 29 08:51:50.377598 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-8780cb70-f3c5-4439-ba78-af2c5970c95b tempest-DeleteServersTestJSON-126197053 tempest-DeleteServersTestJSON-126197053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8aa040fad7754a4ba5752413fcfde807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b69a8d69ede453aa373fca0a65bdedd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:51:50.385321 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-8780cb70-f3c5-4439-ba78-af2c5970c95b tempest-DeleteServersTestJSON-126197053 tempest-DeleteServersTestJSON-126197053-project] 10.222.0.31 "GET /compute/v2.1/servers/2f7df954-edb0-41b8-a3d9-a8a870d487c3" status: 200 len: 1315 microversion: 2.1 time: 0.194806 Apr 29 08:51:50.385954 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 48/105] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 08:51:50 2022] GET /compute/v2.1/servers/2f7df954-edb0-41b8-a3d9-a8a870d487c3 => generated 1315 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 08:51:50.664245 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-0e3e71c3-3042-4728-befa-65feb7f0dba1 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Calling method '>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:51:50.664872 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-0e3e71c3-3042-4728-befa-65feb7f0dba1 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] [instance: 0f9c17b6-b1a2-4ec6-ba8c-2097a8c8ccb7] Fetching instance by UUID {{(pid=123458) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:51:50.671483 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-0e3e71c3-3042-4728-befa-65feb7f0dba1 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:51:50.671930 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-0e3e71c3-3042-4728-befa-65feb7f0dba1 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:51:50.673196 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-0e3e71c3-3042-4728-befa-65feb7f0dba1 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:51:50.673294 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-0e3e71c3-3042-4728-befa-65feb7f0dba1 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:51:50.846630 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-0e3e71c3-3042-4728-befa-65feb7f0dba1 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e47ecdfb01f447699275b13255c15d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578e6a35974d4e5c8a0cd4e5fa994259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:51:50.854849 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-0e3e71c3-3042-4728-befa-65feb7f0dba1 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] 10.222.0.31 "GET /compute/v2.1/servers/0f9c17b6-b1a2-4ec6-ba8c-2097a8c8ccb7" status: 200 len: 1368 microversion: 2.1 time: 0.194498 Apr 29 08:51:50.855763 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 58/106] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 08:51:50 2022] GET /compute/v2.1/servers/0f9c17b6-b1a2-4ec6-ba8c-2097a8c8ccb7 => generated 1368 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 08:51:51.387192 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-f0f67c7d-096b-4d6d-9619-9641e7b1b857 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Calling method '>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:51:51.387957 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-f0f67c7d-096b-4d6d-9619-9641e7b1b857 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] [instance: 406b5ad6-698e-457f-93f4-cdfd45fb3e8e] Fetching instance by UUID {{(pid=123459) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:51:51.401332 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-f0f67c7d-096b-4d6d-9619-9641e7b1b857 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:51:51.403144 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-f0f67c7d-096b-4d6d-9619-9641e7b1b857 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:51:51.403660 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-29f90fe8-34fe-419c-993a-4df29f39e730 tempest-DeleteServersTestJSON-126197053 tempest-DeleteServersTestJSON-126197053-project] Calling method '>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:51:51.404670 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-f0f67c7d-096b-4d6d-9619-9641e7b1b857 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:51:51.405253 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-29f90fe8-34fe-419c-993a-4df29f39e730 tempest-DeleteServersTestJSON-126197053 tempest-DeleteServersTestJSON-126197053-project] [instance: 2f7df954-edb0-41b8-a3d9-a8a870d487c3] Fetching instance by UUID {{(pid=123458) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:51:51.405746 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-f0f67c7d-096b-4d6d-9619-9641e7b1b857 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:51:51.413770 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-29f90fe8-34fe-419c-993a-4df29f39e730 tempest-DeleteServersTestJSON-126197053 tempest-DeleteServersTestJSON-126197053-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:51:51.417063 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-29f90fe8-34fe-419c-993a-4df29f39e730 tempest-DeleteServersTestJSON-126197053 tempest-DeleteServersTestJSON-126197053-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:51:51.418644 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-29f90fe8-34fe-419c-993a-4df29f39e730 tempest-DeleteServersTestJSON-126197053 tempest-DeleteServersTestJSON-126197053-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:51:51.419374 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-29f90fe8-34fe-419c-993a-4df29f39e730 tempest-DeleteServersTestJSON-126197053 tempest-DeleteServersTestJSON-126197053-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:51:51.602412 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-f0f67c7d-096b-4d6d-9619-9641e7b1b857 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:51:51.611049 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-f0f67c7d-096b-4d6d-9619-9641e7b1b857 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:51:51.612606 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-f0f67c7d-096b-4d6d-9619-9641e7b1b857 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:51:51.613867 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-f0f67c7d-096b-4d6d-9619-9641e7b1b857 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] 10.222.0.31 "GET /compute/v2.1/servers/406b5ad6-698e-457f-93f4-cdfd45fb3e8e" status: 200 len: 1408 microversion: 2.20 time: 0.234578 Apr 29 08:51:51.624838 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 49/107] 10.222.0.31 () {60 vars in 1276 bytes} [Fri Apr 29 08:51:51 2022] GET /compute/v2.1/servers/406b5ad6-698e-457f-93f4-cdfd45fb3e8e => generated 1408 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 29 08:51:51.664424 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-29f90fe8-34fe-419c-993a-4df29f39e730 tempest-DeleteServersTestJSON-126197053 tempest-DeleteServersTestJSON-126197053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8aa040fad7754a4ba5752413fcfde807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b69a8d69ede453aa373fca0a65bdedd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:51:51.675901 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-29f90fe8-34fe-419c-993a-4df29f39e730 tempest-DeleteServersTestJSON-126197053 tempest-DeleteServersTestJSON-126197053-project] 10.222.0.31 "GET /compute/v2.1/servers/2f7df954-edb0-41b8-a3d9-a8a870d487c3" status: 200 len: 1315 microversion: 2.1 time: 0.277791 Apr 29 08:51:51.676525 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 59/108] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 08:51:51 2022] GET /compute/v2.1/servers/2f7df954-edb0-41b8-a3d9-a8a870d487c3 => generated 1315 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 29 08:51:51.874728 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-babda904-d9d5-4b11-b715-b9d5996bd613 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Calling method '>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:51:51.875606 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-babda904-d9d5-4b11-b715-b9d5996bd613 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] [instance: 0f9c17b6-b1a2-4ec6-ba8c-2097a8c8ccb7] Fetching instance by UUID {{(pid=123459) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:51:51.885094 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-babda904-d9d5-4b11-b715-b9d5996bd613 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:51:51.885773 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-babda904-d9d5-4b11-b715-b9d5996bd613 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:51:51.887275 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-babda904-d9d5-4b11-b715-b9d5996bd613 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:51:51.888025 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-babda904-d9d5-4b11-b715-b9d5996bd613 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:51:52.108198 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-babda904-d9d5-4b11-b715-b9d5996bd613 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e47ecdfb01f447699275b13255c15d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578e6a35974d4e5c8a0cd4e5fa994259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:51:52.122697 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-babda904-d9d5-4b11-b715-b9d5996bd613 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] 10.222.0.31 "GET /compute/v2.1/servers/0f9c17b6-b1a2-4ec6-ba8c-2097a8c8ccb7" status: 200 len: 1368 microversion: 2.1 time: 0.254228 Apr 29 08:51:52.123564 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 50/109] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 08:51:51 2022] GET /compute/v2.1/servers/0f9c17b6-b1a2-4ec6-ba8c-2097a8c8ccb7 => generated 1368 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 08:51:52.642676 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-7d5e0c4f-0042-4349-a69f-cba62bd4707d tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Calling method '>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:51:52.643321 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-7d5e0c4f-0042-4349-a69f-cba62bd4707d tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] [instance: 406b5ad6-698e-457f-93f4-cdfd45fb3e8e] Fetching instance by UUID {{(pid=123458) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:51:52.649417 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-7d5e0c4f-0042-4349-a69f-cba62bd4707d tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:51:52.649869 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-7d5e0c4f-0042-4349-a69f-cba62bd4707d tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:51:52.650658 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-7d5e0c4f-0042-4349-a69f-cba62bd4707d tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:51:52.651095 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-7d5e0c4f-0042-4349-a69f-cba62bd4707d tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:51:52.693526 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-a325184e-7c5d-42bb-bb7e-cc3f679f84a6 tempest-DeleteServersTestJSON-126197053 tempest-DeleteServersTestJSON-126197053-project] Calling method '>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:51:52.694296 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-a325184e-7c5d-42bb-bb7e-cc3f679f84a6 tempest-DeleteServersTestJSON-126197053 tempest-DeleteServersTestJSON-126197053-project] [instance: 2f7df954-edb0-41b8-a3d9-a8a870d487c3] Fetching instance by UUID {{(pid=123459) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:51:52.701218 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-a325184e-7c5d-42bb-bb7e-cc3f679f84a6 tempest-DeleteServersTestJSON-126197053 tempest-DeleteServersTestJSON-126197053-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:51:52.701734 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-a325184e-7c5d-42bb-bb7e-cc3f679f84a6 tempest-DeleteServersTestJSON-126197053 tempest-DeleteServersTestJSON-126197053-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:51:52.702797 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-a325184e-7c5d-42bb-bb7e-cc3f679f84a6 tempest-DeleteServersTestJSON-126197053 tempest-DeleteServersTestJSON-126197053-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:51:52.703303 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-a325184e-7c5d-42bb-bb7e-cc3f679f84a6 tempest-DeleteServersTestJSON-126197053 tempest-DeleteServersTestJSON-126197053-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:51:52.825998 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-7d5e0c4f-0042-4349-a69f-cba62bd4707d tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:51:52.835093 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-7d5e0c4f-0042-4349-a69f-cba62bd4707d tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:51:52.836690 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-7d5e0c4f-0042-4349-a69f-cba62bd4707d tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:51:52.837808 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-7d5e0c4f-0042-4349-a69f-cba62bd4707d tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] 10.222.0.31 "GET /compute/v2.1/servers/406b5ad6-698e-457f-93f4-cdfd45fb3e8e" status: 200 len: 1408 microversion: 2.20 time: 0.198934 Apr 29 08:51:52.838384 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 60/110] 10.222.0.31 () {60 vars in 1276 bytes} [Fri Apr 29 08:51:52 2022] GET /compute/v2.1/servers/406b5ad6-698e-457f-93f4-cdfd45fb3e8e => generated 1408 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 29 08:51:52.874405 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-a325184e-7c5d-42bb-bb7e-cc3f679f84a6 tempest-DeleteServersTestJSON-126197053 tempest-DeleteServersTestJSON-126197053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8aa040fad7754a4ba5752413fcfde807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b69a8d69ede453aa373fca0a65bdedd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:51:52.888105 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-a325184e-7c5d-42bb-bb7e-cc3f679f84a6 tempest-DeleteServersTestJSON-126197053 tempest-DeleteServersTestJSON-126197053-project] 10.222.0.31 "GET /compute/v2.1/servers/2f7df954-edb0-41b8-a3d9-a8a870d487c3" status: 200 len: 1315 microversion: 2.1 time: 0.196590 Apr 29 08:51:52.889117 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 51/111] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 08:51:52 2022] GET /compute/v2.1/servers/2f7df954-edb0-41b8-a3d9-a8a870d487c3 => generated 1315 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 29 08:51:53.146105 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-077865a9-f340-4e00-a32f-570b0e74bee4 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Calling method '>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:51:53.146915 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-077865a9-f340-4e00-a32f-570b0e74bee4 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] [instance: 0f9c17b6-b1a2-4ec6-ba8c-2097a8c8ccb7] Fetching instance by UUID {{(pid=123458) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:51:53.154699 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-077865a9-f340-4e00-a32f-570b0e74bee4 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:51:53.155237 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-077865a9-f340-4e00-a32f-570b0e74bee4 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:51:53.156232 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-077865a9-f340-4e00-a32f-570b0e74bee4 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:51:53.156738 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-077865a9-f340-4e00-a32f-570b0e74bee4 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:51:53.318450 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-077865a9-f340-4e00-a32f-570b0e74bee4 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e47ecdfb01f447699275b13255c15d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578e6a35974d4e5c8a0cd4e5fa994259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:51:53.326477 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-077865a9-f340-4e00-a32f-570b0e74bee4 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] 10.222.0.31 "GET /compute/v2.1/servers/0f9c17b6-b1a2-4ec6-ba8c-2097a8c8ccb7" status: 200 len: 1368 microversion: 2.1 time: 0.184518 Apr 29 08:51:53.327059 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 61/112] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 08:51:53 2022] GET /compute/v2.1/servers/0f9c17b6-b1a2-4ec6-ba8c-2097a8c8ccb7 => generated 1368 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 08:51:53.861148 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-f5d9af7b-d30a-41a3-a7f7-451b588c7d60 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Calling method '>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:51:53.861754 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-f5d9af7b-d30a-41a3-a7f7-451b588c7d60 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] [instance: 406b5ad6-698e-457f-93f4-cdfd45fb3e8e] Fetching instance by UUID {{(pid=123459) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:51:53.868536 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-f5d9af7b-d30a-41a3-a7f7-451b588c7d60 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:51:53.869448 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-f5d9af7b-d30a-41a3-a7f7-451b588c7d60 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:51:53.870525 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-f5d9af7b-d30a-41a3-a7f7-451b588c7d60 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:51:53.871641 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-f5d9af7b-d30a-41a3-a7f7-451b588c7d60 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:51:53.915314 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-55a4a485-2681-4208-90b9-45a947a61699 tempest-DeleteServersTestJSON-126197053 tempest-DeleteServersTestJSON-126197053-project] Calling method '>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:51:53.916740 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-55a4a485-2681-4208-90b9-45a947a61699 tempest-DeleteServersTestJSON-126197053 tempest-DeleteServersTestJSON-126197053-project] [instance: 2f7df954-edb0-41b8-a3d9-a8a870d487c3] Fetching instance by UUID {{(pid=123458) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:51:53.927338 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-55a4a485-2681-4208-90b9-45a947a61699 tempest-DeleteServersTestJSON-126197053 tempest-DeleteServersTestJSON-126197053-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:51:53.928842 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-55a4a485-2681-4208-90b9-45a947a61699 tempest-DeleteServersTestJSON-126197053 tempest-DeleteServersTestJSON-126197053-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:51:53.930612 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-55a4a485-2681-4208-90b9-45a947a61699 tempest-DeleteServersTestJSON-126197053 tempest-DeleteServersTestJSON-126197053-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:51:53.931533 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-55a4a485-2681-4208-90b9-45a947a61699 tempest-DeleteServersTestJSON-126197053 tempest-DeleteServersTestJSON-126197053-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:51:54.047326 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-f5d9af7b-d30a-41a3-a7f7-451b588c7d60 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:51:54.055699 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-f5d9af7b-d30a-41a3-a7f7-451b588c7d60 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:51:54.057248 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-f5d9af7b-d30a-41a3-a7f7-451b588c7d60 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:51:54.058953 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-f5d9af7b-d30a-41a3-a7f7-451b588c7d60 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] 10.222.0.31 "GET /compute/v2.1/servers/406b5ad6-698e-457f-93f4-cdfd45fb3e8e" status: 200 len: 1408 microversion: 2.20 time: 0.204319 Apr 29 08:51:54.059745 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 52/113] 10.222.0.31 () {60 vars in 1276 bytes} [Fri Apr 29 08:51:53 2022] GET /compute/v2.1/servers/406b5ad6-698e-457f-93f4-cdfd45fb3e8e => generated 1408 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 29 08:51:54.114581 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-55a4a485-2681-4208-90b9-45a947a61699 tempest-DeleteServersTestJSON-126197053 tempest-DeleteServersTestJSON-126197053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8aa040fad7754a4ba5752413fcfde807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b69a8d69ede453aa373fca0a65bdedd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:51:54.125505 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-55a4a485-2681-4208-90b9-45a947a61699 tempest-DeleteServersTestJSON-126197053 tempest-DeleteServersTestJSON-126197053-project] 10.222.0.31 "GET /compute/v2.1/servers/2f7df954-edb0-41b8-a3d9-a8a870d487c3" status: 200 len: 1315 microversion: 2.1 time: 0.223432 Apr 29 08:51:54.126501 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 62/114] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 08:51:53 2022] GET /compute/v2.1/servers/2f7df954-edb0-41b8-a3d9-a8a870d487c3 => generated 1315 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 29 08:51:54.346562 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-47509371-66b2-4f60-9456-34c3b6a9e812 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Calling method '>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:51:54.347510 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-47509371-66b2-4f60-9456-34c3b6a9e812 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] [instance: 0f9c17b6-b1a2-4ec6-ba8c-2097a8c8ccb7] Fetching instance by UUID {{(pid=123459) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:51:54.357154 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-47509371-66b2-4f60-9456-34c3b6a9e812 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:51:54.357805 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-47509371-66b2-4f60-9456-34c3b6a9e812 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:51:54.358962 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-47509371-66b2-4f60-9456-34c3b6a9e812 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:51:54.359531 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-47509371-66b2-4f60-9456-34c3b6a9e812 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:51:54.517952 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-47509371-66b2-4f60-9456-34c3b6a9e812 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e47ecdfb01f447699275b13255c15d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578e6a35974d4e5c8a0cd4e5fa994259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:51:54.525531 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-47509371-66b2-4f60-9456-34c3b6a9e812 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] 10.222.0.31 "GET /compute/v2.1/servers/0f9c17b6-b1a2-4ec6-ba8c-2097a8c8ccb7" status: 200 len: 1368 microversion: 2.1 time: 0.186270 Apr 29 08:51:54.526103 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 53/115] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 08:51:54 2022] GET /compute/v2.1/servers/0f9c17b6-b1a2-4ec6-ba8c-2097a8c8ccb7 => generated 1368 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 08:51:55.077808 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-3936a8c3-dfc7-45f0-ac33-f95e5e6e3e3c tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Calling method '>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:51:55.078569 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-3936a8c3-dfc7-45f0-ac33-f95e5e6e3e3c tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] [instance: 406b5ad6-698e-457f-93f4-cdfd45fb3e8e] Fetching instance by UUID {{(pid=123458) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:51:55.084607 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-3936a8c3-dfc7-45f0-ac33-f95e5e6e3e3c tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:51:55.085075 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-3936a8c3-dfc7-45f0-ac33-f95e5e6e3e3c tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:51:55.085867 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-3936a8c3-dfc7-45f0-ac33-f95e5e6e3e3c tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:51:55.086299 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-3936a8c3-dfc7-45f0-ac33-f95e5e6e3e3c tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:51:55.142852 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-da4d6ce5-57c7-44dd-aaf1-54ef765e3af5 tempest-DeleteServersTestJSON-126197053 tempest-DeleteServersTestJSON-126197053-project] Calling method '>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:51:55.143544 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-da4d6ce5-57c7-44dd-aaf1-54ef765e3af5 tempest-DeleteServersTestJSON-126197053 tempest-DeleteServersTestJSON-126197053-project] [instance: 2f7df954-edb0-41b8-a3d9-a8a870d487c3] Fetching instance by UUID {{(pid=123459) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:51:55.149624 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-da4d6ce5-57c7-44dd-aaf1-54ef765e3af5 tempest-DeleteServersTestJSON-126197053 tempest-DeleteServersTestJSON-126197053-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:51:55.150100 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-da4d6ce5-57c7-44dd-aaf1-54ef765e3af5 tempest-DeleteServersTestJSON-126197053 tempest-DeleteServersTestJSON-126197053-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:51:55.150856 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-da4d6ce5-57c7-44dd-aaf1-54ef765e3af5 tempest-DeleteServersTestJSON-126197053 tempest-DeleteServersTestJSON-126197053-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:51:55.151291 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-da4d6ce5-57c7-44dd-aaf1-54ef765e3af5 tempest-DeleteServersTestJSON-126197053 tempest-DeleteServersTestJSON-126197053-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:51:55.255890 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-3936a8c3-dfc7-45f0-ac33-f95e5e6e3e3c tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:51:55.270915 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-3936a8c3-dfc7-45f0-ac33-f95e5e6e3e3c tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:51:55.274462 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-3936a8c3-dfc7-45f0-ac33-f95e5e6e3e3c tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:51:55.274462 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-3936a8c3-dfc7-45f0-ac33-f95e5e6e3e3c tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] 10.222.0.31 "GET /compute/v2.1/servers/406b5ad6-698e-457f-93f4-cdfd45fb3e8e" status: 200 len: 1408 microversion: 2.20 time: 0.200759 Apr 29 08:51:55.278851 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 63/116] 10.222.0.31 () {60 vars in 1276 bytes} [Fri Apr 29 08:51:55 2022] GET /compute/v2.1/servers/406b5ad6-698e-457f-93f4-cdfd45fb3e8e => generated 1408 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 29 08:51:55.323291 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-da4d6ce5-57c7-44dd-aaf1-54ef765e3af5 tempest-DeleteServersTestJSON-126197053 tempest-DeleteServersTestJSON-126197053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8aa040fad7754a4ba5752413fcfde807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b69a8d69ede453aa373fca0a65bdedd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:51:55.331826 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-da4d6ce5-57c7-44dd-aaf1-54ef765e3af5 tempest-DeleteServersTestJSON-126197053 tempest-DeleteServersTestJSON-126197053-project] 10.222.0.31 "GET /compute/v2.1/servers/2f7df954-edb0-41b8-a3d9-a8a870d487c3" status: 200 len: 1315 microversion: 2.1 time: 0.192417 Apr 29 08:51:55.332439 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 54/117] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 08:51:55 2022] GET /compute/v2.1/servers/2f7df954-edb0-41b8-a3d9-a8a870d487c3 => generated 1315 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 29 08:51:55.543105 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-2e3be938-ebd4-4bf4-b8f2-1e96a9c5cafe tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Calling method '>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:51:55.543931 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-2e3be938-ebd4-4bf4-b8f2-1e96a9c5cafe tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] [instance: 0f9c17b6-b1a2-4ec6-ba8c-2097a8c8ccb7] Fetching instance by UUID {{(pid=123458) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:51:55.550485 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-2e3be938-ebd4-4bf4-b8f2-1e96a9c5cafe tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:51:55.550932 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-2e3be938-ebd4-4bf4-b8f2-1e96a9c5cafe tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:51:55.551725 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-2e3be938-ebd4-4bf4-b8f2-1e96a9c5cafe tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:51:55.552192 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-2e3be938-ebd4-4bf4-b8f2-1e96a9c5cafe tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:51:55.693474 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-2e3be938-ebd4-4bf4-b8f2-1e96a9c5cafe tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e47ecdfb01f447699275b13255c15d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578e6a35974d4e5c8a0cd4e5fa994259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:51:55.701773 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-2e3be938-ebd4-4bf4-b8f2-1e96a9c5cafe tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] 10.222.0.31 "GET /compute/v2.1/servers/0f9c17b6-b1a2-4ec6-ba8c-2097a8c8ccb7" status: 200 len: 1368 microversion: 2.1 time: 0.162804 Apr 29 08:51:55.702363 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 64/118] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 08:51:55 2022] GET /compute/v2.1/servers/0f9c17b6-b1a2-4ec6-ba8c-2097a8c8ccb7 => generated 1368 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 08:51:56.298777 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-bbd81d9a-d5ef-4599-a6e6-d7490a5d7efb tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Calling method '>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:51:56.299860 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-bbd81d9a-d5ef-4599-a6e6-d7490a5d7efb tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] [instance: 406b5ad6-698e-457f-93f4-cdfd45fb3e8e] Fetching instance by UUID {{(pid=123459) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:51:56.310976 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-bbd81d9a-d5ef-4599-a6e6-d7490a5d7efb tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:51:56.311432 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-bbd81d9a-d5ef-4599-a6e6-d7490a5d7efb tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:51:56.312247 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-bbd81d9a-d5ef-4599-a6e6-d7490a5d7efb tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:51:56.312688 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-bbd81d9a-d5ef-4599-a6e6-d7490a5d7efb tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:51:56.349473 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-43094e05-0d1f-45b5-83f5-8ddf6fdc677b tempest-DeleteServersTestJSON-126197053 tempest-DeleteServersTestJSON-126197053-project] Calling method '>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:51:56.350082 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-43094e05-0d1f-45b5-83f5-8ddf6fdc677b tempest-DeleteServersTestJSON-126197053 tempest-DeleteServersTestJSON-126197053-project] [instance: 2f7df954-edb0-41b8-a3d9-a8a870d487c3] Fetching instance by UUID {{(pid=123458) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:51:56.356376 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-43094e05-0d1f-45b5-83f5-8ddf6fdc677b tempest-DeleteServersTestJSON-126197053 tempest-DeleteServersTestJSON-126197053-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:51:56.356821 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-43094e05-0d1f-45b5-83f5-8ddf6fdc677b tempest-DeleteServersTestJSON-126197053 tempest-DeleteServersTestJSON-126197053-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:51:56.357595 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-43094e05-0d1f-45b5-83f5-8ddf6fdc677b tempest-DeleteServersTestJSON-126197053 tempest-DeleteServersTestJSON-126197053-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:51:56.358033 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-43094e05-0d1f-45b5-83f5-8ddf6fdc677b tempest-DeleteServersTestJSON-126197053 tempest-DeleteServersTestJSON-126197053-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:51:56.475482 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-bbd81d9a-d5ef-4599-a6e6-d7490a5d7efb tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:51:56.483766 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-bbd81d9a-d5ef-4599-a6e6-d7490a5d7efb tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:51:56.485296 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-bbd81d9a-d5ef-4599-a6e6-d7490a5d7efb tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:51:56.486689 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-bbd81d9a-d5ef-4599-a6e6-d7490a5d7efb tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] 10.222.0.31 "GET /compute/v2.1/servers/406b5ad6-698e-457f-93f4-cdfd45fb3e8e" status: 200 len: 1408 microversion: 2.20 time: 0.192518 Apr 29 08:51:56.487313 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 55/119] 10.222.0.31 () {60 vars in 1276 bytes} [Fri Apr 29 08:51:56 2022] GET /compute/v2.1/servers/406b5ad6-698e-457f-93f4-cdfd45fb3e8e => generated 1408 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 29 08:51:56.521992 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-43094e05-0d1f-45b5-83f5-8ddf6fdc677b tempest-DeleteServersTestJSON-126197053 tempest-DeleteServersTestJSON-126197053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8aa040fad7754a4ba5752413fcfde807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b69a8d69ede453aa373fca0a65bdedd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:51:56.533426 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-43094e05-0d1f-45b5-83f5-8ddf6fdc677b tempest-DeleteServersTestJSON-126197053 tempest-DeleteServersTestJSON-126197053-project] 10.222.0.31 "GET /compute/v2.1/servers/2f7df954-edb0-41b8-a3d9-a8a870d487c3" status: 200 len: 1315 microversion: 2.1 time: 0.187260 Apr 29 08:51:56.534564 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 65/120] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 08:51:56 2022] GET /compute/v2.1/servers/2f7df954-edb0-41b8-a3d9-a8a870d487c3 => generated 1315 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 29 08:51:56.718990 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-967423f7-f94b-40e9-bfbc-a13c8f987a03 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Calling method '>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:51:56.719596 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-967423f7-f94b-40e9-bfbc-a13c8f987a03 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] [instance: 0f9c17b6-b1a2-4ec6-ba8c-2097a8c8ccb7] Fetching instance by UUID {{(pid=123459) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:51:56.725579 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-967423f7-f94b-40e9-bfbc-a13c8f987a03 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:51:56.726013 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-967423f7-f94b-40e9-bfbc-a13c8f987a03 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:51:56.726781 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-967423f7-f94b-40e9-bfbc-a13c8f987a03 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:51:56.727203 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-967423f7-f94b-40e9-bfbc-a13c8f987a03 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:51:56.854449 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-967423f7-f94b-40e9-bfbc-a13c8f987a03 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e47ecdfb01f447699275b13255c15d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578e6a35974d4e5c8a0cd4e5fa994259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:51:56.862987 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-967423f7-f94b-40e9-bfbc-a13c8f987a03 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] 10.222.0.31 "GET /compute/v2.1/servers/0f9c17b6-b1a2-4ec6-ba8c-2097a8c8ccb7" status: 200 len: 1368 microversion: 2.1 time: 0.147925 Apr 29 08:51:56.863556 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 56/121] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 08:51:56 2022] GET /compute/v2.1/servers/0f9c17b6-b1a2-4ec6-ba8c-2097a8c8ccb7 => generated 1368 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 08:51:57.505286 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-d7db5e30-27e9-47b9-9959-039ba931ef94 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Calling method '>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:51:57.505895 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-d7db5e30-27e9-47b9-9959-039ba931ef94 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] [instance: 406b5ad6-698e-457f-93f4-cdfd45fb3e8e] Fetching instance by UUID {{(pid=123458) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:51:57.512771 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-d7db5e30-27e9-47b9-9959-039ba931ef94 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:51:57.513210 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-d7db5e30-27e9-47b9-9959-039ba931ef94 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:51:57.513999 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-d7db5e30-27e9-47b9-9959-039ba931ef94 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:51:57.514431 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-d7db5e30-27e9-47b9-9959-039ba931ef94 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:51:57.552690 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-ff5cdfb8-4660-46d0-b2a2-6abb09057c26 tempest-DeleteServersTestJSON-126197053 tempest-DeleteServersTestJSON-126197053-project] Calling method '>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:51:57.553564 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-ff5cdfb8-4660-46d0-b2a2-6abb09057c26 tempest-DeleteServersTestJSON-126197053 tempest-DeleteServersTestJSON-126197053-project] [instance: 2f7df954-edb0-41b8-a3d9-a8a870d487c3] Fetching instance by UUID {{(pid=123459) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:51:57.562013 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-ff5cdfb8-4660-46d0-b2a2-6abb09057c26 tempest-DeleteServersTestJSON-126197053 tempest-DeleteServersTestJSON-126197053-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:51:57.562463 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-ff5cdfb8-4660-46d0-b2a2-6abb09057c26 tempest-DeleteServersTestJSON-126197053 tempest-DeleteServersTestJSON-126197053-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:51:57.563275 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-ff5cdfb8-4660-46d0-b2a2-6abb09057c26 tempest-DeleteServersTestJSON-126197053 tempest-DeleteServersTestJSON-126197053-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:51:57.563857 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-ff5cdfb8-4660-46d0-b2a2-6abb09057c26 tempest-DeleteServersTestJSON-126197053 tempest-DeleteServersTestJSON-126197053-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:51:57.664947 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-d7db5e30-27e9-47b9-9959-039ba931ef94 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:51:57.675254 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-d7db5e30-27e9-47b9-9959-039ba931ef94 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:51:57.677097 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-d7db5e30-27e9-47b9-9959-039ba931ef94 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:51:57.678279 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-d7db5e30-27e9-47b9-9959-039ba931ef94 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] 10.222.0.31 "GET /compute/v2.1/servers/406b5ad6-698e-457f-93f4-cdfd45fb3e8e" status: 200 len: 1408 microversion: 2.20 time: 0.176901 Apr 29 08:51:57.678880 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 66/122] 10.222.0.31 () {60 vars in 1276 bytes} [Fri Apr 29 08:51:57 2022] GET /compute/v2.1/servers/406b5ad6-698e-457f-93f4-cdfd45fb3e8e => generated 1408 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 29 08:51:57.710243 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-ff5cdfb8-4660-46d0-b2a2-6abb09057c26 tempest-DeleteServersTestJSON-126197053 tempest-DeleteServersTestJSON-126197053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8aa040fad7754a4ba5752413fcfde807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b69a8d69ede453aa373fca0a65bdedd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:51:57.718245 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-ff5cdfb8-4660-46d0-b2a2-6abb09057c26 tempest-DeleteServersTestJSON-126197053 tempest-DeleteServersTestJSON-126197053-project] 10.222.0.31 "GET /compute/v2.1/servers/2f7df954-edb0-41b8-a3d9-a8a870d487c3" status: 200 len: 1315 microversion: 2.1 time: 0.169387 Apr 29 08:51:57.718823 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 57/123] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 08:51:57 2022] GET /compute/v2.1/servers/2f7df954-edb0-41b8-a3d9-a8a870d487c3 => generated 1315 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 08:51:57.880581 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-fd3dcdc2-3ae4-4407-abb9-5eb9d6dd6fba tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Calling method '>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:51:57.881197 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-fd3dcdc2-3ae4-4407-abb9-5eb9d6dd6fba tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] [instance: 0f9c17b6-b1a2-4ec6-ba8c-2097a8c8ccb7] Fetching instance by UUID {{(pid=123458) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:51:57.887309 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-fd3dcdc2-3ae4-4407-abb9-5eb9d6dd6fba tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:51:57.887764 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-fd3dcdc2-3ae4-4407-abb9-5eb9d6dd6fba tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:51:57.888580 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-fd3dcdc2-3ae4-4407-abb9-5eb9d6dd6fba tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:51:57.890267 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-fd3dcdc2-3ae4-4407-abb9-5eb9d6dd6fba tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:51:58.035684 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-fd3dcdc2-3ae4-4407-abb9-5eb9d6dd6fba tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e47ecdfb01f447699275b13255c15d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578e6a35974d4e5c8a0cd4e5fa994259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:51:58.044200 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-fd3dcdc2-3ae4-4407-abb9-5eb9d6dd6fba tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] 10.222.0.31 "GET /compute/v2.1/servers/0f9c17b6-b1a2-4ec6-ba8c-2097a8c8ccb7" status: 200 len: 1368 microversion: 2.1 time: 0.167247 Apr 29 08:51:58.044800 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 67/124] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 08:51:57 2022] GET /compute/v2.1/servers/0f9c17b6-b1a2-4ec6-ba8c-2097a8c8ccb7 => generated 1368 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 08:51:58.699662 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-9fe27161-1494-408a-b34f-254804c304ca tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Calling method '>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:51:58.700226 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-9fe27161-1494-408a-b34f-254804c304ca tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] [instance: 406b5ad6-698e-457f-93f4-cdfd45fb3e8e] Fetching instance by UUID {{(pid=123459) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:51:58.706542 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-9fe27161-1494-408a-b34f-254804c304ca tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:51:58.706925 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-9fe27161-1494-408a-b34f-254804c304ca tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:51:58.707734 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-9fe27161-1494-408a-b34f-254804c304ca tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:51:58.708234 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-9fe27161-1494-408a-b34f-254804c304ca tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:51:58.737006 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-912bc2c0-9d99-44ea-b95f-30ce0427f8f8 tempest-DeleteServersTestJSON-126197053 tempest-DeleteServersTestJSON-126197053-project] Calling method '>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:51:58.737913 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-912bc2c0-9d99-44ea-b95f-30ce0427f8f8 tempest-DeleteServersTestJSON-126197053 tempest-DeleteServersTestJSON-126197053-project] [instance: 2f7df954-edb0-41b8-a3d9-a8a870d487c3] Fetching instance by UUID {{(pid=123458) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:51:58.744582 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-912bc2c0-9d99-44ea-b95f-30ce0427f8f8 tempest-DeleteServersTestJSON-126197053 tempest-DeleteServersTestJSON-126197053-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:51:58.745025 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-912bc2c0-9d99-44ea-b95f-30ce0427f8f8 tempest-DeleteServersTestJSON-126197053 tempest-DeleteServersTestJSON-126197053-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:51:58.746307 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-912bc2c0-9d99-44ea-b95f-30ce0427f8f8 tempest-DeleteServersTestJSON-126197053 tempest-DeleteServersTestJSON-126197053-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:51:58.746738 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-912bc2c0-9d99-44ea-b95f-30ce0427f8f8 tempest-DeleteServersTestJSON-126197053 tempest-DeleteServersTestJSON-126197053-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:51:58.845817 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-9fe27161-1494-408a-b34f-254804c304ca tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:51:58.854284 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-9fe27161-1494-408a-b34f-254804c304ca tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:51:58.856640 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-9fe27161-1494-408a-b34f-254804c304ca tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:51:58.857864 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-9fe27161-1494-408a-b34f-254804c304ca tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] 10.222.0.31 "GET /compute/v2.1/servers/406b5ad6-698e-457f-93f4-cdfd45fb3e8e" status: 200 len: 1408 microversion: 2.20 time: 0.162749 Apr 29 08:51:58.858608 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 58/125] 10.222.0.31 () {60 vars in 1276 bytes} [Fri Apr 29 08:51:58 2022] GET /compute/v2.1/servers/406b5ad6-698e-457f-93f4-cdfd45fb3e8e => generated 1408 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 29 08:51:58.878994 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-912bc2c0-9d99-44ea-b95f-30ce0427f8f8 tempest-DeleteServersTestJSON-126197053 tempest-DeleteServersTestJSON-126197053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8aa040fad7754a4ba5752413fcfde807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b69a8d69ede453aa373fca0a65bdedd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:51:58.887268 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-912bc2c0-9d99-44ea-b95f-30ce0427f8f8 tempest-DeleteServersTestJSON-126197053 tempest-DeleteServersTestJSON-126197053-project] 10.222.0.31 "GET /compute/v2.1/servers/2f7df954-edb0-41b8-a3d9-a8a870d487c3" status: 200 len: 1315 microversion: 2.1 time: 0.154478 Apr 29 08:51:58.887848 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 68/126] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 08:51:58 2022] GET /compute/v2.1/servers/2f7df954-edb0-41b8-a3d9-a8a870d487c3 => generated 1315 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 29 08:51:59.062372 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-393adf9f-e6f2-4879-a029-538be9492e87 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Calling method '>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:51:59.062995 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-393adf9f-e6f2-4879-a029-538be9492e87 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] [instance: 0f9c17b6-b1a2-4ec6-ba8c-2097a8c8ccb7] Fetching instance by UUID {{(pid=123459) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:51:59.069073 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-393adf9f-e6f2-4879-a029-538be9492e87 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:51:59.069519 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-393adf9f-e6f2-4879-a029-538be9492e87 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:51:59.070382 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-393adf9f-e6f2-4879-a029-538be9492e87 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:51:59.070856 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-393adf9f-e6f2-4879-a029-538be9492e87 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:51:59.211120 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-393adf9f-e6f2-4879-a029-538be9492e87 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e47ecdfb01f447699275b13255c15d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578e6a35974d4e5c8a0cd4e5fa994259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:51:59.218544 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-393adf9f-e6f2-4879-a029-538be9492e87 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] 10.222.0.31 "GET /compute/v2.1/servers/0f9c17b6-b1a2-4ec6-ba8c-2097a8c8ccb7" status: 200 len: 1368 microversion: 2.1 time: 0.160954 Apr 29 08:51:59.219118 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 59/127] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 08:51:59 2022] GET /compute/v2.1/servers/0f9c17b6-b1a2-4ec6-ba8c-2097a8c8ccb7 => generated 1368 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 08:51:59.876377 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-f43facdf-e7c8-4e20-afb2-8ed81fbf7dda tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Calling method '>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:51:59.877126 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-f43facdf-e7c8-4e20-afb2-8ed81fbf7dda tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] [instance: 406b5ad6-698e-457f-93f4-cdfd45fb3e8e] Fetching instance by UUID {{(pid=123458) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:51:59.882974 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-f43facdf-e7c8-4e20-afb2-8ed81fbf7dda tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:51:59.883486 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-f43facdf-e7c8-4e20-afb2-8ed81fbf7dda tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:51:59.884353 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-f43facdf-e7c8-4e20-afb2-8ed81fbf7dda tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:51:59.884788 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-f43facdf-e7c8-4e20-afb2-8ed81fbf7dda tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:51:59.904438 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-73e0e9b4-9cda-4ec8-8b5d-25f0a8f93e89 tempest-DeleteServersTestJSON-126197053 tempest-DeleteServersTestJSON-126197053-project] Calling method '>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:51:59.905055 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-73e0e9b4-9cda-4ec8-8b5d-25f0a8f93e89 tempest-DeleteServersTestJSON-126197053 tempest-DeleteServersTestJSON-126197053-project] [instance: 2f7df954-edb0-41b8-a3d9-a8a870d487c3] Fetching instance by UUID {{(pid=123459) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:51:59.912989 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-73e0e9b4-9cda-4ec8-8b5d-25f0a8f93e89 tempest-DeleteServersTestJSON-126197053 tempest-DeleteServersTestJSON-126197053-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:51:59.913557 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-73e0e9b4-9cda-4ec8-8b5d-25f0a8f93e89 tempest-DeleteServersTestJSON-126197053 tempest-DeleteServersTestJSON-126197053-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:51:59.914350 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-73e0e9b4-9cda-4ec8-8b5d-25f0a8f93e89 tempest-DeleteServersTestJSON-126197053 tempest-DeleteServersTestJSON-126197053-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:51:59.914787 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-73e0e9b4-9cda-4ec8-8b5d-25f0a8f93e89 tempest-DeleteServersTestJSON-126197053 tempest-DeleteServersTestJSON-126197053-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:52:00.025627 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-f43facdf-e7c8-4e20-afb2-8ed81fbf7dda tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:52:00.035783 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-f43facdf-e7c8-4e20-afb2-8ed81fbf7dda tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:52:00.037399 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-f43facdf-e7c8-4e20-afb2-8ed81fbf7dda tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:52:00.038552 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-f43facdf-e7c8-4e20-afb2-8ed81fbf7dda tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] 10.222.0.31 "GET /compute/v2.1/servers/406b5ad6-698e-457f-93f4-cdfd45fb3e8e" status: 200 len: 1408 microversion: 2.20 time: 0.166201 Apr 29 08:52:00.039122 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 69/128] 10.222.0.31 () {60 vars in 1276 bytes} [Fri Apr 29 08:51:59 2022] GET /compute/v2.1/servers/406b5ad6-698e-457f-93f4-cdfd45fb3e8e => generated 1408 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 29 08:52:00.053199 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-73e0e9b4-9cda-4ec8-8b5d-25f0a8f93e89 tempest-DeleteServersTestJSON-126197053 tempest-DeleteServersTestJSON-126197053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8aa040fad7754a4ba5752413fcfde807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b69a8d69ede453aa373fca0a65bdedd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:52:00.060667 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-73e0e9b4-9cda-4ec8-8b5d-25f0a8f93e89 tempest-DeleteServersTestJSON-126197053 tempest-DeleteServersTestJSON-126197053-project] 10.222.0.31 "GET /compute/v2.1/servers/2f7df954-edb0-41b8-a3d9-a8a870d487c3" status: 200 len: 1315 microversion: 2.1 time: 0.161233 Apr 29 08:52:00.061229 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 60/129] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 08:51:59 2022] GET /compute/v2.1/servers/2f7df954-edb0-41b8-a3d9-a8a870d487c3 => generated 1315 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 29 08:52:00.237656 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-0a4a3d06-b946-4a14-855c-02ce4cb2094b tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Calling method '>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:52:00.238533 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-0a4a3d06-b946-4a14-855c-02ce4cb2094b tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] [instance: 0f9c17b6-b1a2-4ec6-ba8c-2097a8c8ccb7] Fetching instance by UUID {{(pid=123458) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:52:00.247996 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-0a4a3d06-b946-4a14-855c-02ce4cb2094b tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:52:00.248478 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-0a4a3d06-b946-4a14-855c-02ce4cb2094b tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:52:00.249314 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-0a4a3d06-b946-4a14-855c-02ce4cb2094b tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:52:00.249701 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-0a4a3d06-b946-4a14-855c-02ce4cb2094b tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:52:00.384070 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-0a4a3d06-b946-4a14-855c-02ce4cb2094b tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e47ecdfb01f447699275b13255c15d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578e6a35974d4e5c8a0cd4e5fa994259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:52:00.393133 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-0a4a3d06-b946-4a14-855c-02ce4cb2094b tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] 10.222.0.31 "GET /compute/v2.1/servers/0f9c17b6-b1a2-4ec6-ba8c-2097a8c8ccb7" status: 200 len: 1368 microversion: 2.1 time: 0.161359 Apr 29 08:52:00.393707 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 70/130] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 08:52:00 2022] GET /compute/v2.1/servers/0f9c17b6-b1a2-4ec6-ba8c-2097a8c8ccb7 => generated 1368 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 08:52:01.058028 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-a67add79-ca6d-4011-a58c-efbc03c2ceb1 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Calling method '>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:52:01.058858 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-a67add79-ca6d-4011-a58c-efbc03c2ceb1 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] [instance: 406b5ad6-698e-457f-93f4-cdfd45fb3e8e] Fetching instance by UUID {{(pid=123459) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:52:01.064683 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-a67add79-ca6d-4011-a58c-efbc03c2ceb1 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:52:01.065128 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-a67add79-ca6d-4011-a58c-efbc03c2ceb1 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:52:01.065897 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-a67add79-ca6d-4011-a58c-efbc03c2ceb1 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:52:01.066332 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-a67add79-ca6d-4011-a58c-efbc03c2ceb1 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:52:01.078391 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-0f4e8122-e511-4418-9af8-d2153f90bcf1 tempest-DeleteServersTestJSON-126197053 tempest-DeleteServersTestJSON-126197053-project] Calling method '>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:52:01.079014 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-0f4e8122-e511-4418-9af8-d2153f90bcf1 tempest-DeleteServersTestJSON-126197053 tempest-DeleteServersTestJSON-126197053-project] [instance: 2f7df954-edb0-41b8-a3d9-a8a870d487c3] Fetching instance by UUID {{(pid=123458) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:52:01.085280 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-0f4e8122-e511-4418-9af8-d2153f90bcf1 tempest-DeleteServersTestJSON-126197053 tempest-DeleteServersTestJSON-126197053-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:52:01.085733 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-0f4e8122-e511-4418-9af8-d2153f90bcf1 tempest-DeleteServersTestJSON-126197053 tempest-DeleteServersTestJSON-126197053-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:52:01.086509 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-0f4e8122-e511-4418-9af8-d2153f90bcf1 tempest-DeleteServersTestJSON-126197053 tempest-DeleteServersTestJSON-126197053-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:52:01.087120 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-0f4e8122-e511-4418-9af8-d2153f90bcf1 tempest-DeleteServersTestJSON-126197053 tempest-DeleteServersTestJSON-126197053-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:52:01.232252 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-0f4e8122-e511-4418-9af8-d2153f90bcf1 tempest-DeleteServersTestJSON-126197053 tempest-DeleteServersTestJSON-126197053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8aa040fad7754a4ba5752413fcfde807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b69a8d69ede453aa373fca0a65bdedd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:52:01.240865 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-a67add79-ca6d-4011-a58c-efbc03c2ceb1 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:52:01.242956 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-0f4e8122-e511-4418-9af8-d2153f90bcf1 tempest-DeleteServersTestJSON-126197053 tempest-DeleteServersTestJSON-126197053-project] 10.222.0.31 "GET /compute/v2.1/servers/2f7df954-edb0-41b8-a3d9-a8a870d487c3" status: 200 len: 1315 microversion: 2.1 time: 0.169224 Apr 29 08:52:01.248706 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 71/131] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 08:52:01 2022] GET /compute/v2.1/servers/2f7df954-edb0-41b8-a3d9-a8a870d487c3 => generated 1315 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 29 08:52:01.254804 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-a67add79-ca6d-4011-a58c-efbc03c2ceb1 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:52:01.256263 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-a67add79-ca6d-4011-a58c-efbc03c2ceb1 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:52:01.257375 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-a67add79-ca6d-4011-a58c-efbc03c2ceb1 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] 10.222.0.31 "GET /compute/v2.1/servers/406b5ad6-698e-457f-93f4-cdfd45fb3e8e" status: 200 len: 1408 microversion: 2.20 time: 0.203368 Apr 29 08:52:01.258111 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 61/132] 10.222.0.31 () {60 vars in 1276 bytes} [Fri Apr 29 08:52:01 2022] GET /compute/v2.1/servers/406b5ad6-698e-457f-93f4-cdfd45fb3e8e => generated 1408 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 29 08:52:01.409911 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-10bff4f3-6609-497d-991a-552496f0802b tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Calling method '>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:52:01.410600 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-10bff4f3-6609-497d-991a-552496f0802b tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] [instance: 0f9c17b6-b1a2-4ec6-ba8c-2097a8c8ccb7] Fetching instance by UUID {{(pid=123458) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:52:01.416430 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-10bff4f3-6609-497d-991a-552496f0802b tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:52:01.416854 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-10bff4f3-6609-497d-991a-552496f0802b tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:52:01.418230 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-10bff4f3-6609-497d-991a-552496f0802b tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:52:01.418657 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-10bff4f3-6609-497d-991a-552496f0802b tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:52:01.560106 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-10bff4f3-6609-497d-991a-552496f0802b tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e47ecdfb01f447699275b13255c15d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578e6a35974d4e5c8a0cd4e5fa994259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:52:01.576734 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-10bff4f3-6609-497d-991a-552496f0802b tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] 10.222.0.31 "GET /compute/v2.1/servers/0f9c17b6-b1a2-4ec6-ba8c-2097a8c8ccb7" status: 200 len: 1368 microversion: 2.1 time: 0.170522 Apr 29 08:52:01.577331 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 72/133] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 08:52:01 2022] GET /compute/v2.1/servers/0f9c17b6-b1a2-4ec6-ba8c-2097a8c8ccb7 => generated 1368 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 08:52:02.260692 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-c07ff4af-b6fd-400a-b9b3-f920838ce7e2 tempest-DeleteServersTestJSON-126197053 tempest-DeleteServersTestJSON-126197053-project] Calling method '>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:52:02.261485 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-c07ff4af-b6fd-400a-b9b3-f920838ce7e2 tempest-DeleteServersTestJSON-126197053 tempest-DeleteServersTestJSON-126197053-project] [instance: 2f7df954-edb0-41b8-a3d9-a8a870d487c3] Fetching instance by UUID {{(pid=123459) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:52:02.268549 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-c07ff4af-b6fd-400a-b9b3-f920838ce7e2 tempest-DeleteServersTestJSON-126197053 tempest-DeleteServersTestJSON-126197053-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:52:02.269231 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-c07ff4af-b6fd-400a-b9b3-f920838ce7e2 tempest-DeleteServersTestJSON-126197053 tempest-DeleteServersTestJSON-126197053-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:52:02.283263 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-4b9d82c5-4243-4709-ad8d-72b8ee744679 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Calling method '>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:52:02.283263 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-4b9d82c5-4243-4709-ad8d-72b8ee744679 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] [instance: 406b5ad6-698e-457f-93f4-cdfd45fb3e8e] Fetching instance by UUID {{(pid=123458) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:52:02.283794 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-c07ff4af-b6fd-400a-b9b3-f920838ce7e2 tempest-DeleteServersTestJSON-126197053 tempest-DeleteServersTestJSON-126197053-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:52:02.283794 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-c07ff4af-b6fd-400a-b9b3-f920838ce7e2 tempest-DeleteServersTestJSON-126197053 tempest-DeleteServersTestJSON-126197053-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:52:02.283955 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-4b9d82c5-4243-4709-ad8d-72b8ee744679 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:52:02.284564 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-4b9d82c5-4243-4709-ad8d-72b8ee744679 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:52:02.285202 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-4b9d82c5-4243-4709-ad8d-72b8ee744679 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:52:02.285704 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-4b9d82c5-4243-4709-ad8d-72b8ee744679 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:52:02.430395 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-c07ff4af-b6fd-400a-b9b3-f920838ce7e2 tempest-DeleteServersTestJSON-126197053 tempest-DeleteServersTestJSON-126197053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8aa040fad7754a4ba5752413fcfde807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b69a8d69ede453aa373fca0a65bdedd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:52:02.438727 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-c07ff4af-b6fd-400a-b9b3-f920838ce7e2 tempest-DeleteServersTestJSON-126197053 tempest-DeleteServersTestJSON-126197053-project] 10.222.0.31 "GET /compute/v2.1/servers/2f7df954-edb0-41b8-a3d9-a8a870d487c3" status: 200 len: 1315 microversion: 2.1 time: 0.181991 Apr 29 08:52:02.439745 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 62/134] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 08:52:02 2022] GET /compute/v2.1/servers/2f7df954-edb0-41b8-a3d9-a8a870d487c3 => generated 1315 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 08:52:02.441925 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-4b9d82c5-4243-4709-ad8d-72b8ee744679 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:52:02.449906 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-4b9d82c5-4243-4709-ad8d-72b8ee744679 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:52:02.451432 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-4b9d82c5-4243-4709-ad8d-72b8ee744679 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:52:02.452572 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-4b9d82c5-4243-4709-ad8d-72b8ee744679 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] 10.222.0.31 "GET /compute/v2.1/servers/406b5ad6-698e-457f-93f4-cdfd45fb3e8e" status: 200 len: 1408 microversion: 2.20 time: 0.180808 Apr 29 08:52:02.453135 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 73/135] 10.222.0.31 () {60 vars in 1276 bytes} [Fri Apr 29 08:52:02 2022] GET /compute/v2.1/servers/406b5ad6-698e-457f-93f4-cdfd45fb3e8e => generated 1408 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 29 08:52:02.594433 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-68e7a505-47bf-40bf-8607-5bf7d6cf3947 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Calling method '>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:52:02.594958 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-68e7a505-47bf-40bf-8607-5bf7d6cf3947 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] [instance: 0f9c17b6-b1a2-4ec6-ba8c-2097a8c8ccb7] Fetching instance by UUID {{(pid=123459) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:52:02.601140 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-68e7a505-47bf-40bf-8607-5bf7d6cf3947 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:52:02.601585 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-68e7a505-47bf-40bf-8607-5bf7d6cf3947 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:52:02.602361 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-68e7a505-47bf-40bf-8607-5bf7d6cf3947 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:52:02.602792 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-68e7a505-47bf-40bf-8607-5bf7d6cf3947 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:52:02.738649 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-68e7a505-47bf-40bf-8607-5bf7d6cf3947 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e47ecdfb01f447699275b13255c15d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578e6a35974d4e5c8a0cd4e5fa994259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:52:02.746235 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-68e7a505-47bf-40bf-8607-5bf7d6cf3947 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] 10.222.0.31 "GET /compute/v2.1/servers/0f9c17b6-b1a2-4ec6-ba8c-2097a8c8ccb7" status: 200 len: 1368 microversion: 2.1 time: 0.155796 Apr 29 08:52:02.746798 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 63/136] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 08:52:02 2022] GET /compute/v2.1/servers/0f9c17b6-b1a2-4ec6-ba8c-2097a8c8ccb7 => generated 1368 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 08:52:03.456673 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-6bf39080-01d3-4f73-8d39-387c61133f3f tempest-DeleteServersTestJSON-126197053 tempest-DeleteServersTestJSON-126197053-project] Calling method '>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:52:03.457282 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-6bf39080-01d3-4f73-8d39-387c61133f3f tempest-DeleteServersTestJSON-126197053 tempest-DeleteServersTestJSON-126197053-project] [instance: 2f7df954-edb0-41b8-a3d9-a8a870d487c3] Fetching instance by UUID {{(pid=123458) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:52:03.463290 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-6bf39080-01d3-4f73-8d39-387c61133f3f tempest-DeleteServersTestJSON-126197053 tempest-DeleteServersTestJSON-126197053-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:52:03.463741 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-6bf39080-01d3-4f73-8d39-387c61133f3f tempest-DeleteServersTestJSON-126197053 tempest-DeleteServersTestJSON-126197053-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:52:03.464792 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-6bf39080-01d3-4f73-8d39-387c61133f3f tempest-DeleteServersTestJSON-126197053 tempest-DeleteServersTestJSON-126197053-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:52:03.465230 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-6bf39080-01d3-4f73-8d39-387c61133f3f tempest-DeleteServersTestJSON-126197053 tempest-DeleteServersTestJSON-126197053-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:52:03.470608 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-fb69a937-c74f-4b2c-8b04-6c1cedf23e3a tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Calling method '>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:52:03.471214 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-fb69a937-c74f-4b2c-8b04-6c1cedf23e3a tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] [instance: 406b5ad6-698e-457f-93f4-cdfd45fb3e8e] Fetching instance by UUID {{(pid=123459) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:52:03.477073 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-fb69a937-c74f-4b2c-8b04-6c1cedf23e3a tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:52:03.477517 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-fb69a937-c74f-4b2c-8b04-6c1cedf23e3a tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:52:03.478293 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-fb69a937-c74f-4b2c-8b04-6c1cedf23e3a tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:52:03.478725 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-fb69a937-c74f-4b2c-8b04-6c1cedf23e3a tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:52:03.597969 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-6bf39080-01d3-4f73-8d39-387c61133f3f tempest-DeleteServersTestJSON-126197053 tempest-DeleteServersTestJSON-126197053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8aa040fad7754a4ba5752413fcfde807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b69a8d69ede453aa373fca0a65bdedd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:52:03.606113 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-6bf39080-01d3-4f73-8d39-387c61133f3f tempest-DeleteServersTestJSON-126197053 tempest-DeleteServersTestJSON-126197053-project] 10.222.0.31 "GET /compute/v2.1/servers/2f7df954-edb0-41b8-a3d9-a8a870d487c3" status: 200 len: 1315 microversion: 2.1 time: 0.153089 Apr 29 08:52:03.606699 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 74/137] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 08:52:03 2022] GET /compute/v2.1/servers/2f7df954-edb0-41b8-a3d9-a8a870d487c3 => generated 1315 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 08:52:03.610524 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-fb69a937-c74f-4b2c-8b04-6c1cedf23e3a tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:52:03.618502 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-fb69a937-c74f-4b2c-8b04-6c1cedf23e3a tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:52:03.620099 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-fb69a937-c74f-4b2c-8b04-6c1cedf23e3a tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:52:03.621762 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-fb69a937-c74f-4b2c-8b04-6c1cedf23e3a tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] 10.222.0.31 "GET /compute/v2.1/servers/406b5ad6-698e-457f-93f4-cdfd45fb3e8e" status: 200 len: 1408 microversion: 2.20 time: 0.154996 Apr 29 08:52:03.622348 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 64/138] 10.222.0.31 () {60 vars in 1276 bytes} [Fri Apr 29 08:52:03 2022] GET /compute/v2.1/servers/406b5ad6-698e-457f-93f4-cdfd45fb3e8e => generated 1408 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 29 08:52:03.762716 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-cffc960d-2bd7-4828-be11-f61a4f12e833 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Calling method '>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:52:03.763480 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-cffc960d-2bd7-4828-be11-f61a4f12e833 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] [instance: 0f9c17b6-b1a2-4ec6-ba8c-2097a8c8ccb7] Fetching instance by UUID {{(pid=123458) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:52:03.769409 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-cffc960d-2bd7-4828-be11-f61a4f12e833 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:52:03.769853 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-cffc960d-2bd7-4828-be11-f61a4f12e833 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:52:03.770614 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-cffc960d-2bd7-4828-be11-f61a4f12e833 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:52:03.771046 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-cffc960d-2bd7-4828-be11-f61a4f12e833 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:52:03.899167 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-cffc960d-2bd7-4828-be11-f61a4f12e833 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e47ecdfb01f447699275b13255c15d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578e6a35974d4e5c8a0cd4e5fa994259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:52:03.906898 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-cffc960d-2bd7-4828-be11-f61a4f12e833 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] 10.222.0.31 "GET /compute/v2.1/servers/0f9c17b6-b1a2-4ec6-ba8c-2097a8c8ccb7" status: 200 len: 1368 microversion: 2.1 time: 0.148153 Apr 29 08:52:03.907455 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 75/139] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 08:52:03 2022] GET /compute/v2.1/servers/0f9c17b6-b1a2-4ec6-ba8c-2097a8c8ccb7 => generated 1368 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 08:52:04.624590 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-8e33ee29-997e-4ca5-9675-87faff334069 tempest-DeleteServersTestJSON-126197053 tempest-DeleteServersTestJSON-126197053-project] Calling method '>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:52:04.625112 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-8e33ee29-997e-4ca5-9675-87faff334069 tempest-DeleteServersTestJSON-126197053 tempest-DeleteServersTestJSON-126197053-project] [instance: 2f7df954-edb0-41b8-a3d9-a8a870d487c3] Fetching instance by UUID {{(pid=123459) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:52:04.631524 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-8e33ee29-997e-4ca5-9675-87faff334069 tempest-DeleteServersTestJSON-126197053 tempest-DeleteServersTestJSON-126197053-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:52:04.632182 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-8e33ee29-997e-4ca5-9675-87faff334069 tempest-DeleteServersTestJSON-126197053 tempest-DeleteServersTestJSON-126197053-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:52:04.633033 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-8e33ee29-997e-4ca5-9675-87faff334069 tempest-DeleteServersTestJSON-126197053 tempest-DeleteServersTestJSON-126197053-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:52:04.633748 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-8e33ee29-997e-4ca5-9675-87faff334069 tempest-DeleteServersTestJSON-126197053 tempest-DeleteServersTestJSON-126197053-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:52:04.640686 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-a333f056-0167-44f8-975d-a38f4c387d09 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Calling method '>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:52:04.641356 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-a333f056-0167-44f8-975d-a38f4c387d09 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] [instance: 406b5ad6-698e-457f-93f4-cdfd45fb3e8e] Fetching instance by UUID {{(pid=123458) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:52:04.647533 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-a333f056-0167-44f8-975d-a38f4c387d09 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:52:04.647985 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-a333f056-0167-44f8-975d-a38f4c387d09 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:52:04.648832 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-a333f056-0167-44f8-975d-a38f4c387d09 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:52:04.649269 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-a333f056-0167-44f8-975d-a38f4c387d09 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:52:04.779841 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-8e33ee29-997e-4ca5-9675-87faff334069 tempest-DeleteServersTestJSON-126197053 tempest-DeleteServersTestJSON-126197053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8aa040fad7754a4ba5752413fcfde807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b69a8d69ede453aa373fca0a65bdedd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:52:04.787598 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-8e33ee29-997e-4ca5-9675-87faff334069 tempest-DeleteServersTestJSON-126197053 tempest-DeleteServersTestJSON-126197053-project] 10.222.0.31 "GET /compute/v2.1/servers/2f7df954-edb0-41b8-a3d9-a8a870d487c3" status: 200 len: 1315 microversion: 2.1 time: 0.167506 Apr 29 08:52:04.788271 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 65/140] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 08:52:04 2022] GET /compute/v2.1/servers/2f7df954-edb0-41b8-a3d9-a8a870d487c3 => generated 1315 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 08:52:04.815164 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-a333f056-0167-44f8-975d-a38f4c387d09 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:52:04.823695 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-a333f056-0167-44f8-975d-a38f4c387d09 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:52:04.825586 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-a333f056-0167-44f8-975d-a38f4c387d09 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:52:04.826818 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-a333f056-0167-44f8-975d-a38f4c387d09 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] 10.222.0.31 "GET /compute/v2.1/servers/406b5ad6-698e-457f-93f4-cdfd45fb3e8e" status: 200 len: 1408 microversion: 2.20 time: 0.191730 Apr 29 08:52:04.827450 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 76/141] 10.222.0.31 () {60 vars in 1276 bytes} [Fri Apr 29 08:52:04 2022] GET /compute/v2.1/servers/406b5ad6-698e-457f-93f4-cdfd45fb3e8e => generated 1408 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 29 08:52:04.929149 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-0ecb7e7b-575a-4ab9-a9bb-6fedc9324491 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Calling method '>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:52:04.929943 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-0ecb7e7b-575a-4ab9-a9bb-6fedc9324491 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] [instance: 0f9c17b6-b1a2-4ec6-ba8c-2097a8c8ccb7] Fetching instance by UUID {{(pid=123459) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:52:04.936420 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-0ecb7e7b-575a-4ab9-a9bb-6fedc9324491 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:52:04.936860 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-0ecb7e7b-575a-4ab9-a9bb-6fedc9324491 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:52:04.937616 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-0ecb7e7b-575a-4ab9-a9bb-6fedc9324491 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:52:04.938042 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-0ecb7e7b-575a-4ab9-a9bb-6fedc9324491 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:52:05.070091 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-0ecb7e7b-575a-4ab9-a9bb-6fedc9324491 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e47ecdfb01f447699275b13255c15d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578e6a35974d4e5c8a0cd4e5fa994259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:52:05.078244 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-0ecb7e7b-575a-4ab9-a9bb-6fedc9324491 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] 10.222.0.31 "GET /compute/v2.1/servers/0f9c17b6-b1a2-4ec6-ba8c-2097a8c8ccb7" status: 200 len: 1368 microversion: 2.1 time: 0.157210 Apr 29 08:52:05.078812 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 66/142] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 08:52:04 2022] GET /compute/v2.1/servers/0f9c17b6-b1a2-4ec6-ba8c-2097a8c8ccb7 => generated 1368 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 08:52:05.806281 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-5b0e22cb-1be2-4c63-be76-bb0969822d29 tempest-DeleteServersTestJSON-126197053 tempest-DeleteServersTestJSON-126197053-project] Calling method '>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:52:05.807619 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-5b0e22cb-1be2-4c63-be76-bb0969822d29 tempest-DeleteServersTestJSON-126197053 tempest-DeleteServersTestJSON-126197053-project] [instance: 2f7df954-edb0-41b8-a3d9-a8a870d487c3] Fetching instance by UUID {{(pid=123458) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:52:05.814578 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-5b0e22cb-1be2-4c63-be76-bb0969822d29 tempest-DeleteServersTestJSON-126197053 tempest-DeleteServersTestJSON-126197053-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:52:05.815116 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-5b0e22cb-1be2-4c63-be76-bb0969822d29 tempest-DeleteServersTestJSON-126197053 tempest-DeleteServersTestJSON-126197053-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:52:05.816008 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-5b0e22cb-1be2-4c63-be76-bb0969822d29 tempest-DeleteServersTestJSON-126197053 tempest-DeleteServersTestJSON-126197053-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:52:05.816736 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-5b0e22cb-1be2-4c63-be76-bb0969822d29 tempest-DeleteServersTestJSON-126197053 tempest-DeleteServersTestJSON-126197053-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:52:05.847300 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-84d855d7-d97f-42e0-a764-447adee7884b tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Calling method '>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:52:05.847925 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-84d855d7-d97f-42e0-a764-447adee7884b tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] [instance: 406b5ad6-698e-457f-93f4-cdfd45fb3e8e] Fetching instance by UUID {{(pid=123459) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:52:05.854243 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-84d855d7-d97f-42e0-a764-447adee7884b tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:52:05.855311 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-84d855d7-d97f-42e0-a764-447adee7884b tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:52:05.857064 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-84d855d7-d97f-42e0-a764-447adee7884b tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:52:05.857678 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-84d855d7-d97f-42e0-a764-447adee7884b tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:52:06.025832 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-5b0e22cb-1be2-4c63-be76-bb0969822d29 tempest-DeleteServersTestJSON-126197053 tempest-DeleteServersTestJSON-126197053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8aa040fad7754a4ba5752413fcfde807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b69a8d69ede453aa373fca0a65bdedd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:52:06.034389 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-5b0e22cb-1be2-4c63-be76-bb0969822d29 tempest-DeleteServersTestJSON-126197053 tempest-DeleteServersTestJSON-126197053-project] 10.222.0.31 "GET /compute/v2.1/servers/2f7df954-edb0-41b8-a3d9-a8a870d487c3" status: 200 len: 1315 microversion: 2.1 time: 0.232310 Apr 29 08:52:06.034972 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 77/143] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 08:52:05 2022] GET /compute/v2.1/servers/2f7df954-edb0-41b8-a3d9-a8a870d487c3 => generated 1315 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 08:52:06.044677 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-84d855d7-d97f-42e0-a764-447adee7884b tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:52:06.053767 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-84d855d7-d97f-42e0-a764-447adee7884b tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:52:06.055255 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-84d855d7-d97f-42e0-a764-447adee7884b tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:52:06.056386 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-84d855d7-d97f-42e0-a764-447adee7884b tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] 10.222.0.31 "GET /compute/v2.1/servers/406b5ad6-698e-457f-93f4-cdfd45fb3e8e" status: 200 len: 1408 microversion: 2.20 time: 0.213097 Apr 29 08:52:06.056944 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 67/144] 10.222.0.31 () {60 vars in 1276 bytes} [Fri Apr 29 08:52:05 2022] GET /compute/v2.1/servers/406b5ad6-698e-457f-93f4-cdfd45fb3e8e => generated 1408 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 29 08:52:06.095885 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-83507c5b-ccab-4c04-9348-c12a59fd5425 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Calling method '>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:52:06.096761 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-83507c5b-ccab-4c04-9348-c12a59fd5425 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] [instance: 0f9c17b6-b1a2-4ec6-ba8c-2097a8c8ccb7] Fetching instance by UUID {{(pid=123458) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:52:06.103734 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-83507c5b-ccab-4c04-9348-c12a59fd5425 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:52:06.104305 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-83507c5b-ccab-4c04-9348-c12a59fd5425 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:52:06.105687 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-83507c5b-ccab-4c04-9348-c12a59fd5425 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:52:06.106120 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-83507c5b-ccab-4c04-9348-c12a59fd5425 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:52:06.107206 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [req-b67e2c73-277a-4756-822d-ffeb78bbc792 req-0bf2a660-f53e-47f4-b3f3-6e94fcb070be service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0f9c17b6-b1a2-4ec6-ba8c-2097a8c8ccb7", "name": "network-vif-plugged", "status": "completed", "tag": "3b21bf13-34c3-4eab-b46e-1fddbe0106a8"}]} {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 29 08:52:06.116576 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [req-b67e2c73-277a-4756-822d-ffeb78bbc792 req-0bf2a660-f53e-47f4-b3f3-6e94fcb070be service nova] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:52:06.117650 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [req-b67e2c73-277a-4756-822d-ffeb78bbc792 req-0bf2a660-f53e-47f4-b3f3-6e94fcb070be service nova] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:52:06.140764 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.compute.server_external_events [req-b67e2c73-277a-4756-822d-ffeb78bbc792 req-0bf2a660-f53e-47f4-b3f3-6e94fcb070be service nova] Creating event network-vif-plugged:3b21bf13-34c3-4eab-b46e-1fddbe0106a8 for instance 0f9c17b6-b1a2-4ec6-ba8c-2097a8c8ccb7 on hv-cinder-83987 Apr 29 08:52:06.149655 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [req-b67e2c73-277a-4756-822d-ffeb78bbc792 req-0bf2a660-f53e-47f4-b3f3-6e94fcb070be service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046846 Apr 29 08:52:06.150761 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 68/145] 10.222.0.31 () {64 vars in 1317 bytes} [Fri Apr 29 08:52:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 29 08:52:06.258558 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-83507c5b-ccab-4c04-9348-c12a59fd5425 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e47ecdfb01f447699275b13255c15d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578e6a35974d4e5c8a0cd4e5fa994259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:52:06.266517 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-83507c5b-ccab-4c04-9348-c12a59fd5425 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] 10.222.0.31 "GET /compute/v2.1/servers/0f9c17b6-b1a2-4ec6-ba8c-2097a8c8ccb7" status: 200 len: 1368 microversion: 2.1 time: 0.174637 Apr 29 08:52:06.267117 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 78/146] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 08:52:06 2022] GET /compute/v2.1/servers/0f9c17b6-b1a2-4ec6-ba8c-2097a8c8ccb7 => generated 1368 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 08:52:07.054474 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-7b3fe6e8-7103-4078-a93f-fa502d876b05 tempest-DeleteServersTestJSON-126197053 tempest-DeleteServersTestJSON-126197053-project] Calling method '>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:52:07.055684 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-7b3fe6e8-7103-4078-a93f-fa502d876b05 tempest-DeleteServersTestJSON-126197053 tempest-DeleteServersTestJSON-126197053-project] [instance: 2f7df954-edb0-41b8-a3d9-a8a870d487c3] Fetching instance by UUID {{(pid=123459) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:52:07.066122 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-7b3fe6e8-7103-4078-a93f-fa502d876b05 tempest-DeleteServersTestJSON-126197053 tempest-DeleteServersTestJSON-126197053-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:52:07.066597 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-7b3fe6e8-7103-4078-a93f-fa502d876b05 tempest-DeleteServersTestJSON-126197053 tempest-DeleteServersTestJSON-126197053-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:52:07.067471 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-7b3fe6e8-7103-4078-a93f-fa502d876b05 tempest-DeleteServersTestJSON-126197053 tempest-DeleteServersTestJSON-126197053-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:52:07.076920 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-1294c4a5-1f5e-468e-9306-fc82a3e54785 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Calling method '>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:52:07.077820 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-1294c4a5-1f5e-468e-9306-fc82a3e54785 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] [instance: 406b5ad6-698e-457f-93f4-cdfd45fb3e8e] Fetching instance by UUID {{(pid=123458) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:52:07.089144 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-7b3fe6e8-7103-4078-a93f-fa502d876b05 tempest-DeleteServersTestJSON-126197053 tempest-DeleteServersTestJSON-126197053-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:52:07.111541 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-1294c4a5-1f5e-468e-9306-fc82a3e54785 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:52:07.111995 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-1294c4a5-1f5e-468e-9306-fc82a3e54785 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:52:07.112830 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-1294c4a5-1f5e-468e-9306-fc82a3e54785 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:52:07.113272 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-1294c4a5-1f5e-468e-9306-fc82a3e54785 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:52:07.431396 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-1294c4a5-1f5e-468e-9306-fc82a3e54785 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:52:07.440579 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-1294c4a5-1f5e-468e-9306-fc82a3e54785 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:52:07.442129 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-1294c4a5-1f5e-468e-9306-fc82a3e54785 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:52:07.443299 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-1294c4a5-1f5e-468e-9306-fc82a3e54785 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] 10.222.0.31 "GET /compute/v2.1/servers/406b5ad6-698e-457f-93f4-cdfd45fb3e8e" status: 200 len: 1408 microversion: 2.20 time: 0.370916 Apr 29 08:52:07.443865 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 79/147] 10.222.0.31 () {60 vars in 1276 bytes} [Fri Apr 29 08:52:07 2022] GET /compute/v2.1/servers/406b5ad6-698e-457f-93f4-cdfd45fb3e8e => generated 1408 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 29 08:52:07.448525 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-1b4dd653-5f7c-4bc6-bd33-bd6f932ad50e tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Calling method '>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:52:07.449535 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-1b4dd653-5f7c-4bc6-bd33-bd6f932ad50e tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] [instance: 0f9c17b6-b1a2-4ec6-ba8c-2097a8c8ccb7] Fetching instance by UUID {{(pid=123458) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:52:07.455735 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-1b4dd653-5f7c-4bc6-bd33-bd6f932ad50e tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:52:07.456566 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-1b4dd653-5f7c-4bc6-bd33-bd6f932ad50e tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:52:07.457536 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-1b4dd653-5f7c-4bc6-bd33-bd6f932ad50e tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:52:07.458163 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-1b4dd653-5f7c-4bc6-bd33-bd6f932ad50e tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:52:07.471854 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-7b3fe6e8-7103-4078-a93f-fa502d876b05 tempest-DeleteServersTestJSON-126197053 tempest-DeleteServersTestJSON-126197053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8aa040fad7754a4ba5752413fcfde807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b69a8d69ede453aa373fca0a65bdedd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:52:07.486763 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-7b3fe6e8-7103-4078-a93f-fa502d876b05 tempest-DeleteServersTestJSON-126197053 tempest-DeleteServersTestJSON-126197053-project] 10.222.0.31 "GET /compute/v2.1/servers/2f7df954-edb0-41b8-a3d9-a8a870d487c3" status: 200 len: 1315 microversion: 2.1 time: 0.436736 Apr 29 08:52:07.488191 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 69/148] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 08:52:07 2022] GET /compute/v2.1/servers/2f7df954-edb0-41b8-a3d9-a8a870d487c3 => generated 1315 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 08:52:07.664939 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-1b4dd653-5f7c-4bc6-bd33-bd6f932ad50e tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e47ecdfb01f447699275b13255c15d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578e6a35974d4e5c8a0cd4e5fa994259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:52:07.674303 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-1b4dd653-5f7c-4bc6-bd33-bd6f932ad50e tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] 10.222.0.31 "GET /compute/v2.1/servers/0f9c17b6-b1a2-4ec6-ba8c-2097a8c8ccb7" status: 200 len: 1368 microversion: 2.1 time: 0.229335 Apr 29 08:52:07.688235 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 80/149] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 08:52:07 2022] GET /compute/v2.1/servers/0f9c17b6-b1a2-4ec6-ba8c-2097a8c8ccb7 => generated 1368 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 08:52:08.466321 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-fd091ad2-f560-46de-9dae-69373b132d31 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Calling method '>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:52:08.467997 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-fd091ad2-f560-46de-9dae-69373b132d31 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] [instance: 406b5ad6-698e-457f-93f4-cdfd45fb3e8e] Fetching instance by UUID {{(pid=123459) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:52:08.494913 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-fd091ad2-f560-46de-9dae-69373b132d31 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:52:08.496005 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-fd091ad2-f560-46de-9dae-69373b132d31 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:52:08.498252 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-fd091ad2-f560-46de-9dae-69373b132d31 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:52:08.498733 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-fd091ad2-f560-46de-9dae-69373b132d31 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:52:08.506993 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-c5140e12-7b49-4df7-a31a-d1589a7074b6 tempest-DeleteServersTestJSON-126197053 tempest-DeleteServersTestJSON-126197053-project] Calling method '>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:52:08.507602 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-c5140e12-7b49-4df7-a31a-d1589a7074b6 tempest-DeleteServersTestJSON-126197053 tempest-DeleteServersTestJSON-126197053-project] [instance: 2f7df954-edb0-41b8-a3d9-a8a870d487c3] Fetching instance by UUID {{(pid=123458) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:52:08.518206 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-c5140e12-7b49-4df7-a31a-d1589a7074b6 tempest-DeleteServersTestJSON-126197053 tempest-DeleteServersTestJSON-126197053-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:52:08.519882 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-c5140e12-7b49-4df7-a31a-d1589a7074b6 tempest-DeleteServersTestJSON-126197053 tempest-DeleteServersTestJSON-126197053-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:52:08.521270 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-c5140e12-7b49-4df7-a31a-d1589a7074b6 tempest-DeleteServersTestJSON-126197053 tempest-DeleteServersTestJSON-126197053-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:52:08.522309 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-c5140e12-7b49-4df7-a31a-d1589a7074b6 tempest-DeleteServersTestJSON-126197053 tempest-DeleteServersTestJSON-126197053-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:52:08.653577 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-fd091ad2-f560-46de-9dae-69373b132d31 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:52:08.663007 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-fd091ad2-f560-46de-9dae-69373b132d31 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:52:08.664967 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-fd091ad2-f560-46de-9dae-69373b132d31 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:52:08.666401 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-fd091ad2-f560-46de-9dae-69373b132d31 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] 10.222.0.31 "GET /compute/v2.1/servers/406b5ad6-698e-457f-93f4-cdfd45fb3e8e" status: 200 len: 1408 microversion: 2.20 time: 0.207469 Apr 29 08:52:08.668425 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 70/150] 10.222.0.31 () {60 vars in 1276 bytes} [Fri Apr 29 08:52:08 2022] GET /compute/v2.1/servers/406b5ad6-698e-457f-93f4-cdfd45fb3e8e => generated 1408 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 29 08:52:08.672510 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-c5140e12-7b49-4df7-a31a-d1589a7074b6 tempest-DeleteServersTestJSON-126197053 tempest-DeleteServersTestJSON-126197053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8aa040fad7754a4ba5752413fcfde807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b69a8d69ede453aa373fca0a65bdedd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:52:08.680966 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-c5140e12-7b49-4df7-a31a-d1589a7074b6 tempest-DeleteServersTestJSON-126197053 tempest-DeleteServersTestJSON-126197053-project] 10.222.0.31 "GET /compute/v2.1/servers/2f7df954-edb0-41b8-a3d9-a8a870d487c3" status: 200 len: 1315 microversion: 2.1 time: 0.178875 Apr 29 08:52:08.681539 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 81/151] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 08:52:08 2022] GET /compute/v2.1/servers/2f7df954-edb0-41b8-a3d9-a8a870d487c3 => generated 1315 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 29 08:52:08.693106 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-2dbfa1b3-798e-4185-a057-0b6f77a7f53c tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Calling method '>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:52:08.693717 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-2dbfa1b3-798e-4185-a057-0b6f77a7f53c tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] [instance: 0f9c17b6-b1a2-4ec6-ba8c-2097a8c8ccb7] Fetching instance by UUID {{(pid=123459) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:52:08.700404 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-2dbfa1b3-798e-4185-a057-0b6f77a7f53c tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:52:08.700852 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-2dbfa1b3-798e-4185-a057-0b6f77a7f53c tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:52:08.701620 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-2dbfa1b3-798e-4185-a057-0b6f77a7f53c tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:52:08.702045 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-2dbfa1b3-798e-4185-a057-0b6f77a7f53c tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:52:08.846032 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-2dbfa1b3-798e-4185-a057-0b6f77a7f53c tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e47ecdfb01f447699275b13255c15d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578e6a35974d4e5c8a0cd4e5fa994259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:52:08.859628 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-2dbfa1b3-798e-4185-a057-0b6f77a7f53c tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] 10.222.0.31 "GET /compute/v2.1/servers/0f9c17b6-b1a2-4ec6-ba8c-2097a8c8ccb7" status: 200 len: 1368 microversion: 2.1 time: 0.170804 Apr 29 08:52:08.860903 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 71/152] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 08:52:08 2022] GET /compute/v2.1/servers/0f9c17b6-b1a2-4ec6-ba8c-2097a8c8ccb7 => generated 1368 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 08:52:09.684242 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-729645cd-285f-467d-9310-44afd08b54bc tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Calling method '>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:52:09.684853 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-729645cd-285f-467d-9310-44afd08b54bc tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] [instance: 406b5ad6-698e-457f-93f4-cdfd45fb3e8e] Fetching instance by UUID {{(pid=123458) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:52:09.694875 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-729645cd-285f-467d-9310-44afd08b54bc tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:52:09.694875 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-729645cd-285f-467d-9310-44afd08b54bc tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:52:09.694875 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-729645cd-285f-467d-9310-44afd08b54bc tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:52:09.694875 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-729645cd-285f-467d-9310-44afd08b54bc tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:52:09.699960 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-246209c5-3e41-4c9e-b0d9-c2bb98cdbc9e tempest-DeleteServersTestJSON-126197053 tempest-DeleteServersTestJSON-126197053-project] Calling method '>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:52:09.700626 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-246209c5-3e41-4c9e-b0d9-c2bb98cdbc9e tempest-DeleteServersTestJSON-126197053 tempest-DeleteServersTestJSON-126197053-project] [instance: 2f7df954-edb0-41b8-a3d9-a8a870d487c3] Fetching instance by UUID {{(pid=123459) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:52:09.706910 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-246209c5-3e41-4c9e-b0d9-c2bb98cdbc9e tempest-DeleteServersTestJSON-126197053 tempest-DeleteServersTestJSON-126197053-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:52:09.709262 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-246209c5-3e41-4c9e-b0d9-c2bb98cdbc9e tempest-DeleteServersTestJSON-126197053 tempest-DeleteServersTestJSON-126197053-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:52:09.710238 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-246209c5-3e41-4c9e-b0d9-c2bb98cdbc9e tempest-DeleteServersTestJSON-126197053 tempest-DeleteServersTestJSON-126197053-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:52:09.710716 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-246209c5-3e41-4c9e-b0d9-c2bb98cdbc9e tempest-DeleteServersTestJSON-126197053 tempest-DeleteServersTestJSON-126197053-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:52:09.838724 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-729645cd-285f-467d-9310-44afd08b54bc tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:52:09.844640 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-729645cd-285f-467d-9310-44afd08b54bc tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:52:09.846144 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-729645cd-285f-467d-9310-44afd08b54bc tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:52:09.847465 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-729645cd-285f-467d-9310-44afd08b54bc tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] 10.222.0.31 "GET /compute/v2.1/servers/406b5ad6-698e-457f-93f4-cdfd45fb3e8e" status: 200 len: 1408 microversion: 2.20 time: 0.167423 Apr 29 08:52:09.848421 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 82/153] 10.222.0.31 () {60 vars in 1276 bytes} [Fri Apr 29 08:52:09 2022] GET /compute/v2.1/servers/406b5ad6-698e-457f-93f4-cdfd45fb3e8e => generated 1408 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 29 08:52:09.869309 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-246209c5-3e41-4c9e-b0d9-c2bb98cdbc9e tempest-DeleteServersTestJSON-126197053 tempest-DeleteServersTestJSON-126197053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8aa040fad7754a4ba5752413fcfde807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b69a8d69ede453aa373fca0a65bdedd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:52:09.877765 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-246209c5-3e41-4c9e-b0d9-c2bb98cdbc9e tempest-DeleteServersTestJSON-126197053 tempest-DeleteServersTestJSON-126197053-project] 10.222.0.31 "GET /compute/v2.1/servers/2f7df954-edb0-41b8-a3d9-a8a870d487c3" status: 200 len: 1315 microversion: 2.1 time: 0.182757 Apr 29 08:52:09.878395 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 72/154] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 08:52:09 2022] GET /compute/v2.1/servers/2f7df954-edb0-41b8-a3d9-a8a870d487c3 => generated 1315 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 29 08:52:09.893041 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-32583fce-ab06-4aaf-aee7-ab34e58bff2e tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Calling method '>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:52:09.893792 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-32583fce-ab06-4aaf-aee7-ab34e58bff2e tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] [instance: 0f9c17b6-b1a2-4ec6-ba8c-2097a8c8ccb7] Fetching instance by UUID {{(pid=123458) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:52:09.900738 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-32583fce-ab06-4aaf-aee7-ab34e58bff2e tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:52:09.901333 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-32583fce-ab06-4aaf-aee7-ab34e58bff2e tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:52:09.902859 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-32583fce-ab06-4aaf-aee7-ab34e58bff2e tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:52:09.903304 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-32583fce-ab06-4aaf-aee7-ab34e58bff2e tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:52:10.048783 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-32583fce-ab06-4aaf-aee7-ab34e58bff2e tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e47ecdfb01f447699275b13255c15d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578e6a35974d4e5c8a0cd4e5fa994259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:52:10.058267 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-32583fce-ab06-4aaf-aee7-ab34e58bff2e tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] 10.222.0.31 "GET /compute/v2.1/servers/0f9c17b6-b1a2-4ec6-ba8c-2097a8c8ccb7" status: 200 len: 1368 microversion: 2.1 time: 0.168479 Apr 29 08:52:10.068532 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 83/155] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 08:52:09 2022] GET /compute/v2.1/servers/0f9c17b6-b1a2-4ec6-ba8c-2097a8c8ccb7 => generated 1368 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 08:52:10.865572 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-c8dc28af-971f-4858-b7fb-da8433a23404 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Calling method '>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:52:10.866177 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-c8dc28af-971f-4858-b7fb-da8433a23404 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] [instance: 406b5ad6-698e-457f-93f4-cdfd45fb3e8e] Fetching instance by UUID {{(pid=123459) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:52:10.873312 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-c8dc28af-971f-4858-b7fb-da8433a23404 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:52:10.873797 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-c8dc28af-971f-4858-b7fb-da8433a23404 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:52:10.874661 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-c8dc28af-971f-4858-b7fb-da8433a23404 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:52:10.875094 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-c8dc28af-971f-4858-b7fb-da8433a23404 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:52:10.895409 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-7b422599-849a-4042-b216-632231fd1786 tempest-DeleteServersTestJSON-126197053 tempest-DeleteServersTestJSON-126197053-project] Calling method '>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:52:10.896122 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-7b422599-849a-4042-b216-632231fd1786 tempest-DeleteServersTestJSON-126197053 tempest-DeleteServersTestJSON-126197053-project] [instance: 2f7df954-edb0-41b8-a3d9-a8a870d487c3] Fetching instance by UUID {{(pid=123458) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:52:10.902926 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-7b422599-849a-4042-b216-632231fd1786 tempest-DeleteServersTestJSON-126197053 tempest-DeleteServersTestJSON-126197053-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:52:10.903661 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-7b422599-849a-4042-b216-632231fd1786 tempest-DeleteServersTestJSON-126197053 tempest-DeleteServersTestJSON-126197053-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:52:10.904461 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-7b422599-849a-4042-b216-632231fd1786 tempest-DeleteServersTestJSON-126197053 tempest-DeleteServersTestJSON-126197053-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:52:10.904905 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-7b422599-849a-4042-b216-632231fd1786 tempest-DeleteServersTestJSON-126197053 tempest-DeleteServersTestJSON-126197053-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:52:11.035816 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-c8dc28af-971f-4858-b7fb-da8433a23404 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:52:11.046765 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-c8dc28af-971f-4858-b7fb-da8433a23404 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:52:11.048540 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-c8dc28af-971f-4858-b7fb-da8433a23404 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:52:11.049671 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-c8dc28af-971f-4858-b7fb-da8433a23404 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] 10.222.0.31 "GET /compute/v2.1/servers/406b5ad6-698e-457f-93f4-cdfd45fb3e8e" status: 200 len: 1408 microversion: 2.20 time: 0.188252 Apr 29 08:52:11.050226 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 73/156] 10.222.0.31 () {60 vars in 1276 bytes} [Fri Apr 29 08:52:10 2022] GET /compute/v2.1/servers/406b5ad6-698e-457f-93f4-cdfd45fb3e8e => generated 1408 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 29 08:52:11.071409 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-7b422599-849a-4042-b216-632231fd1786 tempest-DeleteServersTestJSON-126197053 tempest-DeleteServersTestJSON-126197053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8aa040fad7754a4ba5752413fcfde807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b69a8d69ede453aa373fca0a65bdedd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:52:11.078649 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-5a7c9513-97d8-4ff3-81aa-274842cf5852 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Calling method '>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:52:11.079178 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-5a7c9513-97d8-4ff3-81aa-274842cf5852 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] [instance: 0f9c17b6-b1a2-4ec6-ba8c-2097a8c8ccb7] Fetching instance by UUID {{(pid=123459) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:52:11.087130 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-7b422599-849a-4042-b216-632231fd1786 tempest-DeleteServersTestJSON-126197053 tempest-DeleteServersTestJSON-126197053-project] 10.222.0.31 "GET /compute/v2.1/servers/2f7df954-edb0-41b8-a3d9-a8a870d487c3" status: 200 len: 1315 microversion: 2.1 time: 0.195970 Apr 29 08:52:11.089806 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 84/157] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 08:52:10 2022] GET /compute/v2.1/servers/2f7df954-edb0-41b8-a3d9-a8a870d487c3 => generated 1315 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 08:52:11.095708 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-5a7c9513-97d8-4ff3-81aa-274842cf5852 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:52:11.096451 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-5a7c9513-97d8-4ff3-81aa-274842cf5852 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:52:11.097688 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-5a7c9513-97d8-4ff3-81aa-274842cf5852 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:52:11.098123 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-5a7c9513-97d8-4ff3-81aa-274842cf5852 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:52:11.236821 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-5a7c9513-97d8-4ff3-81aa-274842cf5852 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e47ecdfb01f447699275b13255c15d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578e6a35974d4e5c8a0cd4e5fa994259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:52:11.244289 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-5a7c9513-97d8-4ff3-81aa-274842cf5852 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] 10.222.0.31 "GET /compute/v2.1/servers/0f9c17b6-b1a2-4ec6-ba8c-2097a8c8ccb7" status: 200 len: 1368 microversion: 2.1 time: 0.169604 Apr 29 08:52:11.244968 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 74/158] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 08:52:11 2022] GET /compute/v2.1/servers/0f9c17b6-b1a2-4ec6-ba8c-2097a8c8ccb7 => generated 1368 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 08:52:12.069368 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-335d9d7e-22f6-4687-ac9b-75395f04df57 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Calling method '>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:52:12.070265 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-335d9d7e-22f6-4687-ac9b-75395f04df57 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] [instance: 406b5ad6-698e-457f-93f4-cdfd45fb3e8e] Fetching instance by UUID {{(pid=123458) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:52:12.076472 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-335d9d7e-22f6-4687-ac9b-75395f04df57 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:52:12.076995 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-335d9d7e-22f6-4687-ac9b-75395f04df57 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:52:12.077855 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-335d9d7e-22f6-4687-ac9b-75395f04df57 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:52:12.078356 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-335d9d7e-22f6-4687-ac9b-75395f04df57 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:52:12.104189 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-09897b71-b9cf-4fac-8e12-f0155631506f tempest-DeleteServersTestJSON-126197053 tempest-DeleteServersTestJSON-126197053-project] Calling method '>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:52:12.106006 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-09897b71-b9cf-4fac-8e12-f0155631506f tempest-DeleteServersTestJSON-126197053 tempest-DeleteServersTestJSON-126197053-project] [instance: 2f7df954-edb0-41b8-a3d9-a8a870d487c3] Fetching instance by UUID {{(pid=123459) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:52:12.112482 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-09897b71-b9cf-4fac-8e12-f0155631506f tempest-DeleteServersTestJSON-126197053 tempest-DeleteServersTestJSON-126197053-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:52:12.112926 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-09897b71-b9cf-4fac-8e12-f0155631506f tempest-DeleteServersTestJSON-126197053 tempest-DeleteServersTestJSON-126197053-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:52:12.113827 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-09897b71-b9cf-4fac-8e12-f0155631506f tempest-DeleteServersTestJSON-126197053 tempest-DeleteServersTestJSON-126197053-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:52:12.114287 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-09897b71-b9cf-4fac-8e12-f0155631506f tempest-DeleteServersTestJSON-126197053 tempest-DeleteServersTestJSON-126197053-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:52:12.249274 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-09897b71-b9cf-4fac-8e12-f0155631506f tempest-DeleteServersTestJSON-126197053 tempest-DeleteServersTestJSON-126197053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8aa040fad7754a4ba5752413fcfde807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b69a8d69ede453aa373fca0a65bdedd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:52:12.256803 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-09897b71-b9cf-4fac-8e12-f0155631506f tempest-DeleteServersTestJSON-126197053 tempest-DeleteServersTestJSON-126197053-project] 10.222.0.31 "GET /compute/v2.1/servers/2f7df954-edb0-41b8-a3d9-a8a870d487c3" status: 200 len: 1315 microversion: 2.1 time: 0.156192 Apr 29 08:52:12.266570 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 75/159] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 08:52:12 2022] GET /compute/v2.1/servers/2f7df954-edb0-41b8-a3d9-a8a870d487c3 => generated 1315 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 29 08:52:12.270681 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-335d9d7e-22f6-4687-ac9b-75395f04df57 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:52:12.271727 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-1e40db9b-2ada-4341-8d81-8ab78b670afc tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Calling method '>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:52:12.272591 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-1e40db9b-2ada-4341-8d81-8ab78b670afc tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] [instance: 0f9c17b6-b1a2-4ec6-ba8c-2097a8c8ccb7] Fetching instance by UUID {{(pid=123459) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:52:12.279214 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-335d9d7e-22f6-4687-ac9b-75395f04df57 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:52:12.280740 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-335d9d7e-22f6-4687-ac9b-75395f04df57 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:52:12.281037 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-1e40db9b-2ada-4341-8d81-8ab78b670afc tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:52:12.281489 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-1e40db9b-2ada-4341-8d81-8ab78b670afc tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:52:12.282271 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-1e40db9b-2ada-4341-8d81-8ab78b670afc tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:52:12.282495 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-335d9d7e-22f6-4687-ac9b-75395f04df57 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] 10.222.0.31 "GET /compute/v2.1/servers/406b5ad6-698e-457f-93f4-cdfd45fb3e8e" status: 200 len: 1408 microversion: 2.20 time: 0.217222 Apr 29 08:52:12.283097 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-1e40db9b-2ada-4341-8d81-8ab78b670afc tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:52:12.283218 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 85/160] 10.222.0.31 () {60 vars in 1276 bytes} [Fri Apr 29 08:52:12 2022] GET /compute/v2.1/servers/406b5ad6-698e-457f-93f4-cdfd45fb3e8e => generated 1408 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 29 08:52:12.430921 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-1e40db9b-2ada-4341-8d81-8ab78b670afc tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e47ecdfb01f447699275b13255c15d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578e6a35974d4e5c8a0cd4e5fa994259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:52:12.438668 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-1e40db9b-2ada-4341-8d81-8ab78b670afc tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] 10.222.0.31 "GET /compute/v2.1/servers/0f9c17b6-b1a2-4ec6-ba8c-2097a8c8ccb7" status: 200 len: 1368 microversion: 2.1 time: 0.170977 Apr 29 08:52:12.439235 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 76/161] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 08:52:12 2022] GET /compute/v2.1/servers/0f9c17b6-b1a2-4ec6-ba8c-2097a8c8ccb7 => generated 1368 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 08:52:13.273963 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-dc50db52-8a9b-4d37-8d28-d6453b69ccce tempest-DeleteServersTestJSON-126197053 tempest-DeleteServersTestJSON-126197053-project] Calling method '>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:52:13.274555 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-dc50db52-8a9b-4d37-8d28-d6453b69ccce tempest-DeleteServersTestJSON-126197053 tempest-DeleteServersTestJSON-126197053-project] [instance: 2f7df954-edb0-41b8-a3d9-a8a870d487c3] Fetching instance by UUID {{(pid=123458) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:52:13.281330 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-dc50db52-8a9b-4d37-8d28-d6453b69ccce tempest-DeleteServersTestJSON-126197053 tempest-DeleteServersTestJSON-126197053-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:52:13.281765 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-dc50db52-8a9b-4d37-8d28-d6453b69ccce tempest-DeleteServersTestJSON-126197053 tempest-DeleteServersTestJSON-126197053-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:52:13.282637 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-dc50db52-8a9b-4d37-8d28-d6453b69ccce tempest-DeleteServersTestJSON-126197053 tempest-DeleteServersTestJSON-126197053-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:52:13.283075 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-dc50db52-8a9b-4d37-8d28-d6453b69ccce tempest-DeleteServersTestJSON-126197053 tempest-DeleteServersTestJSON-126197053-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:52:13.300440 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-2f630842-ee36-452a-a839-a4d432f0c2dc tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Calling method '>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:52:13.301124 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-2f630842-ee36-452a-a839-a4d432f0c2dc tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] [instance: 406b5ad6-698e-457f-93f4-cdfd45fb3e8e] Fetching instance by UUID {{(pid=123459) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:52:13.307004 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-2f630842-ee36-452a-a839-a4d432f0c2dc tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:52:13.307453 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-2f630842-ee36-452a-a839-a4d432f0c2dc tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:52:13.309257 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-2f630842-ee36-452a-a839-a4d432f0c2dc tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:52:13.309701 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-2f630842-ee36-452a-a839-a4d432f0c2dc tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:52:13.437855 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-dc50db52-8a9b-4d37-8d28-d6453b69ccce tempest-DeleteServersTestJSON-126197053 tempest-DeleteServersTestJSON-126197053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8aa040fad7754a4ba5752413fcfde807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b69a8d69ede453aa373fca0a65bdedd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:52:13.447329 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-dc50db52-8a9b-4d37-8d28-d6453b69ccce tempest-DeleteServersTestJSON-126197053 tempest-DeleteServersTestJSON-126197053-project] 10.222.0.31 "GET /compute/v2.1/servers/2f7df954-edb0-41b8-a3d9-a8a870d487c3" status: 200 len: 1315 microversion: 2.1 time: 0.177067 Apr 29 08:52:13.448217 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 86/162] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 08:52:13 2022] GET /compute/v2.1/servers/2f7df954-edb0-41b8-a3d9-a8a870d487c3 => generated 1315 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 08:52:13.460317 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-2f630842-ee36-452a-a839-a4d432f0c2dc tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:52:13.480857 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-848d8ebb-9a13-4e13-9e44-0010d050be33 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Calling method '>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:52:13.481539 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-2f630842-ee36-452a-a839-a4d432f0c2dc tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:52:13.482440 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-848d8ebb-9a13-4e13-9e44-0010d050be33 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] [instance: 0f9c17b6-b1a2-4ec6-ba8c-2097a8c8ccb7] Fetching instance by UUID {{(pid=123458) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:52:13.485959 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-2f630842-ee36-452a-a839-a4d432f0c2dc tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:52:13.492628 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-2f630842-ee36-452a-a839-a4d432f0c2dc tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] 10.222.0.31 "GET /compute/v2.1/servers/406b5ad6-698e-457f-93f4-cdfd45fb3e8e" status: 200 len: 1408 microversion: 2.20 time: 0.195696 Apr 29 08:52:13.496699 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 77/163] 10.222.0.31 () {60 vars in 1276 bytes} [Fri Apr 29 08:52:13 2022] GET /compute/v2.1/servers/406b5ad6-698e-457f-93f4-cdfd45fb3e8e => generated 1408 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 29 08:52:13.498607 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-848d8ebb-9a13-4e13-9e44-0010d050be33 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:52:13.499504 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-848d8ebb-9a13-4e13-9e44-0010d050be33 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:52:13.500553 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-848d8ebb-9a13-4e13-9e44-0010d050be33 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:52:13.501191 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-848d8ebb-9a13-4e13-9e44-0010d050be33 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:52:13.722799 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-848d8ebb-9a13-4e13-9e44-0010d050be33 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e47ecdfb01f447699275b13255c15d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578e6a35974d4e5c8a0cd4e5fa994259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:52:13.732662 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-848d8ebb-9a13-4e13-9e44-0010d050be33 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] 10.222.0.31 "GET /compute/v2.1/servers/0f9c17b6-b1a2-4ec6-ba8c-2097a8c8ccb7" status: 200 len: 1368 microversion: 2.1 time: 0.279069 Apr 29 08:52:13.733385 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 87/164] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 08:52:13 2022] GET /compute/v2.1/servers/0f9c17b6-b1a2-4ec6-ba8c-2097a8c8ccb7 => generated 1368 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 08:52:14.465638 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-79b742cb-2d60-4f91-9c36-05426601f819 tempest-DeleteServersTestJSON-126197053 tempest-DeleteServersTestJSON-126197053-project] Calling method '>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:52:14.466243 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-79b742cb-2d60-4f91-9c36-05426601f819 tempest-DeleteServersTestJSON-126197053 tempest-DeleteServersTestJSON-126197053-project] [instance: 2f7df954-edb0-41b8-a3d9-a8a870d487c3] Fetching instance by UUID {{(pid=123459) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:52:14.473336 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-79b742cb-2d60-4f91-9c36-05426601f819 tempest-DeleteServersTestJSON-126197053 tempest-DeleteServersTestJSON-126197053-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:52:14.473336 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-79b742cb-2d60-4f91-9c36-05426601f819 tempest-DeleteServersTestJSON-126197053 tempest-DeleteServersTestJSON-126197053-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:52:14.473662 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-79b742cb-2d60-4f91-9c36-05426601f819 tempest-DeleteServersTestJSON-126197053 tempest-DeleteServersTestJSON-126197053-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:52:14.474339 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-79b742cb-2d60-4f91-9c36-05426601f819 tempest-DeleteServersTestJSON-126197053 tempest-DeleteServersTestJSON-126197053-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:52:14.514635 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-5a77bcd7-fc0d-4dd4-8410-bf227703d1ce tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Calling method '>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:52:14.515845 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-5a77bcd7-fc0d-4dd4-8410-bf227703d1ce tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] [instance: 406b5ad6-698e-457f-93f4-cdfd45fb3e8e] Fetching instance by UUID {{(pid=123458) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:52:14.522256 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-5a77bcd7-fc0d-4dd4-8410-bf227703d1ce tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:52:14.522782 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-5a77bcd7-fc0d-4dd4-8410-bf227703d1ce tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:52:14.523748 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-5a77bcd7-fc0d-4dd4-8410-bf227703d1ce tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:52:14.524364 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-5a77bcd7-fc0d-4dd4-8410-bf227703d1ce tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:52:14.645658 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-79b742cb-2d60-4f91-9c36-05426601f819 tempest-DeleteServersTestJSON-126197053 tempest-DeleteServersTestJSON-126197053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8aa040fad7754a4ba5752413fcfde807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b69a8d69ede453aa373fca0a65bdedd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:52:14.655154 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-79b742cb-2d60-4f91-9c36-05426601f819 tempest-DeleteServersTestJSON-126197053 tempest-DeleteServersTestJSON-126197053-project] 10.222.0.31 "GET /compute/v2.1/servers/2f7df954-edb0-41b8-a3d9-a8a870d487c3" status: 200 len: 1315 microversion: 2.1 time: 0.194139 Apr 29 08:52:14.655675 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 78/165] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 08:52:14 2022] GET /compute/v2.1/servers/2f7df954-edb0-41b8-a3d9-a8a870d487c3 => generated 1315 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 08:52:14.709851 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-5a77bcd7-fc0d-4dd4-8410-bf227703d1ce tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:52:14.720249 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-5a77bcd7-fc0d-4dd4-8410-bf227703d1ce tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:52:14.722128 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-5a77bcd7-fc0d-4dd4-8410-bf227703d1ce tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:52:14.723253 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-5a77bcd7-fc0d-4dd4-8410-bf227703d1ce tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] 10.222.0.31 "GET /compute/v2.1/servers/406b5ad6-698e-457f-93f4-cdfd45fb3e8e" status: 200 len: 1408 microversion: 2.20 time: 0.213140 Apr 29 08:52:14.723789 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 88/166] 10.222.0.31 () {60 vars in 1276 bytes} [Fri Apr 29 08:52:14 2022] GET /compute/v2.1/servers/406b5ad6-698e-457f-93f4-cdfd45fb3e8e => generated 1408 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 29 08:52:14.752261 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-8e750b95-f57d-4d5e-bdfb-4c69a62c1673 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Calling method '>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:52:14.753236 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-8e750b95-f57d-4d5e-bdfb-4c69a62c1673 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] [instance: 0f9c17b6-b1a2-4ec6-ba8c-2097a8c8ccb7] Fetching instance by UUID {{(pid=123459) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:52:14.759486 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-8e750b95-f57d-4d5e-bdfb-4c69a62c1673 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:52:14.760168 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-8e750b95-f57d-4d5e-bdfb-4c69a62c1673 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:52:14.761731 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-8e750b95-f57d-4d5e-bdfb-4c69a62c1673 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:52:14.762314 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-8e750b95-f57d-4d5e-bdfb-4c69a62c1673 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:52:14.913123 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-8e750b95-f57d-4d5e-bdfb-4c69a62c1673 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e47ecdfb01f447699275b13255c15d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578e6a35974d4e5c8a0cd4e5fa994259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:52:14.926031 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-8e750b95-f57d-4d5e-bdfb-4c69a62c1673 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] 10.222.0.31 "GET /compute/v2.1/servers/0f9c17b6-b1a2-4ec6-ba8c-2097a8c8ccb7" status: 200 len: 1368 microversion: 2.1 time: 0.179356 Apr 29 08:52:14.936060 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 79/167] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 08:52:14 2022] GET /compute/v2.1/servers/0f9c17b6-b1a2-4ec6-ba8c-2097a8c8ccb7 => generated 1368 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 08:52:15.481847 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [req-528bc242-b798-4c8f-b281-5fed21741fef req-6c489f9f-c5c4-43c8-b8ac-10e7907e8f44 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "406b5ad6-698e-457f-93f4-cdfd45fb3e8e", "name": "network-vif-plugged", "status": "completed", "tag": "afdeb60c-c7b1-441b-90f4-293273965fad"}]} {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 29 08:52:15.496493 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [req-528bc242-b798-4c8f-b281-5fed21741fef req-6c489f9f-c5c4-43c8-b8ac-10e7907e8f44 service nova] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:52:15.498060 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [req-528bc242-b798-4c8f-b281-5fed21741fef req-6c489f9f-c5c4-43c8-b8ac-10e7907e8f44 service nova] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:52:15.514133 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.compute.server_external_events [req-528bc242-b798-4c8f-b281-5fed21741fef req-6c489f9f-c5c4-43c8-b8ac-10e7907e8f44 service nova] Creating event network-vif-plugged:afdeb60c-c7b1-441b-90f4-293273965fad for instance 406b5ad6-698e-457f-93f4-cdfd45fb3e8e on hv-cinder-83987 Apr 29 08:52:15.519585 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [req-528bc242-b798-4c8f-b281-5fed21741fef req-6c489f9f-c5c4-43c8-b8ac-10e7907e8f44 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046434 Apr 29 08:52:15.521055 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 89/168] 10.222.0.31 () {64 vars in 1317 bytes} [Fri Apr 29 08:52:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 29 08:52:15.676273 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-9f0ccb9a-b52a-479f-8299-78825be10e99 tempest-DeleteServersTestJSON-126197053 tempest-DeleteServersTestJSON-126197053-project] Calling method '>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:52:15.677777 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-9f0ccb9a-b52a-479f-8299-78825be10e99 tempest-DeleteServersTestJSON-126197053 tempest-DeleteServersTestJSON-126197053-project] [instance: 2f7df954-edb0-41b8-a3d9-a8a870d487c3] Fetching instance by UUID {{(pid=123459) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:52:15.686042 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-9f0ccb9a-b52a-479f-8299-78825be10e99 tempest-DeleteServersTestJSON-126197053 tempest-DeleteServersTestJSON-126197053-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:52:15.687519 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-9f0ccb9a-b52a-479f-8299-78825be10e99 tempest-DeleteServersTestJSON-126197053 tempest-DeleteServersTestJSON-126197053-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:52:15.688933 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-9f0ccb9a-b52a-479f-8299-78825be10e99 tempest-DeleteServersTestJSON-126197053 tempest-DeleteServersTestJSON-126197053-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:52:15.689797 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-9f0ccb9a-b52a-479f-8299-78825be10e99 tempest-DeleteServersTestJSON-126197053 tempest-DeleteServersTestJSON-126197053-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:52:15.743538 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-977aec1f-c52f-4466-a6c5-dcdcd925e5a5 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Calling method '>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:52:15.744275 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-977aec1f-c52f-4466-a6c5-dcdcd925e5a5 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] [instance: 406b5ad6-698e-457f-93f4-cdfd45fb3e8e] Fetching instance by UUID {{(pid=123458) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:52:15.763793 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-977aec1f-c52f-4466-a6c5-dcdcd925e5a5 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:52:15.764361 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-977aec1f-c52f-4466-a6c5-dcdcd925e5a5 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:52:15.766211 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-977aec1f-c52f-4466-a6c5-dcdcd925e5a5 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:52:15.766719 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-977aec1f-c52f-4466-a6c5-dcdcd925e5a5 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:52:15.928545 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-9f0ccb9a-b52a-479f-8299-78825be10e99 tempest-DeleteServersTestJSON-126197053 tempest-DeleteServersTestJSON-126197053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8aa040fad7754a4ba5752413fcfde807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b69a8d69ede453aa373fca0a65bdedd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:52:15.938319 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-9f0ccb9a-b52a-479f-8299-78825be10e99 tempest-DeleteServersTestJSON-126197053 tempest-DeleteServersTestJSON-126197053-project] 10.222.0.31 "GET /compute/v2.1/servers/2f7df954-edb0-41b8-a3d9-a8a870d487c3" status: 200 len: 1315 microversion: 2.1 time: 0.270309 Apr 29 08:52:15.942135 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 80/169] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 08:52:15 2022] GET /compute/v2.1/servers/2f7df954-edb0-41b8-a3d9-a8a870d487c3 => generated 1315 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 08:52:15.954475 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-614848ce-680e-4ff4-9f59-85397662332f tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Calling method '>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:52:15.955300 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-614848ce-680e-4ff4-9f59-85397662332f tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] [instance: 0f9c17b6-b1a2-4ec6-ba8c-2097a8c8ccb7] Fetching instance by UUID {{(pid=123459) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:52:15.969064 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-614848ce-680e-4ff4-9f59-85397662332f tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:52:15.970435 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-614848ce-680e-4ff4-9f59-85397662332f tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:52:15.971342 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-614848ce-680e-4ff4-9f59-85397662332f tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:52:15.972860 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-614848ce-680e-4ff4-9f59-85397662332f tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:52:15.995642 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-977aec1f-c52f-4466-a6c5-dcdcd925e5a5 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:52:16.007933 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-977aec1f-c52f-4466-a6c5-dcdcd925e5a5 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:52:16.010105 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-977aec1f-c52f-4466-a6c5-dcdcd925e5a5 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:52:16.011669 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-977aec1f-c52f-4466-a6c5-dcdcd925e5a5 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] 10.222.0.31 "GET /compute/v2.1/servers/406b5ad6-698e-457f-93f4-cdfd45fb3e8e" status: 200 len: 1408 microversion: 2.20 time: 0.273155 Apr 29 08:52:16.012826 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 90/170] 10.222.0.31 () {60 vars in 1276 bytes} [Fri Apr 29 08:52:15 2022] GET /compute/v2.1/servers/406b5ad6-698e-457f-93f4-cdfd45fb3e8e => generated 1408 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 29 08:52:16.202675 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-614848ce-680e-4ff4-9f59-85397662332f tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e47ecdfb01f447699275b13255c15d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578e6a35974d4e5c8a0cd4e5fa994259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:52:16.204062 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-614848ce-680e-4ff4-9f59-85397662332f tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] 10.222.0.31 "GET /compute/v2.1/servers/0f9c17b6-b1a2-4ec6-ba8c-2097a8c8ccb7" status: 200 len: 1368 microversion: 2.1 time: 0.260497 Apr 29 08:52:16.204815 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 81/171] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 08:52:15 2022] GET /compute/v2.1/servers/0f9c17b6-b1a2-4ec6-ba8c-2097a8c8ccb7 => generated 1368 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 08:52:16.958354 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-930458f9-9a65-456a-9743-226e5111078d tempest-DeleteServersTestJSON-126197053 tempest-DeleteServersTestJSON-126197053-project] Calling method '>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:52:16.959009 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-930458f9-9a65-456a-9743-226e5111078d tempest-DeleteServersTestJSON-126197053 tempest-DeleteServersTestJSON-126197053-project] [instance: 2f7df954-edb0-41b8-a3d9-a8a870d487c3] Fetching instance by UUID {{(pid=123458) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:52:16.965961 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-930458f9-9a65-456a-9743-226e5111078d tempest-DeleteServersTestJSON-126197053 tempest-DeleteServersTestJSON-126197053-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:52:16.966549 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-930458f9-9a65-456a-9743-226e5111078d tempest-DeleteServersTestJSON-126197053 tempest-DeleteServersTestJSON-126197053-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:52:16.967439 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-930458f9-9a65-456a-9743-226e5111078d tempest-DeleteServersTestJSON-126197053 tempest-DeleteServersTestJSON-126197053-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:52:16.967983 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-930458f9-9a65-456a-9743-226e5111078d tempest-DeleteServersTestJSON-126197053 tempest-DeleteServersTestJSON-126197053-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:52:17.032785 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-d0c7624e-78d5-4122-80a4-3474acee6b60 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Calling method '>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:52:17.035010 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-d0c7624e-78d5-4122-80a4-3474acee6b60 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] [instance: 406b5ad6-698e-457f-93f4-cdfd45fb3e8e] Fetching instance by UUID {{(pid=123459) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:52:17.049069 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-d0c7624e-78d5-4122-80a4-3474acee6b60 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:52:17.049069 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-d0c7624e-78d5-4122-80a4-3474acee6b60 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:52:17.049069 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-d0c7624e-78d5-4122-80a4-3474acee6b60 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:52:17.049069 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-d0c7624e-78d5-4122-80a4-3474acee6b60 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:52:17.214206 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-d0c7624e-78d5-4122-80a4-3474acee6b60 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:52:17.226502 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-d0c7624e-78d5-4122-80a4-3474acee6b60 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:52:17.228241 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-d0c7624e-78d5-4122-80a4-3474acee6b60 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:52:17.230013 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-d0c7624e-78d5-4122-80a4-3474acee6b60 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] 10.222.0.31 "GET /compute/v2.1/servers/406b5ad6-698e-457f-93f4-cdfd45fb3e8e" status: 200 len: 1408 microversion: 2.20 time: 0.203419 Apr 29 08:52:17.230916 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 82/172] 10.222.0.31 () {60 vars in 1276 bytes} [Fri Apr 29 08:52:17 2022] GET /compute/v2.1/servers/406b5ad6-698e-457f-93f4-cdfd45fb3e8e => generated 1408 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 29 08:52:17.238351 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-de4ca19b-f3ab-4d40-956f-f1a2bbc84f54 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Calling method '>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:52:17.238945 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-de4ca19b-f3ab-4d40-956f-f1a2bbc84f54 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] [instance: 0f9c17b6-b1a2-4ec6-ba8c-2097a8c8ccb7] Fetching instance by UUID {{(pid=123459) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:52:17.247708 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-de4ca19b-f3ab-4d40-956f-f1a2bbc84f54 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:52:17.248578 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-de4ca19b-f3ab-4d40-956f-f1a2bbc84f54 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:52:17.249623 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-de4ca19b-f3ab-4d40-956f-f1a2bbc84f54 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:52:17.250256 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-de4ca19b-f3ab-4d40-956f-f1a2bbc84f54 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:52:17.329155 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-930458f9-9a65-456a-9743-226e5111078d tempest-DeleteServersTestJSON-126197053 tempest-DeleteServersTestJSON-126197053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8aa040fad7754a4ba5752413fcfde807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b69a8d69ede453aa373fca0a65bdedd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:52:17.338412 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-930458f9-9a65-456a-9743-226e5111078d tempest-DeleteServersTestJSON-126197053 tempest-DeleteServersTestJSON-126197053-project] 10.222.0.31 "GET /compute/v2.1/servers/2f7df954-edb0-41b8-a3d9-a8a870d487c3" status: 200 len: 1502 microversion: 2.1 time: 0.383845 Apr 29 08:52:17.339140 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 91/173] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 08:52:16 2022] GET /compute/v2.1/servers/2f7df954-edb0-41b8-a3d9-a8a870d487c3 => generated 1502 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 08:52:17.402033 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-de4ca19b-f3ab-4d40-956f-f1a2bbc84f54 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e47ecdfb01f447699275b13255c15d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578e6a35974d4e5c8a0cd4e5fa994259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:52:17.409753 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-de4ca19b-f3ab-4d40-956f-f1a2bbc84f54 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] 10.222.0.31 "GET /compute/v2.1/servers/0f9c17b6-b1a2-4ec6-ba8c-2097a8c8ccb7" status: 200 len: 1368 microversion: 2.1 time: 0.177711 Apr 29 08:52:17.410326 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 83/174] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 08:52:17 2022] GET /compute/v2.1/servers/0f9c17b6-b1a2-4ec6-ba8c-2097a8c8ccb7 => generated 1368 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 08:52:18.249598 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-ad1b16a4-dcfc-4a4f-9a4a-70f4f490ce26 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Calling method '>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:52:18.250227 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-ad1b16a4-dcfc-4a4f-9a4a-70f4f490ce26 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] [instance: 406b5ad6-698e-457f-93f4-cdfd45fb3e8e] Fetching instance by UUID {{(pid=123458) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:52:18.256316 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-ad1b16a4-dcfc-4a4f-9a4a-70f4f490ce26 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:52:18.256771 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-ad1b16a4-dcfc-4a4f-9a4a-70f4f490ce26 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:52:18.257538 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-ad1b16a4-dcfc-4a4f-9a4a-70f4f490ce26 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:52:18.257973 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-ad1b16a4-dcfc-4a4f-9a4a-70f4f490ce26 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:52:18.386682 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-ad1b16a4-dcfc-4a4f-9a4a-70f4f490ce26 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:52:18.394335 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-ad1b16a4-dcfc-4a4f-9a4a-70f4f490ce26 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:52:18.395857 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-ad1b16a4-dcfc-4a4f-9a4a-70f4f490ce26 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:52:18.396972 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-ad1b16a4-dcfc-4a4f-9a4a-70f4f490ce26 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] 10.222.0.31 "GET /compute/v2.1/servers/406b5ad6-698e-457f-93f4-cdfd45fb3e8e" status: 200 len: 1408 microversion: 2.20 time: 0.151598 Apr 29 08:52:18.397524 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 92/175] 10.222.0.31 () {60 vars in 1276 bytes} [Fri Apr 29 08:52:18 2022] GET /compute/v2.1/servers/406b5ad6-698e-457f-93f4-cdfd45fb3e8e => generated 1408 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 29 08:52:18.426653 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-bea72653-f2a8-400b-a945-c6235c1e728c tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Calling method '>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:52:18.427265 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-bea72653-f2a8-400b-a945-c6235c1e728c tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] [instance: 0f9c17b6-b1a2-4ec6-ba8c-2097a8c8ccb7] Fetching instance by UUID {{(pid=123459) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:52:18.433706 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-bea72653-f2a8-400b-a945-c6235c1e728c tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:52:18.434156 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-bea72653-f2a8-400b-a945-c6235c1e728c tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:52:18.434924 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-bea72653-f2a8-400b-a945-c6235c1e728c tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:52:18.435361 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-bea72653-f2a8-400b-a945-c6235c1e728c tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:52:18.566160 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-bea72653-f2a8-400b-a945-c6235c1e728c tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e47ecdfb01f447699275b13255c15d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578e6a35974d4e5c8a0cd4e5fa994259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:52:18.574059 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-bea72653-f2a8-400b-a945-c6235c1e728c tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] 10.222.0.31 "GET /compute/v2.1/servers/0f9c17b6-b1a2-4ec6-ba8c-2097a8c8ccb7" status: 200 len: 1368 microversion: 2.1 time: 0.150514 Apr 29 08:52:18.575152 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 84/176] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 08:52:18 2022] GET /compute/v2.1/servers/0f9c17b6-b1a2-4ec6-ba8c-2097a8c8ccb7 => generated 1368 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 08:52:19.416509 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-21076ce0-e534-4197-bcc5-a0e9f9d8596c tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Calling method '>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:52:19.417693 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-21076ce0-e534-4197-bcc5-a0e9f9d8596c tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] [instance: 406b5ad6-698e-457f-93f4-cdfd45fb3e8e] Fetching instance by UUID {{(pid=123458) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:52:19.425814 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-21076ce0-e534-4197-bcc5-a0e9f9d8596c tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:52:19.426267 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-21076ce0-e534-4197-bcc5-a0e9f9d8596c tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:52:19.427261 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-21076ce0-e534-4197-bcc5-a0e9f9d8596c tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:52:19.427703 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-21076ce0-e534-4197-bcc5-a0e9f9d8596c tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:52:19.577331 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-21076ce0-e534-4197-bcc5-a0e9f9d8596c tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:52:19.587021 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-21076ce0-e534-4197-bcc5-a0e9f9d8596c tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:52:19.588456 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-21076ce0-e534-4197-bcc5-a0e9f9d8596c tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:52:19.589691 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-21076ce0-e534-4197-bcc5-a0e9f9d8596c tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] 10.222.0.31 "GET /compute/v2.1/servers/406b5ad6-698e-457f-93f4-cdfd45fb3e8e" status: 200 len: 1408 microversion: 2.20 time: 0.177214 Apr 29 08:52:19.590248 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 93/177] 10.222.0.31 () {60 vars in 1276 bytes} [Fri Apr 29 08:52:19 2022] GET /compute/v2.1/servers/406b5ad6-698e-457f-93f4-cdfd45fb3e8e => generated 1408 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 29 08:52:19.600083 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-6642680e-e295-4cc6-916c-8142ad378793 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Calling method '>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:52:19.600847 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-6642680e-e295-4cc6-916c-8142ad378793 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] [instance: 0f9c17b6-b1a2-4ec6-ba8c-2097a8c8ccb7] Fetching instance by UUID {{(pid=123459) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:52:19.608763 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-6642680e-e295-4cc6-916c-8142ad378793 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:52:19.609216 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-6642680e-e295-4cc6-916c-8142ad378793 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:52:19.610031 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-6642680e-e295-4cc6-916c-8142ad378793 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:52:19.610467 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-6642680e-e295-4cc6-916c-8142ad378793 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:52:19.753911 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-6642680e-e295-4cc6-916c-8142ad378793 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e47ecdfb01f447699275b13255c15d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578e6a35974d4e5c8a0cd4e5fa994259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:52:19.762993 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-6642680e-e295-4cc6-916c-8142ad378793 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] 10.222.0.31 "GET /compute/v2.1/servers/0f9c17b6-b1a2-4ec6-ba8c-2097a8c8ccb7" status: 200 len: 1368 microversion: 2.1 time: 0.175260 Apr 29 08:52:19.769353 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 85/178] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 08:52:19 2022] GET /compute/v2.1/servers/0f9c17b6-b1a2-4ec6-ba8c-2097a8c8ccb7 => generated 1368 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 08:52:20.607794 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-760c7ec9-ec2a-48a2-af41-a803cfbe29ef tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Calling method '>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:52:20.608580 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-760c7ec9-ec2a-48a2-af41-a803cfbe29ef tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] [instance: 406b5ad6-698e-457f-93f4-cdfd45fb3e8e] Fetching instance by UUID {{(pid=123458) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:52:20.614500 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-760c7ec9-ec2a-48a2-af41-a803cfbe29ef tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:52:20.614947 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-760c7ec9-ec2a-48a2-af41-a803cfbe29ef tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:52:20.615711 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-760c7ec9-ec2a-48a2-af41-a803cfbe29ef tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:52:20.616151 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-760c7ec9-ec2a-48a2-af41-a803cfbe29ef tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:52:20.757228 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-760c7ec9-ec2a-48a2-af41-a803cfbe29ef tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:52:20.768015 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-760c7ec9-ec2a-48a2-af41-a803cfbe29ef tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:52:20.769649 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-760c7ec9-ec2a-48a2-af41-a803cfbe29ef tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:52:20.771506 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-760c7ec9-ec2a-48a2-af41-a803cfbe29ef tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] 10.222.0.31 "GET /compute/v2.1/servers/406b5ad6-698e-457f-93f4-cdfd45fb3e8e" status: 200 len: 1408 microversion: 2.20 time: 0.167723 Apr 29 08:52:20.772410 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 94/179] 10.222.0.31 () {60 vars in 1276 bytes} [Fri Apr 29 08:52:20 2022] GET /compute/v2.1/servers/406b5ad6-698e-457f-93f4-cdfd45fb3e8e => generated 1408 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 29 08:52:20.779472 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-46074e11-5944-4162-b06d-174711f2d18e tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Calling method '>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:52:20.780108 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-46074e11-5944-4162-b06d-174711f2d18e tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] [instance: 0f9c17b6-b1a2-4ec6-ba8c-2097a8c8ccb7] Fetching instance by UUID {{(pid=123459) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:52:20.788476 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-46074e11-5944-4162-b06d-174711f2d18e tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:52:20.788927 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-46074e11-5944-4162-b06d-174711f2d18e tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:52:20.789712 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-46074e11-5944-4162-b06d-174711f2d18e tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:52:20.790146 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-46074e11-5944-4162-b06d-174711f2d18e tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:52:20.954766 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-46074e11-5944-4162-b06d-174711f2d18e tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e47ecdfb01f447699275b13255c15d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578e6a35974d4e5c8a0cd4e5fa994259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:52:20.962393 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-46074e11-5944-4162-b06d-174711f2d18e tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] 10.222.0.31 "GET /compute/v2.1/servers/0f9c17b6-b1a2-4ec6-ba8c-2097a8c8ccb7" status: 200 len: 1368 microversion: 2.1 time: 0.186753 Apr 29 08:52:20.962965 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 86/180] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 08:52:20 2022] GET /compute/v2.1/servers/0f9c17b6-b1a2-4ec6-ba8c-2097a8c8ccb7 => generated 1368 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 08:52:21.790398 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-2a979433-a423-47c4-a6ae-7a4f775e1171 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Calling method '>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:52:21.791011 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-2a979433-a423-47c4-a6ae-7a4f775e1171 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] [instance: 406b5ad6-698e-457f-93f4-cdfd45fb3e8e] Fetching instance by UUID {{(pid=123458) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:52:21.797458 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-2a979433-a423-47c4-a6ae-7a4f775e1171 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:52:21.797912 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-2a979433-a423-47c4-a6ae-7a4f775e1171 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:52:21.798727 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-2a979433-a423-47c4-a6ae-7a4f775e1171 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:52:21.799169 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-2a979433-a423-47c4-a6ae-7a4f775e1171 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:52:21.931508 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-2a979433-a423-47c4-a6ae-7a4f775e1171 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:52:21.946278 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-2a979433-a423-47c4-a6ae-7a4f775e1171 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:52:21.947846 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-2a979433-a423-47c4-a6ae-7a4f775e1171 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:52:21.949011 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-2a979433-a423-47c4-a6ae-7a4f775e1171 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] 10.222.0.31 "GET /compute/v2.1/servers/406b5ad6-698e-457f-93f4-cdfd45fb3e8e" status: 200 len: 1408 microversion: 2.20 time: 0.162593 Apr 29 08:52:21.949588 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 95/181] 10.222.0.31 () {60 vars in 1276 bytes} [Fri Apr 29 08:52:21 2022] GET /compute/v2.1/servers/406b5ad6-698e-457f-93f4-cdfd45fb3e8e => generated 1408 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 29 08:52:21.978652 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-20f53c1f-50ec-4654-9803-8af3424d9e6d tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Calling method '>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:52:21.979357 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-20f53c1f-50ec-4654-9803-8af3424d9e6d tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] [instance: 0f9c17b6-b1a2-4ec6-ba8c-2097a8c8ccb7] Fetching instance by UUID {{(pid=123459) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:52:21.986194 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-20f53c1f-50ec-4654-9803-8af3424d9e6d tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:52:21.986888 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-20f53c1f-50ec-4654-9803-8af3424d9e6d tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:52:21.987707 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-20f53c1f-50ec-4654-9803-8af3424d9e6d tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:52:21.988162 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-20f53c1f-50ec-4654-9803-8af3424d9e6d tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:52:22.128820 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-20f53c1f-50ec-4654-9803-8af3424d9e6d tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e47ecdfb01f447699275b13255c15d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578e6a35974d4e5c8a0cd4e5fa994259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:52:22.137460 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-20f53c1f-50ec-4654-9803-8af3424d9e6d tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] 10.222.0.31 "GET /compute/v2.1/servers/0f9c17b6-b1a2-4ec6-ba8c-2097a8c8ccb7" status: 200 len: 1559 microversion: 2.1 time: 0.162075 Apr 29 08:52:22.138386 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 87/182] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 08:52:21 2022] GET /compute/v2.1/servers/0f9c17b6-b1a2-4ec6-ba8c-2097a8c8ccb7 => generated 1559 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 08:52:22.155432 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-4a81a06e-fb68-4c99-ad66-39bc622a3482 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Calling method '>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:52:22.155934 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-4a81a06e-fb68-4c99-ad66-39bc622a3482 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] [instance: 0f9c17b6-b1a2-4ec6-ba8c-2097a8c8ccb7] Fetching instance by UUID {{(pid=123458) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:52:22.162738 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-4a81a06e-fb68-4c99-ad66-39bc622a3482 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:52:22.163221 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-4a81a06e-fb68-4c99-ad66-39bc622a3482 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:52:22.163971 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-4a81a06e-fb68-4c99-ad66-39bc622a3482 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:52:22.164436 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-4a81a06e-fb68-4c99-ad66-39bc622a3482 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:52:22.297849 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-4a81a06e-fb68-4c99-ad66-39bc622a3482 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] 10.222.0.31 "GET /compute/v2.1/servers/0f9c17b6-b1a2-4ec6-ba8c-2097a8c8ccb7/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.146789 Apr 29 08:52:22.298517 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 96/183] 10.222.0.31 () {58 vars in 1274 bytes} [Fri Apr 29 08:52:22 2022] GET /compute/v2.1/servers/0f9c17b6-b1a2-4ec6-ba8c-2097a8c8ccb7/os-interface => generated 285 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 29 08:52:22.937035 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-13a16b33-a22a-4259-90aa-cbada4bbd9a9 tempest-DeleteServersTestJSON-126197053 tempest-DeleteServersTestJSON-126197053-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "03b682f9-60de-4aa9-b334-8d0bf88cd3a2"}} {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 29 08:52:22.938531 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-13a16b33-a22a-4259-90aa-cbada4bbd9a9 tempest-DeleteServersTestJSON-126197053 tempest-DeleteServersTestJSON-126197053-project] [instance: 2f7df954-edb0-41b8-a3d9-a8a870d487c3] Fetching instance by UUID {{(pid=123459) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:52:22.944654 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-13a16b33-a22a-4259-90aa-cbada4bbd9a9 tempest-DeleteServersTestJSON-126197053 tempest-DeleteServersTestJSON-126197053-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:52:22.945286 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-13a16b33-a22a-4259-90aa-cbada4bbd9a9 tempest-DeleteServersTestJSON-126197053 tempest-DeleteServersTestJSON-126197053-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:52:22.946213 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-13a16b33-a22a-4259-90aa-cbada4bbd9a9 tempest-DeleteServersTestJSON-126197053 tempest-DeleteServersTestJSON-126197053-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:52:22.946811 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-13a16b33-a22a-4259-90aa-cbada4bbd9a9 tempest-DeleteServersTestJSON-126197053 tempest-DeleteServersTestJSON-126197053-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:52:22.972169 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-7379890d-777b-4fb4-8423-377f54d1c4c9 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Calling method '>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:52:22.973714 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-7379890d-777b-4fb4-8423-377f54d1c4c9 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] [instance: 406b5ad6-698e-457f-93f4-cdfd45fb3e8e] Fetching instance by UUID {{(pid=123458) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:52:22.982687 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-7379890d-777b-4fb4-8423-377f54d1c4c9 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:52:22.983605 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-7379890d-777b-4fb4-8423-377f54d1c4c9 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:52:22.984631 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-7379890d-777b-4fb4-8423-377f54d1c4c9 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:52:22.985291 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-7379890d-777b-4fb4-8423-377f54d1c4c9 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:52:23.221675 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-7379890d-777b-4fb4-8423-377f54d1c4c9 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:52:23.230306 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-7379890d-777b-4fb4-8423-377f54d1c4c9 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:52:23.231799 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-7379890d-777b-4fb4-8423-377f54d1c4c9 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:52:23.232987 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-7379890d-777b-4fb4-8423-377f54d1c4c9 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] 10.222.0.31 "GET /compute/v2.1/servers/406b5ad6-698e-457f-93f4-cdfd45fb3e8e" status: 200 len: 1408 microversion: 2.20 time: 0.268105 Apr 29 08:52:23.233482 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 97/184] 10.222.0.31 () {60 vars in 1276 bytes} [Fri Apr 29 08:52:22 2022] GET /compute/v2.1/servers/406b5ad6-698e-457f-93f4-cdfd45fb3e8e => generated 1408 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 29 08:52:23.628234 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [req-86446039-512a-423a-b02f-feee54c139e2 req-d4763123-3134-4789-b65e-c512c3deb8d8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0f9c17b6-b1a2-4ec6-ba8c-2097a8c8ccb7", "tag": "3b21bf13-34c3-4eab-b46e-1fddbe0106a8"}]} {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 29 08:52:23.639125 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [req-86446039-512a-423a-b02f-feee54c139e2 req-d4763123-3134-4789-b65e-c512c3deb8d8 service nova] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:52:23.639556 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [req-86446039-512a-423a-b02f-feee54c139e2 req-d4763123-3134-4789-b65e-c512c3deb8d8 service nova] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:52:23.652835 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.compute.server_external_events [req-86446039-512a-423a-b02f-feee54c139e2 req-d4763123-3134-4789-b65e-c512c3deb8d8 service nova] Creating event network-changed:3b21bf13-34c3-4eab-b46e-1fddbe0106a8 for instance 0f9c17b6-b1a2-4ec6-ba8c-2097a8c8ccb7 on hv-cinder-83987 Apr 29 08:52:23.659461 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [req-86446039-512a-423a-b02f-feee54c139e2 req-d4763123-3134-4789-b65e-c512c3deb8d8 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034299 Apr 29 08:52:23.660284 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 98/185] 10.222.0.31 () {64 vars in 1317 bytes} [Fri Apr 29 08:52:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 29 08:52:24.056204 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-13a16b33-a22a-4259-90aa-cbada4bbd9a9 tempest-DeleteServersTestJSON-126197053 tempest-DeleteServersTestJSON-126197053-project] 10.222.0.31 "POST /compute/v2.1/servers/2f7df954-edb0-41b8-a3d9-a8a870d487c3/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.138904 Apr 29 08:52:24.056998 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 88/186] 10.222.0.31 () {60 vars in 1322 bytes} [Fri Apr 29 08:52:22 2022] POST /compute/v2.1/servers/2f7df954-edb0-41b8-a3d9-a8a870d487c3/os-volume_attachments => generated 194 bytes in 1141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 29 08:52:24.252658 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-4bc065af-f2e5-4a87-92d2-9aa6da2aba94 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Calling method '>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:52:24.253403 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-4bc065af-f2e5-4a87-92d2-9aa6da2aba94 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] [instance: 406b5ad6-698e-457f-93f4-cdfd45fb3e8e] Fetching instance by UUID {{(pid=123458) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:52:24.260306 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-4bc065af-f2e5-4a87-92d2-9aa6da2aba94 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:52:24.262465 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-4bc065af-f2e5-4a87-92d2-9aa6da2aba94 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:52:24.263719 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-4bc065af-f2e5-4a87-92d2-9aa6da2aba94 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:52:24.264362 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-4bc065af-f2e5-4a87-92d2-9aa6da2aba94 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:52:24.437390 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-4bc065af-f2e5-4a87-92d2-9aa6da2aba94 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:52:24.445625 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-4bc065af-f2e5-4a87-92d2-9aa6da2aba94 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:52:24.447340 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-4bc065af-f2e5-4a87-92d2-9aa6da2aba94 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:52:24.449682 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-4bc065af-f2e5-4a87-92d2-9aa6da2aba94 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] 10.222.0.31 "GET /compute/v2.1/servers/406b5ad6-698e-457f-93f4-cdfd45fb3e8e" status: 200 len: 1408 microversion: 2.20 time: 0.201124 Apr 29 08:52:24.450305 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 99/187] 10.222.0.31 () {60 vars in 1276 bytes} [Fri Apr 29 08:52:24 2022] GET /compute/v2.1/servers/406b5ad6-698e-457f-93f4-cdfd45fb3e8e => generated 1408 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 29 08:52:25.468568 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-85f04d46-e5ab-4992-a35d-7714ccc40ba7 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Calling method '>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:52:25.469261 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-85f04d46-e5ab-4992-a35d-7714ccc40ba7 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] [instance: 406b5ad6-698e-457f-93f4-cdfd45fb3e8e] Fetching instance by UUID {{(pid=123459) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:52:25.477904 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-85f04d46-e5ab-4992-a35d-7714ccc40ba7 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:52:25.478352 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-85f04d46-e5ab-4992-a35d-7714ccc40ba7 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:52:25.479118 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-85f04d46-e5ab-4992-a35d-7714ccc40ba7 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:52:25.480267 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-85f04d46-e5ab-4992-a35d-7714ccc40ba7 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:52:25.610879 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-85f04d46-e5ab-4992-a35d-7714ccc40ba7 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:52:25.618974 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-85f04d46-e5ab-4992-a35d-7714ccc40ba7 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:52:25.621491 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-85f04d46-e5ab-4992-a35d-7714ccc40ba7 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:52:25.622661 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-85f04d46-e5ab-4992-a35d-7714ccc40ba7 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] 10.222.0.31 "GET /compute/v2.1/servers/406b5ad6-698e-457f-93f4-cdfd45fb3e8e" status: 200 len: 1601 microversion: 2.20 time: 0.158662 Apr 29 08:52:25.623232 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 89/188] 10.222.0.31 () {60 vars in 1276 bytes} [Fri Apr 29 08:52:25 2022] GET /compute/v2.1/servers/406b5ad6-698e-457f-93f4-cdfd45fb3e8e => generated 1601 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 29 08:52:25.652023 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-12f1ca96-2354-42ca-8b88-3654e850dabc tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Calling method '>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:52:25.652612 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-12f1ca96-2354-42ca-8b88-3654e850dabc tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] [instance: 406b5ad6-698e-457f-93f4-cdfd45fb3e8e] Fetching instance by UUID {{(pid=123458) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:52:25.658737 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-12f1ca96-2354-42ca-8b88-3654e850dabc tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:52:25.659191 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-12f1ca96-2354-42ca-8b88-3654e850dabc tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:52:25.659941 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-12f1ca96-2354-42ca-8b88-3654e850dabc tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:52:25.660403 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-12f1ca96-2354-42ca-8b88-3654e850dabc tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:52:25.736952 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-12f1ca96-2354-42ca-8b88-3654e850dabc tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] 10.222.0.31 "GET /compute/v2.1/servers/406b5ad6-698e-457f-93f4-cdfd45fb3e8e/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.099613 Apr 29 08:52:25.737716 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 100/189] 10.222.0.31 () {60 vars in 1315 bytes} [Fri Apr 29 08:52:25 2022] GET /compute/v2.1/servers/406b5ad6-698e-457f-93f4-cdfd45fb3e8e/os-interface => generated 285 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Apr 29 08:52:26.915506 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [req-44c043f7-1dee-445d-ad87-37779d6caa54 req-2ed3a53f-10c4-4c34-848b-1f2f383f18e0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "406b5ad6-698e-457f-93f4-cdfd45fb3e8e", "tag": "afdeb60c-c7b1-441b-90f4-293273965fad"}]} {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 29 08:52:26.930131 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [req-44c043f7-1dee-445d-ad87-37779d6caa54 req-2ed3a53f-10c4-4c34-848b-1f2f383f18e0 service nova] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:52:26.930616 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [req-44c043f7-1dee-445d-ad87-37779d6caa54 req-2ed3a53f-10c4-4c34-848b-1f2f383f18e0 service nova] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:52:26.942932 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.compute.server_external_events [req-44c043f7-1dee-445d-ad87-37779d6caa54 req-2ed3a53f-10c4-4c34-848b-1f2f383f18e0 service nova] Creating event network-changed:afdeb60c-c7b1-441b-90f4-293273965fad for instance 406b5ad6-698e-457f-93f4-cdfd45fb3e8e on hv-cinder-83987 Apr 29 08:52:26.948086 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [req-44c043f7-1dee-445d-ad87-37779d6caa54 req-2ed3a53f-10c4-4c34-848b-1f2f383f18e0 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036112 Apr 29 08:52:26.949337 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 90/190] 10.222.0.31 () {64 vars in 1317 bytes} [Fri Apr 29 08:52:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 29 08:52:51.795431 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-eecacde1-820a-4722-b8a6-2a7181ee29df tempest-VolumesSnapshotTestJSON-1697003112 tempest-VolumesSnapshotTestJSON-1697003112-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-942212811", "imageRef": "e0678f88-0b68-4453-b569-29fd065e544e", "flavorRef": "452", "networks": [{"uuid": "f4f44d9f-d67a-42a4-ae05-6cfe31d44fd1"}]}} {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 29 08:52:51.892270 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.network.neutron [None req-eecacde1-820a-4722-b8a6-2a7181ee29df tempest-VolumesSnapshotTestJSON-1697003112 tempest-VolumesSnapshotTestJSON-1697003112-project] validate_networks() for [('f4f44d9f-d67a-42a4-ae05-6cfe31d44fd1', None, None, None, None, None)] {{(pid=123458) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 29 08:52:52.787510 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.virt.hardware [None req-eecacde1-820a-4722-b8a6-2a7181ee29df tempest-VolumesSnapshotTestJSON-1697003112 tempest-VolumesSnapshotTestJSON-1697003112-project] Flavor limits 0:0:0 {{(pid=123458) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 29 08:52:52.787510 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.virt.hardware [None req-eecacde1-820a-4722-b8a6-2a7181ee29df tempest-VolumesSnapshotTestJSON-1697003112 tempest-VolumesSnapshotTestJSON-1697003112-project] Image limits 0:0:0 {{(pid=123458) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 29 08:52:52.787510 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.virt.hardware [None req-eecacde1-820a-4722-b8a6-2a7181ee29df tempest-VolumesSnapshotTestJSON-1697003112 tempest-VolumesSnapshotTestJSON-1697003112-project] Flavor pref 0:0:0 {{(pid=123458) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 29 08:52:52.787510 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.virt.hardware [None req-eecacde1-820a-4722-b8a6-2a7181ee29df tempest-VolumesSnapshotTestJSON-1697003112 tempest-VolumesSnapshotTestJSON-1697003112-project] Image pref 0:0:0 {{(pid=123458) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 29 08:52:52.787510 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.virt.hardware [None req-eecacde1-820a-4722-b8a6-2a7181ee29df tempest-VolumesSnapshotTestJSON-1697003112 tempest-VolumesSnapshotTestJSON-1697003112-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123458) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 29 08:52:52.789899 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-37b29c7d-15bd-4148-93a5-0b71dd9d18a4 tempest-DeleteServersTestJSON-126197053 tempest-DeleteServersTestJSON-126197053-project] Calling method '>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:52:52.790431 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-37b29c7d-15bd-4148-93a5-0b71dd9d18a4 tempest-DeleteServersTestJSON-126197053 tempest-DeleteServersTestJSON-126197053-project] [instance: 2f7df954-edb0-41b8-a3d9-a8a870d487c3] Fetching instance by UUID {{(pid=123459) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:52:52.811333 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-37b29c7d-15bd-4148-93a5-0b71dd9d18a4 tempest-DeleteServersTestJSON-126197053 tempest-DeleteServersTestJSON-126197053-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:52:52.811919 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-37b29c7d-15bd-4148-93a5-0b71dd9d18a4 tempest-DeleteServersTestJSON-126197053 tempest-DeleteServersTestJSON-126197053-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:52:52.812860 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-37b29c7d-15bd-4148-93a5-0b71dd9d18a4 tempest-DeleteServersTestJSON-126197053 tempest-DeleteServersTestJSON-126197053-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:52:52.814299 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-eecacde1-820a-4722-b8a6-2a7181ee29df tempest-VolumesSnapshotTestJSON-1697003112 tempest-VolumesSnapshotTestJSON-1697003112-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:52:52.814789 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-eecacde1-820a-4722-b8a6-2a7181ee29df tempest-VolumesSnapshotTestJSON-1697003112 tempest-VolumesSnapshotTestJSON-1697003112-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:52:52.815289 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-37b29c7d-15bd-4148-93a5-0b71dd9d18a4 tempest-DeleteServersTestJSON-126197053 tempest-DeleteServersTestJSON-126197053-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:52:52.817341 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-eecacde1-820a-4722-b8a6-2a7181ee29df tempest-VolumesSnapshotTestJSON-1697003112 tempest-VolumesSnapshotTestJSON-1697003112-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:52:52.818025 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-eecacde1-820a-4722-b8a6-2a7181ee29df tempest-VolumesSnapshotTestJSON-1697003112 tempest-VolumesSnapshotTestJSON-1697003112-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:52:52.843872 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-37b29c7d-15bd-4148-93a5-0b71dd9d18a4 tempest-DeleteServersTestJSON-126197053 tempest-DeleteServersTestJSON-126197053-project] [instance: 2f7df954-edb0-41b8-a3d9-a8a870d487c3] Going to try to terminate instance {{(pid=123459) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 29 08:52:52.852675 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.quota [None req-eecacde1-820a-4722-b8a6-2a7181ee29df tempest-VolumesSnapshotTestJSON-1697003112 tempest-VolumesSnapshotTestJSON-1697003112-project] Getting quotas for project 2c0d26c7abcc4bc7b175ac175bb5f2ec. Resources: {'instances', 'cores', 'ram'} {{(pid=123458) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 29 08:52:52.858511 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.quota [None req-eecacde1-820a-4722-b8a6-2a7181ee29df tempest-VolumesSnapshotTestJSON-1697003112 tempest-VolumesSnapshotTestJSON-1697003112-project] Getting quotas for user a210cf812fb54682ac28a13a5dce0563 and project 2c0d26c7abcc4bc7b175ac175bb5f2ec. Resources: {'instances', 'cores', 'ram'} {{(pid=123458) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 29 08:52:52.873140 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-eecacde1-820a-4722-b8a6-2a7181ee29df tempest-VolumesSnapshotTestJSON-1697003112 tempest-VolumesSnapshotTestJSON-1697003112-project] Going to run 1 instances... {{(pid=123458) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 29 08:52:52.880042 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-eecacde1-820a-4722-b8a6-2a7181ee29df tempest-VolumesSnapshotTestJSON-1697003112 tempest-VolumesSnapshotTestJSON-1697003112-project] [instance: 620e45e7-5ce1-4319-8b61-5aaff72e47aa] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e0678f88-0b68-4453-b569-29fd065e544e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123458) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 29 08:52:53.004623 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-eecacde1-820a-4722-b8a6-2a7181ee29df tempest-VolumesSnapshotTestJSON-1697003112 tempest-VolumesSnapshotTestJSON-1697003112-project] 10.222.0.31 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.210225 Apr 29 08:52:53.005014 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-37b29c7d-15bd-4148-93a5-0b71dd9d18a4 tempest-DeleteServersTestJSON-126197053 tempest-DeleteServersTestJSON-126197053-project] 10.222.0.31 "DELETE /compute/v2.1/servers/2f7df954-edb0-41b8-a3d9-a8a870d487c3" status: 204 len: 0 microversion: 2.1 time: 0.225923 Apr 29 08:52:53.006769 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 101/191] 10.222.0.31 () {60 vars in 1146 bytes} [Fri Apr 29 08:52:51 2022] POST /compute/v2.1/servers => generated 380 bytes in 1215 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 29 08:52:53.020530 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 91/192] 10.222.0.31 () {58 vars in 1238 bytes} [Fri Apr 29 08:52:52 2022] DELETE /compute/v2.1/servers/2f7df954-edb0-41b8-a3d9-a8a870d487c3 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Apr 29 08:52:53.020740 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-b6e7a004-53ed-44d8-98b0-acbb514ee156 tempest-VolumesSnapshotTestJSON-1697003112 tempest-VolumesSnapshotTestJSON-1697003112-project] Calling method '>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:52:53.021194 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-b6e7a004-53ed-44d8-98b0-acbb514ee156 tempest-VolumesSnapshotTestJSON-1697003112 tempest-VolumesSnapshotTestJSON-1697003112-project] [instance: 620e45e7-5ce1-4319-8b61-5aaff72e47aa] Fetching instance by UUID {{(pid=123458) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:52:53.032283 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-4fb5bc54-9426-4c55-86e3-4e4c17d52580 tempest-DeleteServersTestJSON-126197053 tempest-DeleteServersTestJSON-126197053-project] Calling method '>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:52:53.033771 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-4fb5bc54-9426-4c55-86e3-4e4c17d52580 tempest-DeleteServersTestJSON-126197053 tempest-DeleteServersTestJSON-126197053-project] [instance: 2f7df954-edb0-41b8-a3d9-a8a870d487c3] Fetching instance by UUID {{(pid=123459) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:52:53.046506 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-4fb5bc54-9426-4c55-86e3-4e4c17d52580 tempest-DeleteServersTestJSON-126197053 tempest-DeleteServersTestJSON-126197053-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:52:53.048530 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-4fb5bc54-9426-4c55-86e3-4e4c17d52580 tempest-DeleteServersTestJSON-126197053 tempest-DeleteServersTestJSON-126197053-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:52:53.050413 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-4fb5bc54-9426-4c55-86e3-4e4c17d52580 tempest-DeleteServersTestJSON-126197053 tempest-DeleteServersTestJSON-126197053-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:52:53.051359 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-4fb5bc54-9426-4c55-86e3-4e4c17d52580 tempest-DeleteServersTestJSON-126197053 tempest-DeleteServersTestJSON-126197053-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:52:53.085431 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-b6e7a004-53ed-44d8-98b0-acbb514ee156 tempest-VolumesSnapshotTestJSON-1697003112 tempest-VolumesSnapshotTestJSON-1697003112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a210cf812fb54682ac28a13a5dce0563', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c0d26c7abcc4bc7b175ac175bb5f2ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:52:53.097263 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-b6e7a004-53ed-44d8-98b0-acbb514ee156 tempest-VolumesSnapshotTestJSON-1697003112 tempest-VolumesSnapshotTestJSON-1697003112-project] 10.222.0.31 "GET /compute/v2.1/servers/620e45e7-5ce1-4319-8b61-5aaff72e47aa" status: 200 len: 1218 microversion: 2.1 time: 0.082656 Apr 29 08:52:53.097858 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 102/193] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 08:52:53 2022] GET /compute/v2.1/servers/620e45e7-5ce1-4319-8b61-5aaff72e47aa => generated 1218 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 08:52:53.249304 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-4fb5bc54-9426-4c55-86e3-4e4c17d52580 tempest-DeleteServersTestJSON-126197053 tempest-DeleteServersTestJSON-126197053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8aa040fad7754a4ba5752413fcfde807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b69a8d69ede453aa373fca0a65bdedd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:52:53.257876 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-4fb5bc54-9426-4c55-86e3-4e4c17d52580 tempest-DeleteServersTestJSON-126197053 tempest-DeleteServersTestJSON-126197053-project] 10.222.0.31 "GET /compute/v2.1/servers/2f7df954-edb0-41b8-a3d9-a8a870d487c3" status: 200 len: 1554 microversion: 2.1 time: 0.233329 Apr 29 08:52:53.258684 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 92/194] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 08:52:53 2022] GET /compute/v2.1/servers/2f7df954-edb0-41b8-a3d9-a8a870d487c3 => generated 1554 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 08:52:54.125552 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-9551cf55-82f1-481d-bd32-e46b37e62644 tempest-VolumesSnapshotTestJSON-1697003112 tempest-VolumesSnapshotTestJSON-1697003112-project] Calling method '>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:52:54.126347 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-9551cf55-82f1-481d-bd32-e46b37e62644 tempest-VolumesSnapshotTestJSON-1697003112 tempest-VolumesSnapshotTestJSON-1697003112-project] [instance: 620e45e7-5ce1-4319-8b61-5aaff72e47aa] Fetching instance by UUID {{(pid=123458) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:52:54.133114 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-9551cf55-82f1-481d-bd32-e46b37e62644 tempest-VolumesSnapshotTestJSON-1697003112 tempest-VolumesSnapshotTestJSON-1697003112-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:52:54.133567 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-9551cf55-82f1-481d-bd32-e46b37e62644 tempest-VolumesSnapshotTestJSON-1697003112 tempest-VolumesSnapshotTestJSON-1697003112-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:52:54.134354 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-9551cf55-82f1-481d-bd32-e46b37e62644 tempest-VolumesSnapshotTestJSON-1697003112 tempest-VolumesSnapshotTestJSON-1697003112-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:52:54.134793 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-9551cf55-82f1-481d-bd32-e46b37e62644 tempest-VolumesSnapshotTestJSON-1697003112 tempest-VolumesSnapshotTestJSON-1697003112-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:52:54.207318 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-9551cf55-82f1-481d-bd32-e46b37e62644 tempest-VolumesSnapshotTestJSON-1697003112 tempest-VolumesSnapshotTestJSON-1697003112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a210cf812fb54682ac28a13a5dce0563', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c0d26c7abcc4bc7b175ac175bb5f2ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:52:54.217703 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-9551cf55-82f1-481d-bd32-e46b37e62644 tempest-VolumesSnapshotTestJSON-1697003112 tempest-VolumesSnapshotTestJSON-1697003112-project] 10.222.0.31 "GET /compute/v2.1/servers/620e45e7-5ce1-4319-8b61-5aaff72e47aa" status: 200 len: 1222 microversion: 2.1 time: 0.097446 Apr 29 08:52:54.222960 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 103/195] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 08:52:54 2022] GET /compute/v2.1/servers/620e45e7-5ce1-4319-8b61-5aaff72e47aa => generated 1222 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 08:52:54.285313 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-bd25f04d-cd9b-4682-8661-408706077768 tempest-DeleteServersTestJSON-126197053 tempest-DeleteServersTestJSON-126197053-project] Calling method '>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:52:54.285951 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-bd25f04d-cd9b-4682-8661-408706077768 tempest-DeleteServersTestJSON-126197053 tempest-DeleteServersTestJSON-126197053-project] [instance: 2f7df954-edb0-41b8-a3d9-a8a870d487c3] Fetching instance by UUID {{(pid=123459) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:52:54.292769 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-bd25f04d-cd9b-4682-8661-408706077768 tempest-DeleteServersTestJSON-126197053 tempest-DeleteServersTestJSON-126197053-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:52:54.293417 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-bd25f04d-cd9b-4682-8661-408706077768 tempest-DeleteServersTestJSON-126197053 tempest-DeleteServersTestJSON-126197053-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:52:54.294714 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-bd25f04d-cd9b-4682-8661-408706077768 tempest-DeleteServersTestJSON-126197053 tempest-DeleteServersTestJSON-126197053-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:52:54.295315 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-bd25f04d-cd9b-4682-8661-408706077768 tempest-DeleteServersTestJSON-126197053 tempest-DeleteServersTestJSON-126197053-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:52:54.433541 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-bd25f04d-cd9b-4682-8661-408706077768 tempest-DeleteServersTestJSON-126197053 tempest-DeleteServersTestJSON-126197053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8aa040fad7754a4ba5752413fcfde807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b69a8d69ede453aa373fca0a65bdedd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:52:54.441750 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-bd25f04d-cd9b-4682-8661-408706077768 tempest-DeleteServersTestJSON-126197053 tempest-DeleteServersTestJSON-126197053-project] 10.222.0.31 "GET /compute/v2.1/servers/2f7df954-edb0-41b8-a3d9-a8a870d487c3" status: 200 len: 1554 microversion: 2.1 time: 0.160961 Apr 29 08:52:54.442340 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 93/196] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 08:52:54 2022] GET /compute/v2.1/servers/2f7df954-edb0-41b8-a3d9-a8a870d487c3 => generated 1554 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 08:52:55.236602 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-ea962101-7c85-4ce5-aab9-2ff6f73bf6d5 tempest-VolumesSnapshotTestJSON-1697003112 tempest-VolumesSnapshotTestJSON-1697003112-project] Calling method '>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:52:55.237453 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-ea962101-7c85-4ce5-aab9-2ff6f73bf6d5 tempest-VolumesSnapshotTestJSON-1697003112 tempest-VolumesSnapshotTestJSON-1697003112-project] [instance: 620e45e7-5ce1-4319-8b61-5aaff72e47aa] Fetching instance by UUID {{(pid=123458) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:52:55.244052 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-ea962101-7c85-4ce5-aab9-2ff6f73bf6d5 tempest-VolumesSnapshotTestJSON-1697003112 tempest-VolumesSnapshotTestJSON-1697003112-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:52:55.244545 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-ea962101-7c85-4ce5-aab9-2ff6f73bf6d5 tempest-VolumesSnapshotTestJSON-1697003112 tempest-VolumesSnapshotTestJSON-1697003112-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:52:55.245320 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-ea962101-7c85-4ce5-aab9-2ff6f73bf6d5 tempest-VolumesSnapshotTestJSON-1697003112 tempest-VolumesSnapshotTestJSON-1697003112-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:52:55.245749 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-ea962101-7c85-4ce5-aab9-2ff6f73bf6d5 tempest-VolumesSnapshotTestJSON-1697003112 tempest-VolumesSnapshotTestJSON-1697003112-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:52:55.311511 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-ea962101-7c85-4ce5-aab9-2ff6f73bf6d5 tempest-VolumesSnapshotTestJSON-1697003112 tempest-VolumesSnapshotTestJSON-1697003112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a210cf812fb54682ac28a13a5dce0563', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c0d26c7abcc4bc7b175ac175bb5f2ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:52:55.319195 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-ea962101-7c85-4ce5-aab9-2ff6f73bf6d5 tempest-VolumesSnapshotTestJSON-1697003112 tempest-VolumesSnapshotTestJSON-1697003112-project] 10.222.0.31 "GET /compute/v2.1/servers/620e45e7-5ce1-4319-8b61-5aaff72e47aa" status: 200 len: 1270 microversion: 2.1 time: 0.086298 Apr 29 08:52:55.319771 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 104/197] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 08:52:55 2022] GET /compute/v2.1/servers/620e45e7-5ce1-4319-8b61-5aaff72e47aa => generated 1270 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 08:52:55.458681 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-fc38ee8d-401b-4305-92a0-40268fd974c0 tempest-DeleteServersTestJSON-126197053 tempest-DeleteServersTestJSON-126197053-project] Calling method '>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:52:55.459291 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-fc38ee8d-401b-4305-92a0-40268fd974c0 tempest-DeleteServersTestJSON-126197053 tempest-DeleteServersTestJSON-126197053-project] [instance: 2f7df954-edb0-41b8-a3d9-a8a870d487c3] Fetching instance by UUID {{(pid=123459) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:52:55.466185 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-fc38ee8d-401b-4305-92a0-40268fd974c0 tempest-DeleteServersTestJSON-126197053 tempest-DeleteServersTestJSON-126197053-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:52:55.466185 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-fc38ee8d-401b-4305-92a0-40268fd974c0 tempest-DeleteServersTestJSON-126197053 tempest-DeleteServersTestJSON-126197053-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:52:55.466883 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-fc38ee8d-401b-4305-92a0-40268fd974c0 tempest-DeleteServersTestJSON-126197053 tempest-DeleteServersTestJSON-126197053-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:52:55.467313 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-fc38ee8d-401b-4305-92a0-40268fd974c0 tempest-DeleteServersTestJSON-126197053 tempest-DeleteServersTestJSON-126197053-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:52:55.600810 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-fc38ee8d-401b-4305-92a0-40268fd974c0 tempest-DeleteServersTestJSON-126197053 tempest-DeleteServersTestJSON-126197053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8aa040fad7754a4ba5752413fcfde807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b69a8d69ede453aa373fca0a65bdedd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:52:55.609852 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-fc38ee8d-401b-4305-92a0-40268fd974c0 tempest-DeleteServersTestJSON-126197053 tempest-DeleteServersTestJSON-126197053-project] 10.222.0.31 "GET /compute/v2.1/servers/2f7df954-edb0-41b8-a3d9-a8a870d487c3" status: 200 len: 1554 microversion: 2.1 time: 0.154831 Apr 29 08:52:55.620989 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 94/198] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 08:52:55 2022] GET /compute/v2.1/servers/2f7df954-edb0-41b8-a3d9-a8a870d487c3 => generated 1554 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 08:52:56.338010 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-f87e9882-9dbf-43a0-863e-178d7f1eb70e tempest-VolumesSnapshotTestJSON-1697003112 tempest-VolumesSnapshotTestJSON-1697003112-project] Calling method '>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:52:56.338648 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-f87e9882-9dbf-43a0-863e-178d7f1eb70e tempest-VolumesSnapshotTestJSON-1697003112 tempest-VolumesSnapshotTestJSON-1697003112-project] [instance: 620e45e7-5ce1-4319-8b61-5aaff72e47aa] Fetching instance by UUID {{(pid=123458) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:52:56.347638 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-f87e9882-9dbf-43a0-863e-178d7f1eb70e tempest-VolumesSnapshotTestJSON-1697003112 tempest-VolumesSnapshotTestJSON-1697003112-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:52:56.348081 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-f87e9882-9dbf-43a0-863e-178d7f1eb70e tempest-VolumesSnapshotTestJSON-1697003112 tempest-VolumesSnapshotTestJSON-1697003112-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:52:56.348885 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-f87e9882-9dbf-43a0-863e-178d7f1eb70e tempest-VolumesSnapshotTestJSON-1697003112 tempest-VolumesSnapshotTestJSON-1697003112-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:52:56.349316 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-f87e9882-9dbf-43a0-863e-178d7f1eb70e tempest-VolumesSnapshotTestJSON-1697003112 tempest-VolumesSnapshotTestJSON-1697003112-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:52:56.414145 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-f87e9882-9dbf-43a0-863e-178d7f1eb70e tempest-VolumesSnapshotTestJSON-1697003112 tempest-VolumesSnapshotTestJSON-1697003112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a210cf812fb54682ac28a13a5dce0563', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c0d26c7abcc4bc7b175ac175bb5f2ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:52:56.420495 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-f87e9882-9dbf-43a0-863e-178d7f1eb70e tempest-VolumesSnapshotTestJSON-1697003112 tempest-VolumesSnapshotTestJSON-1697003112-project] 10.222.0.31 "GET /compute/v2.1/servers/620e45e7-5ce1-4319-8b61-5aaff72e47aa" status: 200 len: 1270 microversion: 2.1 time: 0.086524 Apr 29 08:52:56.421069 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 105/199] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 08:52:56 2022] GET /compute/v2.1/servers/620e45e7-5ce1-4319-8b61-5aaff72e47aa => generated 1270 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 08:52:56.633313 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-f2e0614a-bf9c-4bf3-9a0c-5fa34e1e3bff tempest-DeleteServersTestJSON-126197053 tempest-DeleteServersTestJSON-126197053-project] Calling method '>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:52:56.633925 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-f2e0614a-bf9c-4bf3-9a0c-5fa34e1e3bff tempest-DeleteServersTestJSON-126197053 tempest-DeleteServersTestJSON-126197053-project] [instance: 2f7df954-edb0-41b8-a3d9-a8a870d487c3] Fetching instance by UUID {{(pid=123459) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:52:56.641489 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-f2e0614a-bf9c-4bf3-9a0c-5fa34e1e3bff tempest-DeleteServersTestJSON-126197053 tempest-DeleteServersTestJSON-126197053-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:52:56.642549 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-f2e0614a-bf9c-4bf3-9a0c-5fa34e1e3bff tempest-DeleteServersTestJSON-126197053 tempest-DeleteServersTestJSON-126197053-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:52:56.642786 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-f2e0614a-bf9c-4bf3-9a0c-5fa34e1e3bff tempest-DeleteServersTestJSON-126197053 tempest-DeleteServersTestJSON-126197053-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:52:56.643215 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-f2e0614a-bf9c-4bf3-9a0c-5fa34e1e3bff tempest-DeleteServersTestJSON-126197053 tempest-DeleteServersTestJSON-126197053-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:52:56.782496 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-f2e0614a-bf9c-4bf3-9a0c-5fa34e1e3bff tempest-DeleteServersTestJSON-126197053 tempest-DeleteServersTestJSON-126197053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8aa040fad7754a4ba5752413fcfde807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b69a8d69ede453aa373fca0a65bdedd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:52:56.790816 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-f2e0614a-bf9c-4bf3-9a0c-5fa34e1e3bff tempest-DeleteServersTestJSON-126197053 tempest-DeleteServersTestJSON-126197053-project] 10.222.0.31 "GET /compute/v2.1/servers/2f7df954-edb0-41b8-a3d9-a8a870d487c3" status: 200 len: 1554 microversion: 2.1 time: 0.161221 Apr 29 08:52:56.791474 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 95/200] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 08:52:56 2022] GET /compute/v2.1/servers/2f7df954-edb0-41b8-a3d9-a8a870d487c3 => generated 1554 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 08:52:57.437257 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-9adf1256-8235-4e2e-ba30-571aafd019ad tempest-VolumesSnapshotTestJSON-1697003112 tempest-VolumesSnapshotTestJSON-1697003112-project] Calling method '>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:52:57.437949 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-9adf1256-8235-4e2e-ba30-571aafd019ad tempest-VolumesSnapshotTestJSON-1697003112 tempest-VolumesSnapshotTestJSON-1697003112-project] [instance: 620e45e7-5ce1-4319-8b61-5aaff72e47aa] Fetching instance by UUID {{(pid=123458) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:52:57.443841 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-9adf1256-8235-4e2e-ba30-571aafd019ad tempest-VolumesSnapshotTestJSON-1697003112 tempest-VolumesSnapshotTestJSON-1697003112-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:52:57.444409 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-9adf1256-8235-4e2e-ba30-571aafd019ad tempest-VolumesSnapshotTestJSON-1697003112 tempest-VolumesSnapshotTestJSON-1697003112-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:52:57.445300 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-9adf1256-8235-4e2e-ba30-571aafd019ad tempest-VolumesSnapshotTestJSON-1697003112 tempest-VolumesSnapshotTestJSON-1697003112-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:52:57.445908 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-9adf1256-8235-4e2e-ba30-571aafd019ad tempest-VolumesSnapshotTestJSON-1697003112 tempest-VolumesSnapshotTestJSON-1697003112-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:52:57.511874 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-9adf1256-8235-4e2e-ba30-571aafd019ad tempest-VolumesSnapshotTestJSON-1697003112 tempest-VolumesSnapshotTestJSON-1697003112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a210cf812fb54682ac28a13a5dce0563', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c0d26c7abcc4bc7b175ac175bb5f2ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:52:57.519674 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-9adf1256-8235-4e2e-ba30-571aafd019ad tempest-VolumesSnapshotTestJSON-1697003112 tempest-VolumesSnapshotTestJSON-1697003112-project] 10.222.0.31 "GET /compute/v2.1/servers/620e45e7-5ce1-4319-8b61-5aaff72e47aa" status: 200 len: 1270 microversion: 2.1 time: 0.086129 Apr 29 08:52:57.520262 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 106/201] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 08:52:57 2022] GET /compute/v2.1/servers/620e45e7-5ce1-4319-8b61-5aaff72e47aa => generated 1270 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 08:52:57.808439 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-46f60c14-251c-40e9-a0f1-5f6ec31e8d7d tempest-DeleteServersTestJSON-126197053 tempest-DeleteServersTestJSON-126197053-project] Calling method '>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:52:57.809245 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-46f60c14-251c-40e9-a0f1-5f6ec31e8d7d tempest-DeleteServersTestJSON-126197053 tempest-DeleteServersTestJSON-126197053-project] [instance: 2f7df954-edb0-41b8-a3d9-a8a870d487c3] Fetching instance by UUID {{(pid=123459) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:52:57.815508 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-46f60c14-251c-40e9-a0f1-5f6ec31e8d7d tempest-DeleteServersTestJSON-126197053 tempest-DeleteServersTestJSON-126197053-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:52:57.815952 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-46f60c14-251c-40e9-a0f1-5f6ec31e8d7d tempest-DeleteServersTestJSON-126197053 tempest-DeleteServersTestJSON-126197053-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:52:57.816750 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-46f60c14-251c-40e9-a0f1-5f6ec31e8d7d tempest-DeleteServersTestJSON-126197053 tempest-DeleteServersTestJSON-126197053-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:52:57.817180 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-46f60c14-251c-40e9-a0f1-5f6ec31e8d7d tempest-DeleteServersTestJSON-126197053 tempest-DeleteServersTestJSON-126197053-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:52:57.957757 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-46f60c14-251c-40e9-a0f1-5f6ec31e8d7d tempest-DeleteServersTestJSON-126197053 tempest-DeleteServersTestJSON-126197053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8aa040fad7754a4ba5752413fcfde807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b69a8d69ede453aa373fca0a65bdedd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:52:57.965447 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-46f60c14-251c-40e9-a0f1-5f6ec31e8d7d tempest-DeleteServersTestJSON-126197053 tempest-DeleteServersTestJSON-126197053-project] 10.222.0.31 "GET /compute/v2.1/servers/2f7df954-edb0-41b8-a3d9-a8a870d487c3" status: 200 len: 1554 microversion: 2.1 time: 0.160737 Apr 29 08:52:57.966127 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 96/202] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 08:52:57 2022] GET /compute/v2.1/servers/2f7df954-edb0-41b8-a3d9-a8a870d487c3 => generated 1554 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 08:52:58.537327 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-302e3e3d-193f-4fe4-aa23-8624e39c5fe4 tempest-VolumesSnapshotTestJSON-1697003112 tempest-VolumesSnapshotTestJSON-1697003112-project] Calling method '>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:52:58.537836 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-302e3e3d-193f-4fe4-aa23-8624e39c5fe4 tempest-VolumesSnapshotTestJSON-1697003112 tempest-VolumesSnapshotTestJSON-1697003112-project] [instance: 620e45e7-5ce1-4319-8b61-5aaff72e47aa] Fetching instance by UUID {{(pid=123458) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:52:58.544385 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-302e3e3d-193f-4fe4-aa23-8624e39c5fe4 tempest-VolumesSnapshotTestJSON-1697003112 tempest-VolumesSnapshotTestJSON-1697003112-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:52:58.544838 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-302e3e3d-193f-4fe4-aa23-8624e39c5fe4 tempest-VolumesSnapshotTestJSON-1697003112 tempest-VolumesSnapshotTestJSON-1697003112-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:52:58.545606 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-302e3e3d-193f-4fe4-aa23-8624e39c5fe4 tempest-VolumesSnapshotTestJSON-1697003112 tempest-VolumesSnapshotTestJSON-1697003112-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:52:58.546046 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-302e3e3d-193f-4fe4-aa23-8624e39c5fe4 tempest-VolumesSnapshotTestJSON-1697003112 tempest-VolumesSnapshotTestJSON-1697003112-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:52:58.823024 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-302e3e3d-193f-4fe4-aa23-8624e39c5fe4 tempest-VolumesSnapshotTestJSON-1697003112 tempest-VolumesSnapshotTestJSON-1697003112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a210cf812fb54682ac28a13a5dce0563', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c0d26c7abcc4bc7b175ac175bb5f2ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:52:58.830689 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-302e3e3d-193f-4fe4-aa23-8624e39c5fe4 tempest-VolumesSnapshotTestJSON-1697003112 tempest-VolumesSnapshotTestJSON-1697003112-project] 10.222.0.31 "GET /compute/v2.1/servers/620e45e7-5ce1-4319-8b61-5aaff72e47aa" status: 200 len: 1270 microversion: 2.1 time: 0.297250 Apr 29 08:52:58.831257 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 107/203] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 08:52:58 2022] GET /compute/v2.1/servers/620e45e7-5ce1-4319-8b61-5aaff72e47aa => generated 1270 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 08:52:58.982975 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-d4996241-cb3b-4c5e-8444-ef0a81e93422 tempest-DeleteServersTestJSON-126197053 tempest-DeleteServersTestJSON-126197053-project] Calling method '>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:52:58.983614 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-d4996241-cb3b-4c5e-8444-ef0a81e93422 tempest-DeleteServersTestJSON-126197053 tempest-DeleteServersTestJSON-126197053-project] [instance: 2f7df954-edb0-41b8-a3d9-a8a870d487c3] Fetching instance by UUID {{(pid=123459) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:52:58.990180 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-d4996241-cb3b-4c5e-8444-ef0a81e93422 tempest-DeleteServersTestJSON-126197053 tempest-DeleteServersTestJSON-126197053-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:52:58.990648 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-d4996241-cb3b-4c5e-8444-ef0a81e93422 tempest-DeleteServersTestJSON-126197053 tempest-DeleteServersTestJSON-126197053-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:52:58.991414 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-d4996241-cb3b-4c5e-8444-ef0a81e93422 tempest-DeleteServersTestJSON-126197053 tempest-DeleteServersTestJSON-126197053-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:52:58.991844 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-d4996241-cb3b-4c5e-8444-ef0a81e93422 tempest-DeleteServersTestJSON-126197053 tempest-DeleteServersTestJSON-126197053-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:52:59.121336 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-d4996241-cb3b-4c5e-8444-ef0a81e93422 tempest-DeleteServersTestJSON-126197053 tempest-DeleteServersTestJSON-126197053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8aa040fad7754a4ba5752413fcfde807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b69a8d69ede453aa373fca0a65bdedd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:52:59.129372 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-d4996241-cb3b-4c5e-8444-ef0a81e93422 tempest-DeleteServersTestJSON-126197053 tempest-DeleteServersTestJSON-126197053-project] 10.222.0.31 "GET /compute/v2.1/servers/2f7df954-edb0-41b8-a3d9-a8a870d487c3" status: 200 len: 1554 microversion: 2.1 time: 0.150504 Apr 29 08:52:59.129976 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 97/204] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 08:52:58 2022] GET /compute/v2.1/servers/2f7df954-edb0-41b8-a3d9-a8a870d487c3 => generated 1554 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 08:52:59.847909 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-9b0972da-e5a5-4f54-8342-4178a1c21e90 tempest-VolumesSnapshotTestJSON-1697003112 tempest-VolumesSnapshotTestJSON-1697003112-project] Calling method '>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:52:59.848550 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-9b0972da-e5a5-4f54-8342-4178a1c21e90 tempest-VolumesSnapshotTestJSON-1697003112 tempest-VolumesSnapshotTestJSON-1697003112-project] [instance: 620e45e7-5ce1-4319-8b61-5aaff72e47aa] Fetching instance by UUID {{(pid=123458) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:52:59.854570 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-9b0972da-e5a5-4f54-8342-4178a1c21e90 tempest-VolumesSnapshotTestJSON-1697003112 tempest-VolumesSnapshotTestJSON-1697003112-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:52:59.855010 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-9b0972da-e5a5-4f54-8342-4178a1c21e90 tempest-VolumesSnapshotTestJSON-1697003112 tempest-VolumesSnapshotTestJSON-1697003112-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:52:59.855861 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-9b0972da-e5a5-4f54-8342-4178a1c21e90 tempest-VolumesSnapshotTestJSON-1697003112 tempest-VolumesSnapshotTestJSON-1697003112-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:52:59.857121 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-9b0972da-e5a5-4f54-8342-4178a1c21e90 tempest-VolumesSnapshotTestJSON-1697003112 tempest-VolumesSnapshotTestJSON-1697003112-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:53:00.018794 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [req-ddd46f5f-0139-4df3-9b78-8be31768556c req-43b5d70b-da72-4615-a36a-7e265af609ab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2f7df954-edb0-41b8-a3d9-a8a870d487c3", "name": "network-vif-deleted", "tag": "028eab3d-f19b-4591-b8b2-199e74d95dfe"}]} {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 29 08:53:00.029455 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [req-ddd46f5f-0139-4df3-9b78-8be31768556c req-43b5d70b-da72-4615-a36a-7e265af609ab service nova] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:53:00.029904 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [req-ddd46f5f-0139-4df3-9b78-8be31768556c req-43b5d70b-da72-4615-a36a-7e265af609ab service nova] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:53:00.042561 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.compute.server_external_events [req-ddd46f5f-0139-4df3-9b78-8be31768556c req-43b5d70b-da72-4615-a36a-7e265af609ab service nova] Creating event network-vif-deleted:028eab3d-f19b-4591-b8b2-199e74d95dfe for instance 2f7df954-edb0-41b8-a3d9-a8a870d487c3 on hv-cinder-83987 Apr 29 08:53:00.049026 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [req-ddd46f5f-0139-4df3-9b78-8be31768556c req-43b5d70b-da72-4615-a36a-7e265af609ab service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033681 Apr 29 08:53:00.049758 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 98/205] 10.222.0.31 () {64 vars in 1317 bytes} [Fri Apr 29 08:53:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 29 08:53:00.089102 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-9b0972da-e5a5-4f54-8342-4178a1c21e90 tempest-VolumesSnapshotTestJSON-1697003112 tempest-VolumesSnapshotTestJSON-1697003112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a210cf812fb54682ac28a13a5dce0563', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c0d26c7abcc4bc7b175ac175bb5f2ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:53:00.097717 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-9b0972da-e5a5-4f54-8342-4178a1c21e90 tempest-VolumesSnapshotTestJSON-1697003112 tempest-VolumesSnapshotTestJSON-1697003112-project] 10.222.0.31 "GET /compute/v2.1/servers/620e45e7-5ce1-4319-8b61-5aaff72e47aa" status: 200 len: 1318 microversion: 2.1 time: 0.253674 Apr 29 08:53:00.098300 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 108/206] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 08:52:59 2022] GET /compute/v2.1/servers/620e45e7-5ce1-4319-8b61-5aaff72e47aa => generated 1318 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 08:53:00.147360 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-c3b7caa5-4147-4891-85bf-353b2f548fc0 tempest-DeleteServersTestJSON-126197053 tempest-DeleteServersTestJSON-126197053-project] Calling method '>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:53:00.147973 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-c3b7caa5-4147-4891-85bf-353b2f548fc0 tempest-DeleteServersTestJSON-126197053 tempest-DeleteServersTestJSON-126197053-project] [instance: 2f7df954-edb0-41b8-a3d9-a8a870d487c3] Fetching instance by UUID {{(pid=123459) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:53:00.166750 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-c3b7caa5-4147-4891-85bf-353b2f548fc0 tempest-DeleteServersTestJSON-126197053 tempest-DeleteServersTestJSON-126197053-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:53:00.167518 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-c3b7caa5-4147-4891-85bf-353b2f548fc0 tempest-DeleteServersTestJSON-126197053 tempest-DeleteServersTestJSON-126197053-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:53:00.169531 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-c3b7caa5-4147-4891-85bf-353b2f548fc0 tempest-DeleteServersTestJSON-126197053 tempest-DeleteServersTestJSON-126197053-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:53:00.170350 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-c3b7caa5-4147-4891-85bf-353b2f548fc0 tempest-DeleteServersTestJSON-126197053 tempest-DeleteServersTestJSON-126197053-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:53:00.253433 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-c3b7caa5-4147-4891-85bf-353b2f548fc0 tempest-DeleteServersTestJSON-126197053 tempest-DeleteServersTestJSON-126197053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8aa040fad7754a4ba5752413fcfde807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b69a8d69ede453aa373fca0a65bdedd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:53:00.263211 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-c3b7caa5-4147-4891-85bf-353b2f548fc0 tempest-DeleteServersTestJSON-126197053 tempest-DeleteServersTestJSON-126197053-project] 10.222.0.31 "GET /compute/v2.1/servers/2f7df954-edb0-41b8-a3d9-a8a870d487c3" status: 200 len: 1346 microversion: 2.1 time: 0.120009 Apr 29 08:53:00.263788 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 99/207] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 08:53:00 2022] GET /compute/v2.1/servers/2f7df954-edb0-41b8-a3d9-a8a870d487c3 => generated 1346 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 08:53:00.867101 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [req-9ef9d089-d187-4db2-b691-793f00aceb57 req-e97b7c7c-9646-4e86-ba54-14a9b4917ec1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "620e45e7-5ce1-4319-8b61-5aaff72e47aa", "tag": "3213a42c-c1bc-4b54-aae9-e15a4aa846ef"}]} {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 29 08:53:00.878300 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [req-9ef9d089-d187-4db2-b691-793f00aceb57 req-e97b7c7c-9646-4e86-ba54-14a9b4917ec1 service nova] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:53:00.879384 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [req-9ef9d089-d187-4db2-b691-793f00aceb57 req-e97b7c7c-9646-4e86-ba54-14a9b4917ec1 service nova] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:53:00.892342 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.compute.server_external_events [req-9ef9d089-d187-4db2-b691-793f00aceb57 req-e97b7c7c-9646-4e86-ba54-14a9b4917ec1 service nova] Creating event network-changed:3213a42c-c1bc-4b54-aae9-e15a4aa846ef for instance 620e45e7-5ce1-4319-8b61-5aaff72e47aa on hv-cinder-83987 Apr 29 08:53:00.897831 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [req-9ef9d089-d187-4db2-b691-793f00aceb57 req-e97b7c7c-9646-4e86-ba54-14a9b4917ec1 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034688 Apr 29 08:53:00.898772 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 109/208] 10.222.0.31 () {64 vars in 1317 bytes} [Fri Apr 29 08:53:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 29 08:53:01.118990 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-be69d635-dd78-4c99-9765-2b25c9911a0b tempest-VolumesSnapshotTestJSON-1697003112 tempest-VolumesSnapshotTestJSON-1697003112-project] Calling method '>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:53:01.119981 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-be69d635-dd78-4c99-9765-2b25c9911a0b tempest-VolumesSnapshotTestJSON-1697003112 tempest-VolumesSnapshotTestJSON-1697003112-project] [instance: 620e45e7-5ce1-4319-8b61-5aaff72e47aa] Fetching instance by UUID {{(pid=123459) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:53:01.127829 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-be69d635-dd78-4c99-9765-2b25c9911a0b tempest-VolumesSnapshotTestJSON-1697003112 tempest-VolumesSnapshotTestJSON-1697003112-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:53:01.128333 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-be69d635-dd78-4c99-9765-2b25c9911a0b tempest-VolumesSnapshotTestJSON-1697003112 tempest-VolumesSnapshotTestJSON-1697003112-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:53:01.129121 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-be69d635-dd78-4c99-9765-2b25c9911a0b tempest-VolumesSnapshotTestJSON-1697003112 tempest-VolumesSnapshotTestJSON-1697003112-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:53:01.129558 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-be69d635-dd78-4c99-9765-2b25c9911a0b tempest-VolumesSnapshotTestJSON-1697003112 tempest-VolumesSnapshotTestJSON-1697003112-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:53:01.279666 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-be69d635-dd78-4c99-9765-2b25c9911a0b tempest-VolumesSnapshotTestJSON-1697003112 tempest-VolumesSnapshotTestJSON-1697003112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a210cf812fb54682ac28a13a5dce0563', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c0d26c7abcc4bc7b175ac175bb5f2ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:53:01.280548 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-4a2de916-deff-4739-88cd-dd77e2826f3a tempest-DeleteServersTestJSON-126197053 tempest-DeleteServersTestJSON-126197053-project] Calling method '>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:53:01.281262 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-4a2de916-deff-4739-88cd-dd77e2826f3a tempest-DeleteServersTestJSON-126197053 tempest-DeleteServersTestJSON-126197053-project] [instance: 2f7df954-edb0-41b8-a3d9-a8a870d487c3] Fetching instance by UUID {{(pid=123458) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:53:01.287359 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-be69d635-dd78-4c99-9765-2b25c9911a0b tempest-VolumesSnapshotTestJSON-1697003112 tempest-VolumesSnapshotTestJSON-1697003112-project] 10.222.0.31 "GET /compute/v2.1/servers/620e45e7-5ce1-4319-8b61-5aaff72e47aa" status: 200 len: 1318 microversion: 2.1 time: 0.174591 Apr 29 08:53:01.287976 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-4a2de916-deff-4739-88cd-dd77e2826f3a tempest-DeleteServersTestJSON-126197053 tempest-DeleteServersTestJSON-126197053-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:53:01.297586 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-4a2de916-deff-4739-88cd-dd77e2826f3a tempest-DeleteServersTestJSON-126197053 tempest-DeleteServersTestJSON-126197053-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:53:01.298015 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 100/209] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 08:53:01 2022] GET /compute/v2.1/servers/620e45e7-5ce1-4319-8b61-5aaff72e47aa => generated 1318 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 08:53:01.298123 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-4a2de916-deff-4739-88cd-dd77e2826f3a tempest-DeleteServersTestJSON-126197053 tempest-DeleteServersTestJSON-126197053-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:53:01.298123 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-4a2de916-deff-4739-88cd-dd77e2826f3a tempest-DeleteServersTestJSON-126197053 tempest-DeleteServersTestJSON-126197053-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:53:01.363529 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-4a2de916-deff-4739-88cd-dd77e2826f3a tempest-DeleteServersTestJSON-126197053 tempest-DeleteServersTestJSON-126197053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8aa040fad7754a4ba5752413fcfde807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b69a8d69ede453aa373fca0a65bdedd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:53:01.372567 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-4a2de916-deff-4739-88cd-dd77e2826f3a tempest-DeleteServersTestJSON-126197053 tempest-DeleteServersTestJSON-126197053-project] 10.222.0.31 "GET /compute/v2.1/servers/2f7df954-edb0-41b8-a3d9-a8a870d487c3" status: 200 len: 1346 microversion: 2.1 time: 0.095660 Apr 29 08:53:01.373159 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 110/210] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 08:53:01 2022] GET /compute/v2.1/servers/2f7df954-edb0-41b8-a3d9-a8a870d487c3 => generated 1346 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 08:53:02.306336 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-69bf2503-023d-40da-afc8-bbf91860ba49 tempest-VolumesSnapshotTestJSON-1697003112 tempest-VolumesSnapshotTestJSON-1697003112-project] Calling method '>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:53:02.306336 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-69bf2503-023d-40da-afc8-bbf91860ba49 tempest-VolumesSnapshotTestJSON-1697003112 tempest-VolumesSnapshotTestJSON-1697003112-project] [instance: 620e45e7-5ce1-4319-8b61-5aaff72e47aa] Fetching instance by UUID {{(pid=123459) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:53:02.313525 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-69bf2503-023d-40da-afc8-bbf91860ba49 tempest-VolumesSnapshotTestJSON-1697003112 tempest-VolumesSnapshotTestJSON-1697003112-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:53:02.314017 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-69bf2503-023d-40da-afc8-bbf91860ba49 tempest-VolumesSnapshotTestJSON-1697003112 tempest-VolumesSnapshotTestJSON-1697003112-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:53:02.315190 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-69bf2503-023d-40da-afc8-bbf91860ba49 tempest-VolumesSnapshotTestJSON-1697003112 tempest-VolumesSnapshotTestJSON-1697003112-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:53:02.315368 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-69bf2503-023d-40da-afc8-bbf91860ba49 tempest-VolumesSnapshotTestJSON-1697003112 tempest-VolumesSnapshotTestJSON-1697003112-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:53:02.391292 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-347ff22a-2399-4d27-8fdb-18bdfdd254f8 tempest-DeleteServersTestJSON-126197053 tempest-DeleteServersTestJSON-126197053-project] Calling method '>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:53:02.392000 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-347ff22a-2399-4d27-8fdb-18bdfdd254f8 tempest-DeleteServersTestJSON-126197053 tempest-DeleteServersTestJSON-126197053-project] [instance: 2f7df954-edb0-41b8-a3d9-a8a870d487c3] Fetching instance by UUID {{(pid=123458) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:53:02.401769 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-347ff22a-2399-4d27-8fdb-18bdfdd254f8 tempest-DeleteServersTestJSON-126197053 tempest-DeleteServersTestJSON-126197053-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:53:02.402395 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-347ff22a-2399-4d27-8fdb-18bdfdd254f8 tempest-DeleteServersTestJSON-126197053 tempest-DeleteServersTestJSON-126197053-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:53:02.403666 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-347ff22a-2399-4d27-8fdb-18bdfdd254f8 tempest-DeleteServersTestJSON-126197053 tempest-DeleteServersTestJSON-126197053-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:53:02.404495 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-347ff22a-2399-4d27-8fdb-18bdfdd254f8 tempest-DeleteServersTestJSON-126197053 tempest-DeleteServersTestJSON-126197053-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:53:02.468567 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-69bf2503-023d-40da-afc8-bbf91860ba49 tempest-VolumesSnapshotTestJSON-1697003112 tempest-VolumesSnapshotTestJSON-1697003112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a210cf812fb54682ac28a13a5dce0563', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c0d26c7abcc4bc7b175ac175bb5f2ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:53:02.476475 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-69bf2503-023d-40da-afc8-bbf91860ba49 tempest-VolumesSnapshotTestJSON-1697003112 tempest-VolumesSnapshotTestJSON-1697003112-project] 10.222.0.31 "GET /compute/v2.1/servers/620e45e7-5ce1-4319-8b61-5aaff72e47aa" status: 200 len: 1318 microversion: 2.1 time: 0.174722 Apr 29 08:53:02.477055 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 101/211] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 08:53:02 2022] GET /compute/v2.1/servers/620e45e7-5ce1-4319-8b61-5aaff72e47aa => generated 1318 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 08:53:02.484392 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-347ff22a-2399-4d27-8fdb-18bdfdd254f8 tempest-DeleteServersTestJSON-126197053 tempest-DeleteServersTestJSON-126197053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8aa040fad7754a4ba5752413fcfde807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b69a8d69ede453aa373fca0a65bdedd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:53:02.493269 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-347ff22a-2399-4d27-8fdb-18bdfdd254f8 tempest-DeleteServersTestJSON-126197053 tempest-DeleteServersTestJSON-126197053-project] 10.222.0.31 "GET /compute/v2.1/servers/2f7df954-edb0-41b8-a3d9-a8a870d487c3" status: 200 len: 1346 microversion: 2.1 time: 0.107621 Apr 29 08:53:02.494006 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 111/212] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 08:53:02 2022] GET /compute/v2.1/servers/2f7df954-edb0-41b8-a3d9-a8a870d487c3 => generated 1346 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 08:53:03.493572 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-ef1deb08-4875-40be-b8b3-e9d45131966d tempest-VolumesSnapshotTestJSON-1697003112 tempest-VolumesSnapshotTestJSON-1697003112-project] Calling method '>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:53:03.494176 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-ef1deb08-4875-40be-b8b3-e9d45131966d tempest-VolumesSnapshotTestJSON-1697003112 tempest-VolumesSnapshotTestJSON-1697003112-project] [instance: 620e45e7-5ce1-4319-8b61-5aaff72e47aa] Fetching instance by UUID {{(pid=123459) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:53:03.500658 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-ef1deb08-4875-40be-b8b3-e9d45131966d tempest-VolumesSnapshotTestJSON-1697003112 tempest-VolumesSnapshotTestJSON-1697003112-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:53:03.501102 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-ef1deb08-4875-40be-b8b3-e9d45131966d tempest-VolumesSnapshotTestJSON-1697003112 tempest-VolumesSnapshotTestJSON-1697003112-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:53:03.501886 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-ef1deb08-4875-40be-b8b3-e9d45131966d tempest-VolumesSnapshotTestJSON-1697003112 tempest-VolumesSnapshotTestJSON-1697003112-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:53:03.502296 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-ef1deb08-4875-40be-b8b3-e9d45131966d tempest-VolumesSnapshotTestJSON-1697003112 tempest-VolumesSnapshotTestJSON-1697003112-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:53:03.513075 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-ec429575-4db1-426f-b730-891a9fba3e0c tempest-DeleteServersTestJSON-126197053 tempest-DeleteServersTestJSON-126197053-project] Calling method '>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:53:03.514133 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-ec429575-4db1-426f-b730-891a9fba3e0c tempest-DeleteServersTestJSON-126197053 tempest-DeleteServersTestJSON-126197053-project] [instance: 2f7df954-edb0-41b8-a3d9-a8a870d487c3] Fetching instance by UUID {{(pid=123458) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:53:03.520307 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-ec429575-4db1-426f-b730-891a9fba3e0c tempest-DeleteServersTestJSON-126197053 tempest-DeleteServersTestJSON-126197053-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:53:03.520756 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-ec429575-4db1-426f-b730-891a9fba3e0c tempest-DeleteServersTestJSON-126197053 tempest-DeleteServersTestJSON-126197053-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:53:03.521535 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-ec429575-4db1-426f-b730-891a9fba3e0c tempest-DeleteServersTestJSON-126197053 tempest-DeleteServersTestJSON-126197053-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:53:03.521968 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-ec429575-4db1-426f-b730-891a9fba3e0c tempest-DeleteServersTestJSON-126197053 tempest-DeleteServersTestJSON-126197053-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:53:03.585022 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-ec429575-4db1-426f-b730-891a9fba3e0c tempest-DeleteServersTestJSON-126197053 tempest-DeleteServersTestJSON-126197053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8aa040fad7754a4ba5752413fcfde807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b69a8d69ede453aa373fca0a65bdedd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:53:03.593919 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-ec429575-4db1-426f-b730-891a9fba3e0c tempest-DeleteServersTestJSON-126197053 tempest-DeleteServersTestJSON-126197053-project] 10.222.0.31 "GET /compute/v2.1/servers/2f7df954-edb0-41b8-a3d9-a8a870d487c3" status: 200 len: 1346 microversion: 2.1 time: 0.085388 Apr 29 08:53:03.594641 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 112/213] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 08:53:03 2022] GET /compute/v2.1/servers/2f7df954-edb0-41b8-a3d9-a8a870d487c3 => generated 1346 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 29 08:53:03.638108 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-ef1deb08-4875-40be-b8b3-e9d45131966d tempest-VolumesSnapshotTestJSON-1697003112 tempest-VolumesSnapshotTestJSON-1697003112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a210cf812fb54682ac28a13a5dce0563', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c0d26c7abcc4bc7b175ac175bb5f2ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:53:03.646641 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-ef1deb08-4875-40be-b8b3-e9d45131966d tempest-VolumesSnapshotTestJSON-1697003112 tempest-VolumesSnapshotTestJSON-1697003112-project] 10.222.0.31 "GET /compute/v2.1/servers/620e45e7-5ce1-4319-8b61-5aaff72e47aa" status: 200 len: 1318 microversion: 2.1 time: 0.156852 Apr 29 08:53:03.647245 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 102/214] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 08:53:03 2022] GET /compute/v2.1/servers/620e45e7-5ce1-4319-8b61-5aaff72e47aa => generated 1318 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 08:53:04.611883 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-5b9e7578-3a59-49a3-a368-f4ac6f844f86 tempest-DeleteServersTestJSON-126197053 tempest-DeleteServersTestJSON-126197053-project] Calling method '>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:53:04.613651 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-5b9e7578-3a59-49a3-a368-f4ac6f844f86 tempest-DeleteServersTestJSON-126197053 tempest-DeleteServersTestJSON-126197053-project] [instance: 2f7df954-edb0-41b8-a3d9-a8a870d487c3] Fetching instance by UUID {{(pid=123458) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:53:04.620261 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-5b9e7578-3a59-49a3-a368-f4ac6f844f86 tempest-DeleteServersTestJSON-126197053 tempest-DeleteServersTestJSON-126197053-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:53:04.620890 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-5b9e7578-3a59-49a3-a368-f4ac6f844f86 tempest-DeleteServersTestJSON-126197053 tempest-DeleteServersTestJSON-126197053-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:53:04.622472 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-5b9e7578-3a59-49a3-a368-f4ac6f844f86 tempest-DeleteServersTestJSON-126197053 tempest-DeleteServersTestJSON-126197053-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:53:04.623128 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-5b9e7578-3a59-49a3-a368-f4ac6f844f86 tempest-DeleteServersTestJSON-126197053 tempest-DeleteServersTestJSON-126197053-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:53:04.665716 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-211f56ce-15ea-402a-8965-f16e8daa4b0b tempest-VolumesSnapshotTestJSON-1697003112 tempest-VolumesSnapshotTestJSON-1697003112-project] Calling method '>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:53:04.666394 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-211f56ce-15ea-402a-8965-f16e8daa4b0b tempest-VolumesSnapshotTestJSON-1697003112 tempest-VolumesSnapshotTestJSON-1697003112-project] [instance: 620e45e7-5ce1-4319-8b61-5aaff72e47aa] Fetching instance by UUID {{(pid=123459) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:53:04.673894 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-211f56ce-15ea-402a-8965-f16e8daa4b0b tempest-VolumesSnapshotTestJSON-1697003112 tempest-VolumesSnapshotTestJSON-1697003112-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:53:04.674398 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-211f56ce-15ea-402a-8965-f16e8daa4b0b tempest-VolumesSnapshotTestJSON-1697003112 tempest-VolumesSnapshotTestJSON-1697003112-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:53:04.675269 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-211f56ce-15ea-402a-8965-f16e8daa4b0b tempest-VolumesSnapshotTestJSON-1697003112 tempest-VolumesSnapshotTestJSON-1697003112-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:53:04.675722 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-211f56ce-15ea-402a-8965-f16e8daa4b0b tempest-VolumesSnapshotTestJSON-1697003112 tempest-VolumesSnapshotTestJSON-1697003112-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:53:04.697733 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-5b9e7578-3a59-49a3-a368-f4ac6f844f86 tempest-DeleteServersTestJSON-126197053 tempest-DeleteServersTestJSON-126197053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8aa040fad7754a4ba5752413fcfde807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b69a8d69ede453aa373fca0a65bdedd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:53:04.707602 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-5b9e7578-3a59-49a3-a368-f4ac6f844f86 tempest-DeleteServersTestJSON-126197053 tempest-DeleteServersTestJSON-126197053-project] 10.222.0.31 "GET /compute/v2.1/servers/2f7df954-edb0-41b8-a3d9-a8a870d487c3" status: 200 len: 1346 microversion: 2.1 time: 0.099996 Apr 29 08:53:04.708847 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 113/215] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 08:53:04 2022] GET /compute/v2.1/servers/2f7df954-edb0-41b8-a3d9-a8a870d487c3 => generated 1346 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 08:53:04.828547 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-211f56ce-15ea-402a-8965-f16e8daa4b0b tempest-VolumesSnapshotTestJSON-1697003112 tempest-VolumesSnapshotTestJSON-1697003112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a210cf812fb54682ac28a13a5dce0563', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c0d26c7abcc4bc7b175ac175bb5f2ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:53:04.836056 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-211f56ce-15ea-402a-8965-f16e8daa4b0b tempest-VolumesSnapshotTestJSON-1697003112 tempest-VolumesSnapshotTestJSON-1697003112-project] 10.222.0.31 "GET /compute/v2.1/servers/620e45e7-5ce1-4319-8b61-5aaff72e47aa" status: 200 len: 1318 microversion: 2.1 time: 0.174365 Apr 29 08:53:04.836681 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 103/216] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 08:53:04 2022] GET /compute/v2.1/servers/620e45e7-5ce1-4319-8b61-5aaff72e47aa => generated 1318 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 29 08:53:05.726332 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-ee54de0d-e517-4d53-bdc5-f81abc3629d9 tempest-DeleteServersTestJSON-126197053 tempest-DeleteServersTestJSON-126197053-project] Calling method '>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:53:05.727640 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-ee54de0d-e517-4d53-bdc5-f81abc3629d9 tempest-DeleteServersTestJSON-126197053 tempest-DeleteServersTestJSON-126197053-project] [instance: 2f7df954-edb0-41b8-a3d9-a8a870d487c3] Fetching instance by UUID {{(pid=123458) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:53:05.734979 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-ee54de0d-e517-4d53-bdc5-f81abc3629d9 tempest-DeleteServersTestJSON-126197053 tempest-DeleteServersTestJSON-126197053-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:53:05.735503 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-ee54de0d-e517-4d53-bdc5-f81abc3629d9 tempest-DeleteServersTestJSON-126197053 tempest-DeleteServersTestJSON-126197053-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:53:05.736383 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-ee54de0d-e517-4d53-bdc5-f81abc3629d9 tempest-DeleteServersTestJSON-126197053 tempest-DeleteServersTestJSON-126197053-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:53:05.736878 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-ee54de0d-e517-4d53-bdc5-f81abc3629d9 tempest-DeleteServersTestJSON-126197053 tempest-DeleteServersTestJSON-126197053-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:53:05.751219 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.wsgi [None req-ee54de0d-e517-4d53-bdc5-f81abc3629d9 tempest-DeleteServersTestJSON-126197053 tempest-DeleteServersTestJSON-126197053-project] HTTP exception thrown: Instance 2f7df954-edb0-41b8-a3d9-a8a870d487c3 could not be found. Apr 29 08:53:05.751917 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-ee54de0d-e517-4d53-bdc5-f81abc3629d9 tempest-DeleteServersTestJSON-126197053 tempest-DeleteServersTestJSON-126197053-project] Returning 404 to user: Instance 2f7df954-edb0-41b8-a3d9-a8a870d487c3 could not be found. {{(pid=123458) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 29 08:53:05.753536 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-ee54de0d-e517-4d53-bdc5-f81abc3629d9 tempest-DeleteServersTestJSON-126197053 tempest-DeleteServersTestJSON-126197053-project] 10.222.0.31 "GET /compute/v2.1/servers/2f7df954-edb0-41b8-a3d9-a8a870d487c3" status: 404 len: 111 microversion: 2.1 time: 0.031261 Apr 29 08:53:05.754086 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 114/217] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 08:53:05 2022] GET /compute/v2.1/servers/2f7df954-edb0-41b8-a3d9-a8a870d487c3 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Apr 29 08:53:05.852498 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-92b18a18-55d3-41dc-85dc-72024fec9297 tempest-VolumesSnapshotTestJSON-1697003112 tempest-VolumesSnapshotTestJSON-1697003112-project] Calling method '>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:53:05.853621 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-92b18a18-55d3-41dc-85dc-72024fec9297 tempest-VolumesSnapshotTestJSON-1697003112 tempest-VolumesSnapshotTestJSON-1697003112-project] [instance: 620e45e7-5ce1-4319-8b61-5aaff72e47aa] Fetching instance by UUID {{(pid=123459) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:53:05.862440 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-92b18a18-55d3-41dc-85dc-72024fec9297 tempest-VolumesSnapshotTestJSON-1697003112 tempest-VolumesSnapshotTestJSON-1697003112-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:53:05.862926 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-92b18a18-55d3-41dc-85dc-72024fec9297 tempest-VolumesSnapshotTestJSON-1697003112 tempest-VolumesSnapshotTestJSON-1697003112-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:53:05.863704 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-92b18a18-55d3-41dc-85dc-72024fec9297 tempest-VolumesSnapshotTestJSON-1697003112 tempest-VolumesSnapshotTestJSON-1697003112-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:53:05.863969 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-9133143a-e6c1-4693-ab0e-fb4daf20e4a0 tempest-DeleteServersTestJSON-126197053 tempest-DeleteServersTestJSON-126197053-project] Calling method '>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:53:05.864181 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-92b18a18-55d3-41dc-85dc-72024fec9297 tempest-VolumesSnapshotTestJSON-1697003112 tempest-VolumesSnapshotTestJSON-1697003112-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:53:05.864974 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-9133143a-e6c1-4693-ab0e-fb4daf20e4a0 tempest-DeleteServersTestJSON-126197053 tempest-DeleteServersTestJSON-126197053-project] [instance: 2f7df954-edb0-41b8-a3d9-a8a870d487c3] Fetching instance by UUID {{(pid=123458) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:53:05.872526 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-9133143a-e6c1-4693-ab0e-fb4daf20e4a0 tempest-DeleteServersTestJSON-126197053 tempest-DeleteServersTestJSON-126197053-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:53:05.877997 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-9133143a-e6c1-4693-ab0e-fb4daf20e4a0 tempest-DeleteServersTestJSON-126197053 tempest-DeleteServersTestJSON-126197053-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:53:05.879506 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-9133143a-e6c1-4693-ab0e-fb4daf20e4a0 tempest-DeleteServersTestJSON-126197053 tempest-DeleteServersTestJSON-126197053-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:53:05.880116 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-9133143a-e6c1-4693-ab0e-fb4daf20e4a0 tempest-DeleteServersTestJSON-126197053 tempest-DeleteServersTestJSON-126197053-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:53:05.896378 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.wsgi [None req-9133143a-e6c1-4693-ab0e-fb4daf20e4a0 tempest-DeleteServersTestJSON-126197053 tempest-DeleteServersTestJSON-126197053-project] HTTP exception thrown: Instance 2f7df954-edb0-41b8-a3d9-a8a870d487c3 could not be found. Apr 29 08:53:05.896970 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-9133143a-e6c1-4693-ab0e-fb4daf20e4a0 tempest-DeleteServersTestJSON-126197053 tempest-DeleteServersTestJSON-126197053-project] Returning 404 to user: Instance 2f7df954-edb0-41b8-a3d9-a8a870d487c3 could not be found. {{(pid=123458) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 29 08:53:05.897898 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-9133143a-e6c1-4693-ab0e-fb4daf20e4a0 tempest-DeleteServersTestJSON-126197053 tempest-DeleteServersTestJSON-126197053-project] 10.222.0.31 "GET /compute/v2.1/servers/2f7df954-edb0-41b8-a3d9-a8a870d487c3/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.038105 Apr 29 08:53:05.898457 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 115/218] 10.222.0.31 () {58 vars in 1301 bytes} [Fri Apr 29 08:53:05 2022] GET /compute/v2.1/servers/2f7df954-edb0-41b8-a3d9-a8a870d487c3/os-volume_attachments => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Apr 29 08:53:06.052538 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-92b18a18-55d3-41dc-85dc-72024fec9297 tempest-VolumesSnapshotTestJSON-1697003112 tempest-VolumesSnapshotTestJSON-1697003112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a210cf812fb54682ac28a13a5dce0563', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c0d26c7abcc4bc7b175ac175bb5f2ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:53:06.062900 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-92b18a18-55d3-41dc-85dc-72024fec9297 tempest-VolumesSnapshotTestJSON-1697003112 tempest-VolumesSnapshotTestJSON-1697003112-project] 10.222.0.31 "GET /compute/v2.1/servers/620e45e7-5ce1-4319-8b61-5aaff72e47aa" status: 200 len: 1318 microversion: 2.1 time: 0.214141 Apr 29 08:53:06.064363 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 104/219] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 08:53:05 2022] GET /compute/v2.1/servers/620e45e7-5ce1-4319-8b61-5aaff72e47aa => generated 1318 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 08:53:07.081779 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-2801072c-2d7b-46c5-9273-24d89f52cbe7 tempest-VolumesSnapshotTestJSON-1697003112 tempest-VolumesSnapshotTestJSON-1697003112-project] Calling method '>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:53:07.082397 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-2801072c-2d7b-46c5-9273-24d89f52cbe7 tempest-VolumesSnapshotTestJSON-1697003112 tempest-VolumesSnapshotTestJSON-1697003112-project] [instance: 620e45e7-5ce1-4319-8b61-5aaff72e47aa] Fetching instance by UUID {{(pid=123458) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:53:07.088457 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-2801072c-2d7b-46c5-9273-24d89f52cbe7 tempest-VolumesSnapshotTestJSON-1697003112 tempest-VolumesSnapshotTestJSON-1697003112-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:53:07.088912 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-2801072c-2d7b-46c5-9273-24d89f52cbe7 tempest-VolumesSnapshotTestJSON-1697003112 tempest-VolumesSnapshotTestJSON-1697003112-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:53:07.089696 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-2801072c-2d7b-46c5-9273-24d89f52cbe7 tempest-VolumesSnapshotTestJSON-1697003112 tempest-VolumesSnapshotTestJSON-1697003112-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:53:07.090663 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-2801072c-2d7b-46c5-9273-24d89f52cbe7 tempest-VolumesSnapshotTestJSON-1697003112 tempest-VolumesSnapshotTestJSON-1697003112-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:53:07.157221 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-5f2c83e2-b368-4e45-8699-ec3794432e30 tempest-DeleteServersTestJSON-126197053 tempest-DeleteServersTestJSON-126197053-project] Calling method '>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:53:07.157791 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-5f2c83e2-b368-4e45-8699-ec3794432e30 tempest-DeleteServersTestJSON-126197053 tempest-DeleteServersTestJSON-126197053-project] [instance: 2f7df954-edb0-41b8-a3d9-a8a870d487c3] Fetching instance by UUID {{(pid=123459) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:53:07.170106 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-5f2c83e2-b368-4e45-8699-ec3794432e30 tempest-DeleteServersTestJSON-126197053 tempest-DeleteServersTestJSON-126197053-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:53:07.170814 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-5f2c83e2-b368-4e45-8699-ec3794432e30 tempest-DeleteServersTestJSON-126197053 tempest-DeleteServersTestJSON-126197053-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:53:07.171859 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-5f2c83e2-b368-4e45-8699-ec3794432e30 tempest-DeleteServersTestJSON-126197053 tempest-DeleteServersTestJSON-126197053-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:53:07.172588 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-5f2c83e2-b368-4e45-8699-ec3794432e30 tempest-DeleteServersTestJSON-126197053 tempest-DeleteServersTestJSON-126197053-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:53:07.187308 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.wsgi [None req-5f2c83e2-b368-4e45-8699-ec3794432e30 tempest-DeleteServersTestJSON-126197053 tempest-DeleteServersTestJSON-126197053-project] HTTP exception thrown: Instance 2f7df954-edb0-41b8-a3d9-a8a870d487c3 could not be found. Apr 29 08:53:07.187908 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-5f2c83e2-b368-4e45-8699-ec3794432e30 tempest-DeleteServersTestJSON-126197053 tempest-DeleteServersTestJSON-126197053-project] Returning 404 to user: Instance 2f7df954-edb0-41b8-a3d9-a8a870d487c3 could not be found. {{(pid=123459) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 29 08:53:07.188765 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-5f2c83e2-b368-4e45-8699-ec3794432e30 tempest-DeleteServersTestJSON-126197053 tempest-DeleteServersTestJSON-126197053-project] 10.222.0.31 "DELETE /compute/v2.1/servers/2f7df954-edb0-41b8-a3d9-a8a870d487c3" status: 404 len: 111 microversion: 2.1 time: 0.036697 Apr 29 08:53:07.189622 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 105/220] 10.222.0.31 () {58 vars in 1238 bytes} [Fri Apr 29 08:53:07 2022] DELETE /compute/v2.1/servers/2f7df954-edb0-41b8-a3d9-a8a870d487c3 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Apr 29 08:53:07.197279 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-84d11a00-c4b6-41ff-8d3e-7e0b0414ba9a tempest-DeleteServersTestJSON-126197053 tempest-DeleteServersTestJSON-126197053-project] Calling method '>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:53:07.197886 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-84d11a00-c4b6-41ff-8d3e-7e0b0414ba9a tempest-DeleteServersTestJSON-126197053 tempest-DeleteServersTestJSON-126197053-project] [instance: 2f7df954-edb0-41b8-a3d9-a8a870d487c3] Fetching instance by UUID {{(pid=123459) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:53:07.204268 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-84d11a00-c4b6-41ff-8d3e-7e0b0414ba9a tempest-DeleteServersTestJSON-126197053 tempest-DeleteServersTestJSON-126197053-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:53:07.204721 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-84d11a00-c4b6-41ff-8d3e-7e0b0414ba9a tempest-DeleteServersTestJSON-126197053 tempest-DeleteServersTestJSON-126197053-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:53:07.205497 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-84d11a00-c4b6-41ff-8d3e-7e0b0414ba9a tempest-DeleteServersTestJSON-126197053 tempest-DeleteServersTestJSON-126197053-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:53:07.205931 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-84d11a00-c4b6-41ff-8d3e-7e0b0414ba9a tempest-DeleteServersTestJSON-126197053 tempest-DeleteServersTestJSON-126197053-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:53:07.220950 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.wsgi [None req-84d11a00-c4b6-41ff-8d3e-7e0b0414ba9a tempest-DeleteServersTestJSON-126197053 tempest-DeleteServersTestJSON-126197053-project] HTTP exception thrown: Instance 2f7df954-edb0-41b8-a3d9-a8a870d487c3 could not be found. Apr 29 08:53:07.221502 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-84d11a00-c4b6-41ff-8d3e-7e0b0414ba9a tempest-DeleteServersTestJSON-126197053 tempest-DeleteServersTestJSON-126197053-project] Returning 404 to user: Instance 2f7df954-edb0-41b8-a3d9-a8a870d487c3 could not be found. {{(pid=123459) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 29 08:53:07.222584 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-84d11a00-c4b6-41ff-8d3e-7e0b0414ba9a tempest-DeleteServersTestJSON-126197053 tempest-DeleteServersTestJSON-126197053-project] 10.222.0.31 "GET /compute/v2.1/servers/2f7df954-edb0-41b8-a3d9-a8a870d487c3" status: 404 len: 111 microversion: 2.1 time: 0.028982 Apr 29 08:53:07.226842 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 106/221] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 08:53:07 2022] GET /compute/v2.1/servers/2f7df954-edb0-41b8-a3d9-a8a870d487c3 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Apr 29 08:53:07.250429 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-2801072c-2d7b-46c5-9273-24d89f52cbe7 tempest-VolumesSnapshotTestJSON-1697003112 tempest-VolumesSnapshotTestJSON-1697003112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a210cf812fb54682ac28a13a5dce0563', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c0d26c7abcc4bc7b175ac175bb5f2ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:53:07.258167 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-2801072c-2d7b-46c5-9273-24d89f52cbe7 tempest-VolumesSnapshotTestJSON-1697003112 tempest-VolumesSnapshotTestJSON-1697003112-project] 10.222.0.31 "GET /compute/v2.1/servers/620e45e7-5ce1-4319-8b61-5aaff72e47aa" status: 200 len: 1318 microversion: 2.1 time: 0.180590 Apr 29 08:53:07.259084 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 116/222] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 08:53:07 2022] GET /compute/v2.1/servers/620e45e7-5ce1-4319-8b61-5aaff72e47aa => generated 1318 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 08:53:08.275881 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-0c62eca4-e01f-488f-98dc-30db8fc37546 tempest-VolumesSnapshotTestJSON-1697003112 tempest-VolumesSnapshotTestJSON-1697003112-project] Calling method '>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:53:08.276436 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-0c62eca4-e01f-488f-98dc-30db8fc37546 tempest-VolumesSnapshotTestJSON-1697003112 tempest-VolumesSnapshotTestJSON-1697003112-project] [instance: 620e45e7-5ce1-4319-8b61-5aaff72e47aa] Fetching instance by UUID {{(pid=123459) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:53:08.283852 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-0c62eca4-e01f-488f-98dc-30db8fc37546 tempest-VolumesSnapshotTestJSON-1697003112 tempest-VolumesSnapshotTestJSON-1697003112-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:53:08.284094 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-0c62eca4-e01f-488f-98dc-30db8fc37546 tempest-VolumesSnapshotTestJSON-1697003112 tempest-VolumesSnapshotTestJSON-1697003112-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:53:08.284901 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-0c62eca4-e01f-488f-98dc-30db8fc37546 tempest-VolumesSnapshotTestJSON-1697003112 tempest-VolumesSnapshotTestJSON-1697003112-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:53:08.285362 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-0c62eca4-e01f-488f-98dc-30db8fc37546 tempest-VolumesSnapshotTestJSON-1697003112 tempest-VolumesSnapshotTestJSON-1697003112-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:53:08.456962 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-0c62eca4-e01f-488f-98dc-30db8fc37546 tempest-VolumesSnapshotTestJSON-1697003112 tempest-VolumesSnapshotTestJSON-1697003112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a210cf812fb54682ac28a13a5dce0563', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c0d26c7abcc4bc7b175ac175bb5f2ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:53:08.466783 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-0c62eca4-e01f-488f-98dc-30db8fc37546 tempest-VolumesSnapshotTestJSON-1697003112 tempest-VolumesSnapshotTestJSON-1697003112-project] 10.222.0.31 "GET /compute/v2.1/servers/620e45e7-5ce1-4319-8b61-5aaff72e47aa" status: 200 len: 1318 microversion: 2.1 time: 0.194463 Apr 29 08:53:08.467793 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 107/223] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 08:53:08 2022] GET /compute/v2.1/servers/620e45e7-5ce1-4319-8b61-5aaff72e47aa => generated 1318 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 08:53:09.485304 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-626617b1-86a6-4bc0-84d3-662b5c1ac5ec tempest-VolumesSnapshotTestJSON-1697003112 tempest-VolumesSnapshotTestJSON-1697003112-project] Calling method '>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:53:09.485922 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-626617b1-86a6-4bc0-84d3-662b5c1ac5ec tempest-VolumesSnapshotTestJSON-1697003112 tempest-VolumesSnapshotTestJSON-1697003112-project] [instance: 620e45e7-5ce1-4319-8b61-5aaff72e47aa] Fetching instance by UUID {{(pid=123458) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:53:09.492512 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-626617b1-86a6-4bc0-84d3-662b5c1ac5ec tempest-VolumesSnapshotTestJSON-1697003112 tempest-VolumesSnapshotTestJSON-1697003112-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:53:09.493040 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-626617b1-86a6-4bc0-84d3-662b5c1ac5ec tempest-VolumesSnapshotTestJSON-1697003112 tempest-VolumesSnapshotTestJSON-1697003112-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:53:09.493893 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-626617b1-86a6-4bc0-84d3-662b5c1ac5ec tempest-VolumesSnapshotTestJSON-1697003112 tempest-VolumesSnapshotTestJSON-1697003112-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:53:09.494410 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-626617b1-86a6-4bc0-84d3-662b5c1ac5ec tempest-VolumesSnapshotTestJSON-1697003112 tempest-VolumesSnapshotTestJSON-1697003112-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:53:09.634085 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-626617b1-86a6-4bc0-84d3-662b5c1ac5ec tempest-VolumesSnapshotTestJSON-1697003112 tempest-VolumesSnapshotTestJSON-1697003112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a210cf812fb54682ac28a13a5dce0563', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c0d26c7abcc4bc7b175ac175bb5f2ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:53:09.649104 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-626617b1-86a6-4bc0-84d3-662b5c1ac5ec tempest-VolumesSnapshotTestJSON-1697003112 tempest-VolumesSnapshotTestJSON-1697003112-project] 10.222.0.31 "GET /compute/v2.1/servers/620e45e7-5ce1-4319-8b61-5aaff72e47aa" status: 200 len: 1318 microversion: 2.1 time: 0.168764 Apr 29 08:53:09.649698 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 117/224] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 08:53:09 2022] GET /compute/v2.1/servers/620e45e7-5ce1-4319-8b61-5aaff72e47aa => generated 1318 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 08:53:10.667134 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-5841fd68-a034-4f39-a974-75149f6d4b3b tempest-VolumesSnapshotTestJSON-1697003112 tempest-VolumesSnapshotTestJSON-1697003112-project] Calling method '>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:53:10.668926 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-5841fd68-a034-4f39-a974-75149f6d4b3b tempest-VolumesSnapshotTestJSON-1697003112 tempest-VolumesSnapshotTestJSON-1697003112-project] [instance: 620e45e7-5ce1-4319-8b61-5aaff72e47aa] Fetching instance by UUID {{(pid=123459) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:53:10.675923 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-5841fd68-a034-4f39-a974-75149f6d4b3b tempest-VolumesSnapshotTestJSON-1697003112 tempest-VolumesSnapshotTestJSON-1697003112-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:53:10.676414 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-5841fd68-a034-4f39-a974-75149f6d4b3b tempest-VolumesSnapshotTestJSON-1697003112 tempest-VolumesSnapshotTestJSON-1697003112-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:53:10.677193 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-5841fd68-a034-4f39-a974-75149f6d4b3b tempest-VolumesSnapshotTestJSON-1697003112 tempest-VolumesSnapshotTestJSON-1697003112-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:53:10.677622 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-5841fd68-a034-4f39-a974-75149f6d4b3b tempest-VolumesSnapshotTestJSON-1697003112 tempest-VolumesSnapshotTestJSON-1697003112-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:53:10.831610 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-5841fd68-a034-4f39-a974-75149f6d4b3b tempest-VolumesSnapshotTestJSON-1697003112 tempest-VolumesSnapshotTestJSON-1697003112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a210cf812fb54682ac28a13a5dce0563', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c0d26c7abcc4bc7b175ac175bb5f2ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:53:10.839802 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-5841fd68-a034-4f39-a974-75149f6d4b3b tempest-VolumesSnapshotTestJSON-1697003112 tempest-VolumesSnapshotTestJSON-1697003112-project] 10.222.0.31 "GET /compute/v2.1/servers/620e45e7-5ce1-4319-8b61-5aaff72e47aa" status: 200 len: 1318 microversion: 2.1 time: 0.176667 Apr 29 08:53:10.840992 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 108/225] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 08:53:10 2022] GET /compute/v2.1/servers/620e45e7-5ce1-4319-8b61-5aaff72e47aa => generated 1318 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 08:53:11.863824 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-36906e9c-ce96-49ca-95bd-33ddec577982 tempest-VolumesSnapshotTestJSON-1697003112 tempest-VolumesSnapshotTestJSON-1697003112-project] Calling method '>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:53:11.864621 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-36906e9c-ce96-49ca-95bd-33ddec577982 tempest-VolumesSnapshotTestJSON-1697003112 tempest-VolumesSnapshotTestJSON-1697003112-project] [instance: 620e45e7-5ce1-4319-8b61-5aaff72e47aa] Fetching instance by UUID {{(pid=123458) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:53:11.872618 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-36906e9c-ce96-49ca-95bd-33ddec577982 tempest-VolumesSnapshotTestJSON-1697003112 tempest-VolumesSnapshotTestJSON-1697003112-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:53:11.873283 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-36906e9c-ce96-49ca-95bd-33ddec577982 tempest-VolumesSnapshotTestJSON-1697003112 tempest-VolumesSnapshotTestJSON-1697003112-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:53:11.874109 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-36906e9c-ce96-49ca-95bd-33ddec577982 tempest-VolumesSnapshotTestJSON-1697003112 tempest-VolumesSnapshotTestJSON-1697003112-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:53:11.874585 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-36906e9c-ce96-49ca-95bd-33ddec577982 tempest-VolumesSnapshotTestJSON-1697003112 tempest-VolumesSnapshotTestJSON-1697003112-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:53:12.033692 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-36906e9c-ce96-49ca-95bd-33ddec577982 tempest-VolumesSnapshotTestJSON-1697003112 tempest-VolumesSnapshotTestJSON-1697003112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a210cf812fb54682ac28a13a5dce0563', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c0d26c7abcc4bc7b175ac175bb5f2ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:53:12.041395 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-36906e9c-ce96-49ca-95bd-33ddec577982 tempest-VolumesSnapshotTestJSON-1697003112 tempest-VolumesSnapshotTestJSON-1697003112-project] 10.222.0.31 "GET /compute/v2.1/servers/620e45e7-5ce1-4319-8b61-5aaff72e47aa" status: 200 len: 1318 microversion: 2.1 time: 0.181763 Apr 29 08:53:12.052980 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 118/226] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 08:53:11 2022] GET /compute/v2.1/servers/620e45e7-5ce1-4319-8b61-5aaff72e47aa => generated 1318 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 08:53:13.062250 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-4574b980-8323-4586-862a-032a9a6b701e tempest-VolumesSnapshotTestJSON-1697003112 tempest-VolumesSnapshotTestJSON-1697003112-project] Calling method '>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:53:13.062876 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-4574b980-8323-4586-862a-032a9a6b701e tempest-VolumesSnapshotTestJSON-1697003112 tempest-VolumesSnapshotTestJSON-1697003112-project] [instance: 620e45e7-5ce1-4319-8b61-5aaff72e47aa] Fetching instance by UUID {{(pid=123459) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:53:13.079019 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-4574b980-8323-4586-862a-032a9a6b701e tempest-VolumesSnapshotTestJSON-1697003112 tempest-VolumesSnapshotTestJSON-1697003112-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:53:13.080592 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-4574b980-8323-4586-862a-032a9a6b701e tempest-VolumesSnapshotTestJSON-1697003112 tempest-VolumesSnapshotTestJSON-1697003112-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:53:13.082292 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-4574b980-8323-4586-862a-032a9a6b701e tempest-VolumesSnapshotTestJSON-1697003112 tempest-VolumesSnapshotTestJSON-1697003112-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:53:13.082292 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-4574b980-8323-4586-862a-032a9a6b701e tempest-VolumesSnapshotTestJSON-1697003112 tempest-VolumesSnapshotTestJSON-1697003112-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:53:13.250197 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [req-c417c06d-6d77-4248-acb8-448f4f0820e8 req-4f9cfe3f-95e5-4710-a483-e266c79d4928 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "620e45e7-5ce1-4319-8b61-5aaff72e47aa", "name": "network-vif-plugged", "status": "completed", "tag": "3213a42c-c1bc-4b54-aae9-e15a4aa846ef"}]} {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 29 08:53:13.262246 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [req-c417c06d-6d77-4248-acb8-448f4f0820e8 req-4f9cfe3f-95e5-4710-a483-e266c79d4928 service nova] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:53:13.263085 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [req-c417c06d-6d77-4248-acb8-448f4f0820e8 req-4f9cfe3f-95e5-4710-a483-e266c79d4928 service nova] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:53:13.285968 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.compute.server_external_events [req-c417c06d-6d77-4248-acb8-448f4f0820e8 req-4f9cfe3f-95e5-4710-a483-e266c79d4928 service nova] Creating event network-vif-plugged:3213a42c-c1bc-4b54-aae9-e15a4aa846ef for instance 620e45e7-5ce1-4319-8b61-5aaff72e47aa on hv-cinder-83987 Apr 29 08:53:13.298137 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [req-c417c06d-6d77-4248-acb8-448f4f0820e8 req-4f9cfe3f-95e5-4710-a483-e266c79d4928 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052196 Apr 29 08:53:13.299655 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 119/227] 10.222.0.31 () {64 vars in 1317 bytes} [Fri Apr 29 08:53:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 29 08:53:13.383153 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-4574b980-8323-4586-862a-032a9a6b701e tempest-VolumesSnapshotTestJSON-1697003112 tempest-VolumesSnapshotTestJSON-1697003112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a210cf812fb54682ac28a13a5dce0563', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c0d26c7abcc4bc7b175ac175bb5f2ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:53:13.395119 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-4574b980-8323-4586-862a-032a9a6b701e tempest-VolumesSnapshotTestJSON-1697003112 tempest-VolumesSnapshotTestJSON-1697003112-project] 10.222.0.31 "GET /compute/v2.1/servers/620e45e7-5ce1-4319-8b61-5aaff72e47aa" status: 200 len: 1318 microversion: 2.1 time: 0.339202 Apr 29 08:53:13.395703 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 109/228] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 08:53:13 2022] GET /compute/v2.1/servers/620e45e7-5ce1-4319-8b61-5aaff72e47aa => generated 1318 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 08:53:14.381270 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-d23fe138-b070-4144-89c6-d55ffa003b22 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-687147428", "imageRef": "e0678f88-0b68-4453-b569-29fd065e544e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 29 08:53:14.414044 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-6a9cedaf-97b0-475d-80ac-7e037fa639c9 tempest-VolumesSnapshotTestJSON-1697003112 tempest-VolumesSnapshotTestJSON-1697003112-project] Calling method '>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:53:14.415415 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-6a9cedaf-97b0-475d-80ac-7e037fa639c9 tempest-VolumesSnapshotTestJSON-1697003112 tempest-VolumesSnapshotTestJSON-1697003112-project] [instance: 620e45e7-5ce1-4319-8b61-5aaff72e47aa] Fetching instance by UUID {{(pid=123459) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:53:14.435210 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-6a9cedaf-97b0-475d-80ac-7e037fa639c9 tempest-VolumesSnapshotTestJSON-1697003112 tempest-VolumesSnapshotTestJSON-1697003112-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:53:14.435896 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-6a9cedaf-97b0-475d-80ac-7e037fa639c9 tempest-VolumesSnapshotTestJSON-1697003112 tempest-VolumesSnapshotTestJSON-1697003112-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:53:14.438230 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-6a9cedaf-97b0-475d-80ac-7e037fa639c9 tempest-VolumesSnapshotTestJSON-1697003112 tempest-VolumesSnapshotTestJSON-1697003112-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:53:14.440868 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-6a9cedaf-97b0-475d-80ac-7e037fa639c9 tempest-VolumesSnapshotTestJSON-1697003112 tempest-VolumesSnapshotTestJSON-1697003112-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:53:14.451100 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.network.neutron [None req-d23fe138-b070-4144-89c6-d55ffa003b22 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] validate_networks() for [('a85ddbe4-1cfc-4e78-8e29-c2dcd2efb882', None, None, None, None, None)] {{(pid=123458) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 29 08:53:14.634602 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-6a9cedaf-97b0-475d-80ac-7e037fa639c9 tempest-VolumesSnapshotTestJSON-1697003112 tempest-VolumesSnapshotTestJSON-1697003112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a210cf812fb54682ac28a13a5dce0563', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c0d26c7abcc4bc7b175ac175bb5f2ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:53:14.643505 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-6a9cedaf-97b0-475d-80ac-7e037fa639c9 tempest-VolumesSnapshotTestJSON-1697003112 tempest-VolumesSnapshotTestJSON-1697003112-project] 10.222.0.31 "GET /compute/v2.1/servers/620e45e7-5ce1-4319-8b61-5aaff72e47aa" status: 200 len: 1318 microversion: 2.1 time: 0.235007 Apr 29 08:53:14.644085 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 110/229] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 08:53:14 2022] GET /compute/v2.1/servers/620e45e7-5ce1-4319-8b61-5aaff72e47aa => generated 1318 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 08:53:14.917034 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.virt.hardware [None req-d23fe138-b070-4144-89c6-d55ffa003b22 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Flavor limits 0:0:0 {{(pid=123458) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 29 08:53:14.917453 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.virt.hardware [None req-d23fe138-b070-4144-89c6-d55ffa003b22 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Image limits 0:0:0 {{(pid=123458) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 29 08:53:14.917924 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.virt.hardware [None req-d23fe138-b070-4144-89c6-d55ffa003b22 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Flavor pref 0:0:0 {{(pid=123458) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 29 08:53:14.918374 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.virt.hardware [None req-d23fe138-b070-4144-89c6-d55ffa003b22 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Image pref 0:0:0 {{(pid=123458) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 29 08:53:14.918779 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.virt.hardware [None req-d23fe138-b070-4144-89c6-d55ffa003b22 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123458) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 29 08:53:14.938238 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-d23fe138-b070-4144-89c6-d55ffa003b22 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:53:14.938702 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-d23fe138-b070-4144-89c6-d55ffa003b22 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:53:14.939514 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-d23fe138-b070-4144-89c6-d55ffa003b22 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:53:14.940042 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-d23fe138-b070-4144-89c6-d55ffa003b22 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:53:14.958852 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.quota [None req-d23fe138-b070-4144-89c6-d55ffa003b22 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Getting quotas for project 60998f08c40446e787ead285e40665b1. Resources: {'instances', 'cores', 'ram'} {{(pid=123458) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 29 08:53:14.963616 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.quota [None req-d23fe138-b070-4144-89c6-d55ffa003b22 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Getting quotas for user 5c18e88436f14dc7a2001220b87ce9ed and project 60998f08c40446e787ead285e40665b1. Resources: {'instances', 'cores', 'ram'} {{(pid=123458) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 29 08:53:14.978092 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-d23fe138-b070-4144-89c6-d55ffa003b22 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Going to run 1 instances... {{(pid=123458) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 29 08:53:14.981285 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-d23fe138-b070-4144-89c6-d55ffa003b22 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] [instance: 4e972e2b-7b5e-4a5f-87a1-3642aad3ac24] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e0678f88-0b68-4453-b569-29fd065e544e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123458) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 29 08:53:15.031564 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-d23fe138-b070-4144-89c6-d55ffa003b22 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] 10.222.0.31 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 0.814810 Apr 29 08:53:15.033287 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 120/230] 10.222.0.31 () {60 vars in 1146 bytes} [Fri Apr 29 08:53:14 2022] POST /compute/v2.1/servers => generated 383 bytes in 817 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 29 08:53:15.051481 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-21111f55-e1bf-45a9-88d2-9cf0483fa628 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Calling method '>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:53:15.052907 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-21111f55-e1bf-45a9-88d2-9cf0483fa628 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] [instance: 4e972e2b-7b5e-4a5f-87a1-3642aad3ac24] Fetching instance by UUID {{(pid=123459) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:53:15.156565 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-21111f55-e1bf-45a9-88d2-9cf0483fa628 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c18e88436f14dc7a2001220b87ce9ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60998f08c40446e787ead285e40665b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:53:15.168675 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-21111f55-e1bf-45a9-88d2-9cf0483fa628 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] 10.222.0.31 "GET /compute/v2.1/servers/4e972e2b-7b5e-4a5f-87a1-3642aad3ac24" status: 200 len: 1221 microversion: 2.1 time: 0.127133 Apr 29 08:53:15.169592 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 111/231] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 08:53:15 2022] GET /compute/v2.1/servers/4e972e2b-7b5e-4a5f-87a1-3642aad3ac24 => generated 1221 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 08:53:15.230014 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-8c998fb1-1dab-49c2-90a9-ad47be0680a0 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-286979038", "imageRef": "e0678f88-0b68-4453-b569-29fd065e544e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 29 08:53:15.299790 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.network.neutron [None req-8c998fb1-1dab-49c2-90a9-ad47be0680a0 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] validate_networks() for [('a85ddbe4-1cfc-4e78-8e29-c2dcd2efb882', None, None, None, None, None)] {{(pid=123458) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 29 08:53:15.662630 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-171c3d5d-2238-4823-975e-cf9759944d85 tempest-VolumesSnapshotTestJSON-1697003112 tempest-VolumesSnapshotTestJSON-1697003112-project] Calling method '>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:53:15.663272 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-171c3d5d-2238-4823-975e-cf9759944d85 tempest-VolumesSnapshotTestJSON-1697003112 tempest-VolumesSnapshotTestJSON-1697003112-project] [instance: 620e45e7-5ce1-4319-8b61-5aaff72e47aa] Fetching instance by UUID {{(pid=123459) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:53:15.675374 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-171c3d5d-2238-4823-975e-cf9759944d85 tempest-VolumesSnapshotTestJSON-1697003112 tempest-VolumesSnapshotTestJSON-1697003112-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:53:15.676573 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-171c3d5d-2238-4823-975e-cf9759944d85 tempest-VolumesSnapshotTestJSON-1697003112 tempest-VolumesSnapshotTestJSON-1697003112-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:53:15.677582 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-171c3d5d-2238-4823-975e-cf9759944d85 tempest-VolumesSnapshotTestJSON-1697003112 tempest-VolumesSnapshotTestJSON-1697003112-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:53:15.680418 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-171c3d5d-2238-4823-975e-cf9759944d85 tempest-VolumesSnapshotTestJSON-1697003112 tempest-VolumesSnapshotTestJSON-1697003112-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:53:15.791169 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.virt.hardware [None req-8c998fb1-1dab-49c2-90a9-ad47be0680a0 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Flavor limits 0:0:0 {{(pid=123458) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 29 08:53:15.791689 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.virt.hardware [None req-8c998fb1-1dab-49c2-90a9-ad47be0680a0 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Image limits 0:0:0 {{(pid=123458) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 29 08:53:15.792045 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.virt.hardware [None req-8c998fb1-1dab-49c2-90a9-ad47be0680a0 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Flavor pref 0:0:0 {{(pid=123458) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 29 08:53:15.792486 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.virt.hardware [None req-8c998fb1-1dab-49c2-90a9-ad47be0680a0 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Image pref 0:0:0 {{(pid=123458) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 29 08:53:15.792896 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.virt.hardware [None req-8c998fb1-1dab-49c2-90a9-ad47be0680a0 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123458) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 29 08:53:15.805836 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-8c998fb1-1dab-49c2-90a9-ad47be0680a0 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:53:15.806492 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-8c998fb1-1dab-49c2-90a9-ad47be0680a0 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:53:15.807328 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-8c998fb1-1dab-49c2-90a9-ad47be0680a0 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:53:15.807768 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-8c998fb1-1dab-49c2-90a9-ad47be0680a0 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:53:15.830686 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.quota [None req-8c998fb1-1dab-49c2-90a9-ad47be0680a0 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Getting quotas for project 60998f08c40446e787ead285e40665b1. Resources: {'instances', 'cores', 'ram'} {{(pid=123458) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 29 08:53:15.835450 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.quota [None req-8c998fb1-1dab-49c2-90a9-ad47be0680a0 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Getting quotas for user 5c18e88436f14dc7a2001220b87ce9ed and project 60998f08c40446e787ead285e40665b1. Resources: {'instances', 'cores', 'ram'} {{(pid=123458) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 29 08:53:15.849624 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-8c998fb1-1dab-49c2-90a9-ad47be0680a0 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Going to run 1 instances... {{(pid=123458) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 29 08:53:15.852208 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-8c998fb1-1dab-49c2-90a9-ad47be0680a0 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] [instance: 8715736d-99f1-4f4c-af1f-c4bf3fc295d3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e0678f88-0b68-4453-b569-29fd065e544e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123458) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 29 08:53:15.868330 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-171c3d5d-2238-4823-975e-cf9759944d85 tempest-VolumesSnapshotTestJSON-1697003112 tempest-VolumesSnapshotTestJSON-1697003112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a210cf812fb54682ac28a13a5dce0563', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c0d26c7abcc4bc7b175ac175bb5f2ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:53:15.881757 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-171c3d5d-2238-4823-975e-cf9759944d85 tempest-VolumesSnapshotTestJSON-1697003112 tempest-VolumesSnapshotTestJSON-1697003112-project] 10.222.0.31 "GET /compute/v2.1/servers/620e45e7-5ce1-4319-8b61-5aaff72e47aa" status: 200 len: 1508 microversion: 2.1 time: 0.224584 Apr 29 08:53:15.901019 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 112/232] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 08:53:15 2022] GET /compute/v2.1/servers/620e45e7-5ce1-4319-8b61-5aaff72e47aa => generated 1508 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 29 08:53:15.925609 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-8c998fb1-1dab-49c2-90a9-ad47be0680a0 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] 10.222.0.31 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 0.699813 Apr 29 08:53:15.926446 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 121/233] 10.222.0.31 () {60 vars in 1146 bytes} [Fri Apr 29 08:53:15 2022] POST /compute/v2.1/servers => generated 383 bytes in 702 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 29 08:53:15.937909 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-d619d3c9-3024-40e8-bc7b-e2d0738d6b23 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Calling method '>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:53:15.940337 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-d619d3c9-3024-40e8-bc7b-e2d0738d6b23 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] [instance: 8715736d-99f1-4f4c-af1f-c4bf3fc295d3] Fetching instance by UUID {{(pid=123459) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:53:16.003216 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-d619d3c9-3024-40e8-bc7b-e2d0738d6b23 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c18e88436f14dc7a2001220b87ce9ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60998f08c40446e787ead285e40665b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:53:16.010653 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-d619d3c9-3024-40e8-bc7b-e2d0738d6b23 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] 10.222.0.31 "GET /compute/v2.1/servers/8715736d-99f1-4f4c-af1f-c4bf3fc295d3" status: 200 len: 1221 microversion: 2.1 time: 0.077763 Apr 29 08:53:16.022127 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 113/234] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 08:53:15 2022] GET /compute/v2.1/servers/8715736d-99f1-4f4c-af1f-c4bf3fc295d3 => generated 1221 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 08:53:17.031354 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-17d814a3-6832-4bf4-99db-c42a3a0e173b tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Calling method '>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:53:17.032000 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-17d814a3-6832-4bf4-99db-c42a3a0e173b tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] [instance: 8715736d-99f1-4f4c-af1f-c4bf3fc295d3] Fetching instance by UUID {{(pid=123458) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:53:17.039851 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-17d814a3-6832-4bf4-99db-c42a3a0e173b tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:53:17.041274 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-17d814a3-6832-4bf4-99db-c42a3a0e173b tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:53:17.042756 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-17d814a3-6832-4bf4-99db-c42a3a0e173b tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:53:17.044381 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-17d814a3-6832-4bf4-99db-c42a3a0e173b tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:53:17.150305 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-17d814a3-6832-4bf4-99db-c42a3a0e173b tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c18e88436f14dc7a2001220b87ce9ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60998f08c40446e787ead285e40665b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:53:17.172814 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-17d814a3-6832-4bf4-99db-c42a3a0e173b tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] 10.222.0.31 "GET /compute/v2.1/servers/8715736d-99f1-4f4c-af1f-c4bf3fc295d3" status: 200 len: 1217 microversion: 2.1 time: 0.148817 Apr 29 08:53:17.173977 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 122/235] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 08:53:17 2022] GET /compute/v2.1/servers/8715736d-99f1-4f4c-af1f-c4bf3fc295d3 => generated 1217 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 08:53:18.191672 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-681b480c-58d5-41aa-ac1d-b2595bd1eaac tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Calling method '>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:53:18.192494 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-681b480c-58d5-41aa-ac1d-b2595bd1eaac tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] [instance: 8715736d-99f1-4f4c-af1f-c4bf3fc295d3] Fetching instance by UUID {{(pid=123459) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:53:18.205484 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-681b480c-58d5-41aa-ac1d-b2595bd1eaac tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:53:18.206211 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-681b480c-58d5-41aa-ac1d-b2595bd1eaac tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:53:18.207165 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-681b480c-58d5-41aa-ac1d-b2595bd1eaac tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:53:18.207760 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-681b480c-58d5-41aa-ac1d-b2595bd1eaac tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:53:18.342713 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-681b480c-58d5-41aa-ac1d-b2595bd1eaac tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c18e88436f14dc7a2001220b87ce9ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60998f08c40446e787ead285e40665b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:53:18.368176 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-681b480c-58d5-41aa-ac1d-b2595bd1eaac tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] 10.222.0.31 "GET /compute/v2.1/servers/8715736d-99f1-4f4c-af1f-c4bf3fc295d3" status: 200 len: 1279 microversion: 2.1 time: 0.179215 Apr 29 08:53:18.373673 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 114/236] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 08:53:18 2022] GET /compute/v2.1/servers/8715736d-99f1-4f4c-af1f-c4bf3fc295d3 => generated 1279 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 08:53:19.057739 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [req-1dc3b9f9-4096-4819-83d3-ff8ab3598287 req-8641c3ed-ee86-4e73-b663-82e9cd3a8d05 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4e972e2b-7b5e-4a5f-87a1-3642aad3ac24", "tag": "59575408-22b1-4ee7-9c81-bef3610d56b7"}]} {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 29 08:53:19.107677 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [req-1dc3b9f9-4096-4819-83d3-ff8ab3598287 req-8641c3ed-ee86-4e73-b663-82e9cd3a8d05 service nova] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:53:19.110156 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [req-1dc3b9f9-4096-4819-83d3-ff8ab3598287 req-8641c3ed-ee86-4e73-b663-82e9cd3a8d05 service nova] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:53:19.142721 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.compute.server_external_events [req-1dc3b9f9-4096-4819-83d3-ff8ab3598287 req-8641c3ed-ee86-4e73-b663-82e9cd3a8d05 service nova] Creating event network-changed:59575408-22b1-4ee7-9c81-bef3610d56b7 for instance 4e972e2b-7b5e-4a5f-87a1-3642aad3ac24 on hv-cinder-83987 Apr 29 08:53:19.158870 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [req-1dc3b9f9-4096-4819-83d3-ff8ab3598287 req-8641c3ed-ee86-4e73-b663-82e9cd3a8d05 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.111871 Apr 29 08:53:19.164419 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 123/237] 10.222.0.31 () {64 vars in 1317 bytes} [Fri Apr 29 08:53:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 29 08:53:19.389860 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-5bf08b03-80fb-48dc-bd00-3449f1d9aede tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Calling method '>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:53:19.391072 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-5bf08b03-80fb-48dc-bd00-3449f1d9aede tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] [instance: 8715736d-99f1-4f4c-af1f-c4bf3fc295d3] Fetching instance by UUID {{(pid=123459) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:53:19.397908 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-5bf08b03-80fb-48dc-bd00-3449f1d9aede tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:53:19.398611 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-5bf08b03-80fb-48dc-bd00-3449f1d9aede tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:53:19.399627 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-5bf08b03-80fb-48dc-bd00-3449f1d9aede tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:53:19.400344 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-5bf08b03-80fb-48dc-bd00-3449f1d9aede tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:53:19.780210 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-5bf08b03-80fb-48dc-bd00-3449f1d9aede tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c18e88436f14dc7a2001220b87ce9ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60998f08c40446e787ead285e40665b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:53:19.791015 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-5bf08b03-80fb-48dc-bd00-3449f1d9aede tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] 10.222.0.31 "GET /compute/v2.1/servers/8715736d-99f1-4f4c-af1f-c4bf3fc295d3" status: 200 len: 1321 microversion: 2.1 time: 0.407925 Apr 29 08:53:19.811401 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 115/238] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 08:53:19 2022] GET /compute/v2.1/servers/8715736d-99f1-4f4c-af1f-c4bf3fc295d3 => generated 1321 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 08:53:20.570932 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [req-4eb4d3b4-df32-4627-903d-04b4eb1e900a req-fd16119f-f21e-4c72-afff-e1605dca3e70 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8715736d-99f1-4f4c-af1f-c4bf3fc295d3", "tag": "4011c2e6-769b-4586-8b40-1da7764504df"}]} {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 29 08:53:20.581518 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [req-4eb4d3b4-df32-4627-903d-04b4eb1e900a req-fd16119f-f21e-4c72-afff-e1605dca3e70 service nova] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:53:20.581942 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [req-4eb4d3b4-df32-4627-903d-04b4eb1e900a req-fd16119f-f21e-4c72-afff-e1605dca3e70 service nova] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:53:20.602118 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.compute.server_external_events [req-4eb4d3b4-df32-4627-903d-04b4eb1e900a req-fd16119f-f21e-4c72-afff-e1605dca3e70 service nova] Creating event network-changed:4011c2e6-769b-4586-8b40-1da7764504df for instance 8715736d-99f1-4f4c-af1f-c4bf3fc295d3 on hv-cinder-83987 Apr 29 08:53:20.610309 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [req-4eb4d3b4-df32-4627-903d-04b4eb1e900a req-fd16119f-f21e-4c72-afff-e1605dca3e70 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043231 Apr 29 08:53:20.611506 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 124/239] 10.222.0.31 () {64 vars in 1317 bytes} [Fri Apr 29 08:53:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 29 08:53:20.812762 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-9f6952a8-2294-45c9-b775-e94a47b305f2 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Calling method '>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:53:20.813382 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-9f6952a8-2294-45c9-b775-e94a47b305f2 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] [instance: 8715736d-99f1-4f4c-af1f-c4bf3fc295d3] Fetching instance by UUID {{(pid=123459) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:53:20.820349 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-9f6952a8-2294-45c9-b775-e94a47b305f2 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:53:20.820798 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-9f6952a8-2294-45c9-b775-e94a47b305f2 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:53:20.821584 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-9f6952a8-2294-45c9-b775-e94a47b305f2 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:53:20.822016 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-9f6952a8-2294-45c9-b775-e94a47b305f2 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:53:21.016675 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-9f6952a8-2294-45c9-b775-e94a47b305f2 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c18e88436f14dc7a2001220b87ce9ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60998f08c40446e787ead285e40665b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:53:21.024315 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-9f6952a8-2294-45c9-b775-e94a47b305f2 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] 10.222.0.31 "GET /compute/v2.1/servers/8715736d-99f1-4f4c-af1f-c4bf3fc295d3" status: 200 len: 1321 microversion: 2.1 time: 0.216423 Apr 29 08:53:21.025150 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 116/240] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 08:53:20 2022] GET /compute/v2.1/servers/8715736d-99f1-4f4c-af1f-c4bf3fc295d3 => generated 1321 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 08:53:22.046727 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-21505e1c-82cd-4bfc-b358-fa2acab2197a tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Calling method '>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:53:22.048458 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-21505e1c-82cd-4bfc-b358-fa2acab2197a tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] [instance: 8715736d-99f1-4f4c-af1f-c4bf3fc295d3] Fetching instance by UUID {{(pid=123458) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:53:22.069855 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-21505e1c-82cd-4bfc-b358-fa2acab2197a tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:53:22.069855 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-21505e1c-82cd-4bfc-b358-fa2acab2197a tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:53:22.070043 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-21505e1c-82cd-4bfc-b358-fa2acab2197a tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:53:22.070811 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-21505e1c-82cd-4bfc-b358-fa2acab2197a tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:53:22.276358 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-21505e1c-82cd-4bfc-b358-fa2acab2197a tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c18e88436f14dc7a2001220b87ce9ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60998f08c40446e787ead285e40665b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:53:22.291796 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-21505e1c-82cd-4bfc-b358-fa2acab2197a tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] 10.222.0.31 "GET /compute/v2.1/servers/8715736d-99f1-4f4c-af1f-c4bf3fc295d3" status: 200 len: 1321 microversion: 2.1 time: 0.252525 Apr 29 08:53:22.293737 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 125/241] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 08:53:22 2022] GET /compute/v2.1/servers/8715736d-99f1-4f4c-af1f-c4bf3fc295d3 => generated 1321 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 08:53:23.310481 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-820de7fe-3647-4327-97cd-6f95a5681a4b tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Calling method '>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:53:23.311798 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-820de7fe-3647-4327-97cd-6f95a5681a4b tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] [instance: 8715736d-99f1-4f4c-af1f-c4bf3fc295d3] Fetching instance by UUID {{(pid=123459) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:53:23.328975 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-820de7fe-3647-4327-97cd-6f95a5681a4b tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:53:23.330033 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-820de7fe-3647-4327-97cd-6f95a5681a4b tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:53:23.331329 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-820de7fe-3647-4327-97cd-6f95a5681a4b tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:53:23.332039 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-820de7fe-3647-4327-97cd-6f95a5681a4b tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:53:24.078402 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-820de7fe-3647-4327-97cd-6f95a5681a4b tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c18e88436f14dc7a2001220b87ce9ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60998f08c40446e787ead285e40665b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:53:24.093725 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-820de7fe-3647-4327-97cd-6f95a5681a4b tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] 10.222.0.31 "GET /compute/v2.1/servers/8715736d-99f1-4f4c-af1f-c4bf3fc295d3" status: 200 len: 1321 microversion: 2.1 time: 0.786864 Apr 29 08:53:24.108455 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 117/242] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 08:53:23 2022] GET /compute/v2.1/servers/8715736d-99f1-4f4c-af1f-c4bf3fc295d3 => generated 1321 bytes in 801 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 08:53:25.110947 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-09627914-d520-4d7c-835d-0f61f4b8f8aa tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Calling method '>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:53:25.111974 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-09627914-d520-4d7c-835d-0f61f4b8f8aa tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] [instance: 8715736d-99f1-4f4c-af1f-c4bf3fc295d3] Fetching instance by UUID {{(pid=123458) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:53:25.118299 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-09627914-d520-4d7c-835d-0f61f4b8f8aa tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:53:25.118744 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-09627914-d520-4d7c-835d-0f61f4b8f8aa tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:53:25.119649 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-09627914-d520-4d7c-835d-0f61f4b8f8aa tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:53:25.120175 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-09627914-d520-4d7c-835d-0f61f4b8f8aa tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:53:25.279320 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-09627914-d520-4d7c-835d-0f61f4b8f8aa tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c18e88436f14dc7a2001220b87ce9ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60998f08c40446e787ead285e40665b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:53:25.286874 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-09627914-d520-4d7c-835d-0f61f4b8f8aa tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] 10.222.0.31 "GET /compute/v2.1/servers/8715736d-99f1-4f4c-af1f-c4bf3fc295d3" status: 200 len: 1321 microversion: 2.1 time: 0.180049 Apr 29 08:53:25.287456 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 126/243] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 08:53:25 2022] GET /compute/v2.1/servers/8715736d-99f1-4f4c-af1f-c4bf3fc295d3 => generated 1321 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 08:53:25.458282 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [req-7abf6966-4552-4439-87d2-3f676e6b9825 req-1929301a-500d-4954-a999-9aa203db9279 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4e972e2b-7b5e-4a5f-87a1-3642aad3ac24", "name": "network-vif-plugged", "status": "completed", "tag": "59575408-22b1-4ee7-9c81-bef3610d56b7"}]} {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 29 08:53:25.467576 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [req-7abf6966-4552-4439-87d2-3f676e6b9825 req-1929301a-500d-4954-a999-9aa203db9279 service nova] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:53:25.468017 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [req-7abf6966-4552-4439-87d2-3f676e6b9825 req-1929301a-500d-4954-a999-9aa203db9279 service nova] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:53:25.479806 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.compute.server_external_events [req-7abf6966-4552-4439-87d2-3f676e6b9825 req-1929301a-500d-4954-a999-9aa203db9279 service nova] Creating event network-vif-plugged:59575408-22b1-4ee7-9c81-bef3610d56b7 for instance 4e972e2b-7b5e-4a5f-87a1-3642aad3ac24 on hv-cinder-83987 Apr 29 08:53:25.485995 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [req-7abf6966-4552-4439-87d2-3f676e6b9825 req-1929301a-500d-4954-a999-9aa203db9279 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039118 Apr 29 08:53:25.486594 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 118/244] 10.222.0.31 () {64 vars in 1317 bytes} [Fri Apr 29 08:53:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 29 08:53:26.304855 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-40ced445-e152-44f0-ad80-e21a51dd22b8 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Calling method '>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:53:26.305460 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-40ced445-e152-44f0-ad80-e21a51dd22b8 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] [instance: 8715736d-99f1-4f4c-af1f-c4bf3fc295d3] Fetching instance by UUID {{(pid=123458) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:53:26.311990 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-40ced445-e152-44f0-ad80-e21a51dd22b8 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:53:26.312480 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-40ced445-e152-44f0-ad80-e21a51dd22b8 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:53:26.313237 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-40ced445-e152-44f0-ad80-e21a51dd22b8 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:53:26.313665 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-40ced445-e152-44f0-ad80-e21a51dd22b8 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:53:26.444101 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-40ced445-e152-44f0-ad80-e21a51dd22b8 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c18e88436f14dc7a2001220b87ce9ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60998f08c40446e787ead285e40665b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:53:26.451981 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-40ced445-e152-44f0-ad80-e21a51dd22b8 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] 10.222.0.31 "GET /compute/v2.1/servers/8715736d-99f1-4f4c-af1f-c4bf3fc295d3" status: 200 len: 1321 microversion: 2.1 time: 0.150936 Apr 29 08:53:26.452587 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 127/245] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 08:53:26 2022] GET /compute/v2.1/servers/8715736d-99f1-4f4c-af1f-c4bf3fc295d3 => generated 1321 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 08:53:27.475523 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-ce90b558-84d9-43a2-88ff-ad5020242554 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Calling method '>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:53:27.476250 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-ce90b558-84d9-43a2-88ff-ad5020242554 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] [instance: 8715736d-99f1-4f4c-af1f-c4bf3fc295d3] Fetching instance by UUID {{(pid=123459) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:53:27.483631 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-ce90b558-84d9-43a2-88ff-ad5020242554 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:53:27.484075 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-ce90b558-84d9-43a2-88ff-ad5020242554 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:53:27.484885 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-ce90b558-84d9-43a2-88ff-ad5020242554 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:53:27.485452 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-ce90b558-84d9-43a2-88ff-ad5020242554 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:53:27.619968 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-ce90b558-84d9-43a2-88ff-ad5020242554 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c18e88436f14dc7a2001220b87ce9ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60998f08c40446e787ead285e40665b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:53:27.628439 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-ce90b558-84d9-43a2-88ff-ad5020242554 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] 10.222.0.31 "GET /compute/v2.1/servers/8715736d-99f1-4f4c-af1f-c4bf3fc295d3" status: 200 len: 1321 microversion: 2.1 time: 0.157687 Apr 29 08:53:27.629000 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 119/246] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 08:53:27 2022] GET /compute/v2.1/servers/8715736d-99f1-4f4c-af1f-c4bf3fc295d3 => generated 1321 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 08:53:28.645266 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-a621661c-d6e0-4217-b7cb-c519a2381528 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Calling method '>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:53:28.645873 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-a621661c-d6e0-4217-b7cb-c519a2381528 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] [instance: 8715736d-99f1-4f4c-af1f-c4bf3fc295d3] Fetching instance by UUID {{(pid=123458) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:53:28.651857 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-a621661c-d6e0-4217-b7cb-c519a2381528 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:53:28.652350 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-a621661c-d6e0-4217-b7cb-c519a2381528 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:53:28.653394 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-a621661c-d6e0-4217-b7cb-c519a2381528 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:53:28.653837 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-a621661c-d6e0-4217-b7cb-c519a2381528 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:53:28.783209 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-a621661c-d6e0-4217-b7cb-c519a2381528 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c18e88436f14dc7a2001220b87ce9ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60998f08c40446e787ead285e40665b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:53:28.790287 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-a621661c-d6e0-4217-b7cb-c519a2381528 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] 10.222.0.31 "GET /compute/v2.1/servers/8715736d-99f1-4f4c-af1f-c4bf3fc295d3" status: 200 len: 1321 microversion: 2.1 time: 0.148820 Apr 29 08:53:28.790858 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 128/247] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 08:53:28 2022] GET /compute/v2.1/servers/8715736d-99f1-4f4c-af1f-c4bf3fc295d3 => generated 1321 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 08:53:29.806714 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-ce4bfdbf-fbd2-4546-89c0-af3b4134ea14 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Calling method '>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:53:29.807316 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-ce4bfdbf-fbd2-4546-89c0-af3b4134ea14 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] [instance: 8715736d-99f1-4f4c-af1f-c4bf3fc295d3] Fetching instance by UUID {{(pid=123459) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:53:29.814360 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-ce4bfdbf-fbd2-4546-89c0-af3b4134ea14 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:53:29.814801 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-ce4bfdbf-fbd2-4546-89c0-af3b4134ea14 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:53:29.815559 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-ce4bfdbf-fbd2-4546-89c0-af3b4134ea14 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:53:29.815998 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-ce4bfdbf-fbd2-4546-89c0-af3b4134ea14 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:53:29.943326 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-ce4bfdbf-fbd2-4546-89c0-af3b4134ea14 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c18e88436f14dc7a2001220b87ce9ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60998f08c40446e787ead285e40665b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:53:29.950869 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-ce4bfdbf-fbd2-4546-89c0-af3b4134ea14 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] 10.222.0.31 "GET /compute/v2.1/servers/8715736d-99f1-4f4c-af1f-c4bf3fc295d3" status: 200 len: 1321 microversion: 2.1 time: 0.148014 Apr 29 08:53:29.951437 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 120/248] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 08:53:29 2022] GET /compute/v2.1/servers/8715736d-99f1-4f4c-af1f-c4bf3fc295d3 => generated 1321 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 08:53:30.967258 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-9a47ef12-8903-4f4b-b855-44fa7b9fdf67 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Calling method '>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:53:30.968167 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-9a47ef12-8903-4f4b-b855-44fa7b9fdf67 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] [instance: 8715736d-99f1-4f4c-af1f-c4bf3fc295d3] Fetching instance by UUID {{(pid=123458) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:53:30.974371 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-9a47ef12-8903-4f4b-b855-44fa7b9fdf67 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:53:30.974828 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-9a47ef12-8903-4f4b-b855-44fa7b9fdf67 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:53:30.975597 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-9a47ef12-8903-4f4b-b855-44fa7b9fdf67 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:53:30.976065 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-9a47ef12-8903-4f4b-b855-44fa7b9fdf67 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:53:31.119636 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-9a47ef12-8903-4f4b-b855-44fa7b9fdf67 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c18e88436f14dc7a2001220b87ce9ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60998f08c40446e787ead285e40665b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:53:31.128067 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-9a47ef12-8903-4f4b-b855-44fa7b9fdf67 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] 10.222.0.31 "GET /compute/v2.1/servers/8715736d-99f1-4f4c-af1f-c4bf3fc295d3" status: 200 len: 1321 microversion: 2.1 time: 0.164967 Apr 29 08:53:31.128664 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 129/249] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 08:53:30 2022] GET /compute/v2.1/servers/8715736d-99f1-4f4c-af1f-c4bf3fc295d3 => generated 1321 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 08:53:32.145674 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-7163b7cc-d422-4555-973d-91b5ee920451 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Calling method '>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:53:32.146295 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-7163b7cc-d422-4555-973d-91b5ee920451 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] [instance: 8715736d-99f1-4f4c-af1f-c4bf3fc295d3] Fetching instance by UUID {{(pid=123459) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:53:32.153495 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-7163b7cc-d422-4555-973d-91b5ee920451 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:53:32.153942 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-7163b7cc-d422-4555-973d-91b5ee920451 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:53:32.154728 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-7163b7cc-d422-4555-973d-91b5ee920451 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:53:32.155164 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-7163b7cc-d422-4555-973d-91b5ee920451 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:53:32.321182 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-7163b7cc-d422-4555-973d-91b5ee920451 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c18e88436f14dc7a2001220b87ce9ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60998f08c40446e787ead285e40665b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:53:32.329684 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-7163b7cc-d422-4555-973d-91b5ee920451 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] 10.222.0.31 "GET /compute/v2.1/servers/8715736d-99f1-4f4c-af1f-c4bf3fc295d3" status: 200 len: 1321 microversion: 2.1 time: 0.188348 Apr 29 08:53:32.330283 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 121/250] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 08:53:32 2022] GET /compute/v2.1/servers/8715736d-99f1-4f4c-af1f-c4bf3fc295d3 => generated 1321 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 08:53:33.353733 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-ec2474a5-bb0a-4ab6-a9cd-382d16986ea9 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Calling method '>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:53:33.354827 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-ec2474a5-bb0a-4ab6-a9cd-382d16986ea9 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] [instance: 8715736d-99f1-4f4c-af1f-c4bf3fc295d3] Fetching instance by UUID {{(pid=123458) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:53:33.370640 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-ec2474a5-bb0a-4ab6-a9cd-382d16986ea9 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:53:33.373301 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-ec2474a5-bb0a-4ab6-a9cd-382d16986ea9 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:53:33.375410 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-ec2474a5-bb0a-4ab6-a9cd-382d16986ea9 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:53:33.375993 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-ec2474a5-bb0a-4ab6-a9cd-382d16986ea9 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:53:33.548199 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-ec2474a5-bb0a-4ab6-a9cd-382d16986ea9 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c18e88436f14dc7a2001220b87ce9ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60998f08c40446e787ead285e40665b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:53:33.556438 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-ec2474a5-bb0a-4ab6-a9cd-382d16986ea9 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] 10.222.0.31 "GET /compute/v2.1/servers/8715736d-99f1-4f4c-af1f-c4bf3fc295d3" status: 200 len: 1321 microversion: 2.1 time: 0.211104 Apr 29 08:53:33.557136 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 130/251] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 08:53:33 2022] GET /compute/v2.1/servers/8715736d-99f1-4f4c-af1f-c4bf3fc295d3 => generated 1321 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 08:53:34.573987 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-178dfcbb-7b90-4f94-9d4d-e3415c20031a tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Calling method '>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:53:34.574691 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-178dfcbb-7b90-4f94-9d4d-e3415c20031a tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] [instance: 8715736d-99f1-4f4c-af1f-c4bf3fc295d3] Fetching instance by UUID {{(pid=123459) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:53:34.582499 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-178dfcbb-7b90-4f94-9d4d-e3415c20031a tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:53:34.582922 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-178dfcbb-7b90-4f94-9d4d-e3415c20031a tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:53:34.583848 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-178dfcbb-7b90-4f94-9d4d-e3415c20031a tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:53:34.584513 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-178dfcbb-7b90-4f94-9d4d-e3415c20031a tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:53:34.759737 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-178dfcbb-7b90-4f94-9d4d-e3415c20031a tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c18e88436f14dc7a2001220b87ce9ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60998f08c40446e787ead285e40665b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:53:34.769618 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-178dfcbb-7b90-4f94-9d4d-e3415c20031a tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] 10.222.0.31 "GET /compute/v2.1/servers/8715736d-99f1-4f4c-af1f-c4bf3fc295d3" status: 200 len: 1321 microversion: 2.1 time: 0.199043 Apr 29 08:53:34.787154 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 122/252] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 08:53:34 2022] GET /compute/v2.1/servers/8715736d-99f1-4f4c-af1f-c4bf3fc295d3 => generated 1321 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 08:53:35.800554 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-9ed8fa47-2bf9-458f-8b56-41fbaabd2113 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Calling method '>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:53:35.802171 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-9ed8fa47-2bf9-458f-8b56-41fbaabd2113 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] [instance: 8715736d-99f1-4f4c-af1f-c4bf3fc295d3] Fetching instance by UUID {{(pid=123458) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:53:35.807480 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-9ed8fa47-2bf9-458f-8b56-41fbaabd2113 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:53:35.807925 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-9ed8fa47-2bf9-458f-8b56-41fbaabd2113 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:53:35.809165 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-9ed8fa47-2bf9-458f-8b56-41fbaabd2113 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:53:35.809605 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-9ed8fa47-2bf9-458f-8b56-41fbaabd2113 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:53:35.982611 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-9ed8fa47-2bf9-458f-8b56-41fbaabd2113 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c18e88436f14dc7a2001220b87ce9ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60998f08c40446e787ead285e40665b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:53:35.991033 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-9ed8fa47-2bf9-458f-8b56-41fbaabd2113 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] 10.222.0.31 "GET /compute/v2.1/servers/8715736d-99f1-4f4c-af1f-c4bf3fc295d3" status: 200 len: 1321 microversion: 2.1 time: 0.199746 Apr 29 08:53:35.991824 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 131/253] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 08:53:35 2022] GET /compute/v2.1/servers/8715736d-99f1-4f4c-af1f-c4bf3fc295d3 => generated 1321 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 08:53:36.817007 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [req-edad2e26-7c11-4bd5-b117-e16ea04c7e06 req-4c7c28f4-cce2-47e5-967c-92e81f79ed32 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8715736d-99f1-4f4c-af1f-c4bf3fc295d3", "name": "network-vif-plugged", "status": "completed", "tag": "4011c2e6-769b-4586-8b40-1da7764504df"}]} {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 29 08:53:36.846109 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [req-edad2e26-7c11-4bd5-b117-e16ea04c7e06 req-4c7c28f4-cce2-47e5-967c-92e81f79ed32 service nova] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:53:36.848383 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [req-edad2e26-7c11-4bd5-b117-e16ea04c7e06 req-4c7c28f4-cce2-47e5-967c-92e81f79ed32 service nova] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:53:36.886873 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.compute.server_external_events [req-edad2e26-7c11-4bd5-b117-e16ea04c7e06 req-4c7c28f4-cce2-47e5-967c-92e81f79ed32 service nova] Creating event network-vif-plugged:4011c2e6-769b-4586-8b40-1da7764504df for instance 8715736d-99f1-4f4c-af1f-c4bf3fc295d3 on hv-cinder-83987 Apr 29 08:53:36.900200 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [req-edad2e26-7c11-4bd5-b117-e16ea04c7e06 req-4c7c28f4-cce2-47e5-967c-92e81f79ed32 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091861 Apr 29 08:53:36.903928 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 123/254] 10.222.0.31 () {64 vars in 1317 bytes} [Fri Apr 29 08:53:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 29 08:53:37.010096 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-09d84122-d23d-4464-9ff0-abec0c11237b tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Calling method '>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:53:37.011331 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-09d84122-d23d-4464-9ff0-abec0c11237b tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] [instance: 8715736d-99f1-4f4c-af1f-c4bf3fc295d3] Fetching instance by UUID {{(pid=123458) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:53:37.020835 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-09d84122-d23d-4464-9ff0-abec0c11237b tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:53:37.021456 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-09d84122-d23d-4464-9ff0-abec0c11237b tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:53:37.022651 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-09d84122-d23d-4464-9ff0-abec0c11237b tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:53:37.023257 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-09d84122-d23d-4464-9ff0-abec0c11237b tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:53:37.223447 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-09d84122-d23d-4464-9ff0-abec0c11237b tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c18e88436f14dc7a2001220b87ce9ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60998f08c40446e787ead285e40665b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:53:37.233224 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-09d84122-d23d-4464-9ff0-abec0c11237b tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] 10.222.0.31 "GET /compute/v2.1/servers/8715736d-99f1-4f4c-af1f-c4bf3fc295d3" status: 200 len: 1321 microversion: 2.1 time: 0.226634 Apr 29 08:53:37.244309 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 132/255] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 08:53:37 2022] GET /compute/v2.1/servers/8715736d-99f1-4f4c-af1f-c4bf3fc295d3 => generated 1321 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 08:53:38.261405 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-f0ee17ba-685b-4261-ba3e-e0f64d41031d tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Calling method '>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:53:38.262299 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-f0ee17ba-685b-4261-ba3e-e0f64d41031d tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] [instance: 8715736d-99f1-4f4c-af1f-c4bf3fc295d3] Fetching instance by UUID {{(pid=123459) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:53:38.270417 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-f0ee17ba-685b-4261-ba3e-e0f64d41031d tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:53:38.270864 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-f0ee17ba-685b-4261-ba3e-e0f64d41031d tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:53:38.271816 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-f0ee17ba-685b-4261-ba3e-e0f64d41031d tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:53:38.272458 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-f0ee17ba-685b-4261-ba3e-e0f64d41031d tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:53:38.688203 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-f0ee17ba-685b-4261-ba3e-e0f64d41031d tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c18e88436f14dc7a2001220b87ce9ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60998f08c40446e787ead285e40665b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:53:38.700829 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-f0ee17ba-685b-4261-ba3e-e0f64d41031d tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] 10.222.0.31 "GET /compute/v2.1/servers/8715736d-99f1-4f4c-af1f-c4bf3fc295d3" status: 200 len: 1321 microversion: 2.1 time: 0.443557 Apr 29 08:53:38.713326 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 124/256] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 08:53:38 2022] GET /compute/v2.1/servers/8715736d-99f1-4f4c-af1f-c4bf3fc295d3 => generated 1321 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 08:53:39.722575 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-ae2d660f-2aff-435b-8040-5ecd9c3f9a17 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Calling method '>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:53:39.723915 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-ae2d660f-2aff-435b-8040-5ecd9c3f9a17 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] [instance: 8715736d-99f1-4f4c-af1f-c4bf3fc295d3] Fetching instance by UUID {{(pid=123458) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:53:39.742950 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-ae2d660f-2aff-435b-8040-5ecd9c3f9a17 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:53:39.744874 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-ae2d660f-2aff-435b-8040-5ecd9c3f9a17 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:53:39.745783 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-ae2d660f-2aff-435b-8040-5ecd9c3f9a17 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:53:39.746433 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-ae2d660f-2aff-435b-8040-5ecd9c3f9a17 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:53:39.901226 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-ae2d660f-2aff-435b-8040-5ecd9c3f9a17 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c18e88436f14dc7a2001220b87ce9ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60998f08c40446e787ead285e40665b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:53:39.911242 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-ae2d660f-2aff-435b-8040-5ecd9c3f9a17 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] 10.222.0.31 "GET /compute/v2.1/servers/8715736d-99f1-4f4c-af1f-c4bf3fc295d3" status: 200 len: 1516 microversion: 2.1 time: 0.196448 Apr 29 08:53:39.912238 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 133/257] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 08:53:39 2022] GET /compute/v2.1/servers/8715736d-99f1-4f4c-af1f-c4bf3fc295d3 => generated 1516 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 08:53:39.928654 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-92534148-c7d8-4f03-a10b-e2628914d081 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 29 08:53:39.929717 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-92534148-c7d8-4f03-a10b-e2628914d081 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] [instance: 8715736d-99f1-4f4c-af1f-c4bf3fc295d3] Fetching instance by UUID {{(pid=123459) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:53:39.938058 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-92534148-c7d8-4f03-a10b-e2628914d081 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:53:39.938877 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-92534148-c7d8-4f03-a10b-e2628914d081 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:53:39.940647 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-92534148-c7d8-4f03-a10b-e2628914d081 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:53:39.940647 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-92534148-c7d8-4f03-a10b-e2628914d081 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:53:39.968060 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.objects.instance [None req-92534148-c7d8-4f03-a10b-e2628914d081 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lazy-loading 'flavor' on Instance uuid 8715736d-99f1-4f4c-af1f-c4bf3fc295d3 {{(pid=123459) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 29 08:53:40.135364 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-92534148-c7d8-4f03-a10b-e2628914d081 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] 10.222.0.31 "POST /compute/v2.1/servers/8715736d-99f1-4f4c-af1f-c4bf3fc295d3/action" status: 200 len: 32 microversion: 2.1 time: 0.210528 Apr 29 08:53:40.138345 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 125/258] 10.222.0.31 () {60 vars in 1277 bytes} [Fri Apr 29 08:53:39 2022] POST /compute/v2.1/servers/8715736d-99f1-4f4c-af1f-c4bf3fc295d3/action => generated 32 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 29 08:53:40.152190 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-7c0d7519-fa7d-4aae-9f93-46e9904f78c3 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Calling method '>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:53:40.152819 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-7c0d7519-fa7d-4aae-9f93-46e9904f78c3 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] [instance: 8715736d-99f1-4f4c-af1f-c4bf3fc295d3] Fetching instance by UUID {{(pid=123458) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:53:40.168470 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-7c0d7519-fa7d-4aae-9f93-46e9904f78c3 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:53:40.170069 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-7c0d7519-fa7d-4aae-9f93-46e9904f78c3 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:53:40.179944 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-7c0d7519-fa7d-4aae-9f93-46e9904f78c3 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:53:40.180439 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-7c0d7519-fa7d-4aae-9f93-46e9904f78c3 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:53:40.421232 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-7c0d7519-fa7d-4aae-9f93-46e9904f78c3 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c18e88436f14dc7a2001220b87ce9ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60998f08c40446e787ead285e40665b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:53:40.433556 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-7c0d7519-fa7d-4aae-9f93-46e9904f78c3 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] 10.222.0.31 "GET /compute/v2.1/servers/8715736d-99f1-4f4c-af1f-c4bf3fc295d3" status: 200 len: 1522 microversion: 2.1 time: 0.288257 Apr 29 08:53:40.437292 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 134/259] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 08:53:40 2022] GET /compute/v2.1/servers/8715736d-99f1-4f4c-af1f-c4bf3fc295d3 => generated 1522 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 08:53:41.457833 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-02eb023f-367f-4663-ab05-84c0e9bb01e4 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Calling method '>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:53:41.459182 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-02eb023f-367f-4663-ab05-84c0e9bb01e4 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] [instance: 8715736d-99f1-4f4c-af1f-c4bf3fc295d3] Fetching instance by UUID {{(pid=123459) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:53:41.468472 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-02eb023f-367f-4663-ab05-84c0e9bb01e4 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:53:41.469082 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-02eb023f-367f-4663-ab05-84c0e9bb01e4 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:53:41.470318 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-02eb023f-367f-4663-ab05-84c0e9bb01e4 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:53:41.470872 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-02eb023f-367f-4663-ab05-84c0e9bb01e4 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:53:41.736208 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-02eb023f-367f-4663-ab05-84c0e9bb01e4 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c18e88436f14dc7a2001220b87ce9ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60998f08c40446e787ead285e40665b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:53:41.747887 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-02eb023f-367f-4663-ab05-84c0e9bb01e4 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] 10.222.0.31 "GET /compute/v2.1/servers/8715736d-99f1-4f4c-af1f-c4bf3fc295d3" status: 200 len: 1522 microversion: 2.1 time: 0.294747 Apr 29 08:53:41.757735 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 126/260] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 08:53:41 2022] GET /compute/v2.1/servers/8715736d-99f1-4f4c-af1f-c4bf3fc295d3 => generated 1522 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 08:53:42.768581 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-841a0512-9b0f-45d2-b00d-a2a690a1eb86 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Calling method '>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:53:42.769975 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-841a0512-9b0f-45d2-b00d-a2a690a1eb86 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] [instance: 8715736d-99f1-4f4c-af1f-c4bf3fc295d3] Fetching instance by UUID {{(pid=123458) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:53:42.776992 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-841a0512-9b0f-45d2-b00d-a2a690a1eb86 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:53:42.777441 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-841a0512-9b0f-45d2-b00d-a2a690a1eb86 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:53:42.778552 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-841a0512-9b0f-45d2-b00d-a2a690a1eb86 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:53:42.779056 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-841a0512-9b0f-45d2-b00d-a2a690a1eb86 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:53:43.023017 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-841a0512-9b0f-45d2-b00d-a2a690a1eb86 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c18e88436f14dc7a2001220b87ce9ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60998f08c40446e787ead285e40665b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:53:43.033828 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-841a0512-9b0f-45d2-b00d-a2a690a1eb86 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] 10.222.0.31 "GET /compute/v2.1/servers/8715736d-99f1-4f4c-af1f-c4bf3fc295d3" status: 200 len: 1522 microversion: 2.1 time: 0.270418 Apr 29 08:53:43.034751 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 135/261] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 08:53:42 2022] GET /compute/v2.1/servers/8715736d-99f1-4f4c-af1f-c4bf3fc295d3 => generated 1522 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 08:53:44.053567 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-a6a8b203-6312-4aa0-99af-af85c09d013b tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Calling method '>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:53:44.054182 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-a6a8b203-6312-4aa0-99af-af85c09d013b tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] [instance: 8715736d-99f1-4f4c-af1f-c4bf3fc295d3] Fetching instance by UUID {{(pid=123459) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:53:44.067577 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-a6a8b203-6312-4aa0-99af-af85c09d013b tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:53:44.068122 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-a6a8b203-6312-4aa0-99af-af85c09d013b tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:53:44.069679 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-a6a8b203-6312-4aa0-99af-af85c09d013b tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:53:44.071108 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-a6a8b203-6312-4aa0-99af-af85c09d013b tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:53:44.300504 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-a6a8b203-6312-4aa0-99af-af85c09d013b tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c18e88436f14dc7a2001220b87ce9ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60998f08c40446e787ead285e40665b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:53:44.317962 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-a6a8b203-6312-4aa0-99af-af85c09d013b tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] 10.222.0.31 "GET /compute/v2.1/servers/8715736d-99f1-4f4c-af1f-c4bf3fc295d3" status: 200 len: 1522 microversion: 2.1 time: 0.269922 Apr 29 08:53:44.319232 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 127/262] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 08:53:44 2022] GET /compute/v2.1/servers/8715736d-99f1-4f4c-af1f-c4bf3fc295d3 => generated 1522 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 08:53:45.344453 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-656e0180-bd4b-4934-8f57-0a388ea6b24b tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Calling method '>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:53:45.345166 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-656e0180-bd4b-4934-8f57-0a388ea6b24b tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] [instance: 8715736d-99f1-4f4c-af1f-c4bf3fc295d3] Fetching instance by UUID {{(pid=123458) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:53:45.354995 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-656e0180-bd4b-4934-8f57-0a388ea6b24b tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:53:45.355455 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-656e0180-bd4b-4934-8f57-0a388ea6b24b tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:53:45.356284 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-656e0180-bd4b-4934-8f57-0a388ea6b24b tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:53:45.356726 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-656e0180-bd4b-4934-8f57-0a388ea6b24b tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:53:45.515996 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-656e0180-bd4b-4934-8f57-0a388ea6b24b tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c18e88436f14dc7a2001220b87ce9ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60998f08c40446e787ead285e40665b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:53:45.526245 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-656e0180-bd4b-4934-8f57-0a388ea6b24b tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] 10.222.0.31 "GET /compute/v2.1/servers/8715736d-99f1-4f4c-af1f-c4bf3fc295d3" status: 200 len: 1522 microversion: 2.1 time: 0.186243 Apr 29 08:53:45.527339 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 136/263] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 08:53:45 2022] GET /compute/v2.1/servers/8715736d-99f1-4f4c-af1f-c4bf3fc295d3 => generated 1522 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 08:53:46.545358 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-ad28409a-ccd1-4e24-966c-84689a0ac4a8 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Calling method '>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:53:46.546930 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-ad28409a-ccd1-4e24-966c-84689a0ac4a8 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] [instance: 8715736d-99f1-4f4c-af1f-c4bf3fc295d3] Fetching instance by UUID {{(pid=123459) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:53:46.575383 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-ad28409a-ccd1-4e24-966c-84689a0ac4a8 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:53:46.577444 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-ad28409a-ccd1-4e24-966c-84689a0ac4a8 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:53:46.578405 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-ad28409a-ccd1-4e24-966c-84689a0ac4a8 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:53:46.579021 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-ad28409a-ccd1-4e24-966c-84689a0ac4a8 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:53:46.838445 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-ad28409a-ccd1-4e24-966c-84689a0ac4a8 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c18e88436f14dc7a2001220b87ce9ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60998f08c40446e787ead285e40665b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:53:46.850114 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-ad28409a-ccd1-4e24-966c-84689a0ac4a8 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] 10.222.0.31 "GET /compute/v2.1/servers/8715736d-99f1-4f4c-af1f-c4bf3fc295d3" status: 200 len: 1522 microversion: 2.1 time: 0.309041 Apr 29 08:53:46.851087 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 128/264] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 08:53:46 2022] GET /compute/v2.1/servers/8715736d-99f1-4f4c-af1f-c4bf3fc295d3 => generated 1522 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 08:53:47.867586 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-75c42131-9e7e-4f98-8a0e-cb662c9c152c tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Calling method '>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:53:47.868928 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-75c42131-9e7e-4f98-8a0e-cb662c9c152c tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] [instance: 8715736d-99f1-4f4c-af1f-c4bf3fc295d3] Fetching instance by UUID {{(pid=123458) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:53:47.887250 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-75c42131-9e7e-4f98-8a0e-cb662c9c152c tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:53:47.887705 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-75c42131-9e7e-4f98-8a0e-cb662c9c152c tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:53:47.890319 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-75c42131-9e7e-4f98-8a0e-cb662c9c152c tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:53:47.893347 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-75c42131-9e7e-4f98-8a0e-cb662c9c152c tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:53:48.096545 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-75c42131-9e7e-4f98-8a0e-cb662c9c152c tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c18e88436f14dc7a2001220b87ce9ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60998f08c40446e787ead285e40665b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:53:48.115400 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-75c42131-9e7e-4f98-8a0e-cb662c9c152c tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] 10.222.0.31 "GET /compute/v2.1/servers/8715736d-99f1-4f4c-af1f-c4bf3fc295d3" status: 200 len: 1522 microversion: 2.1 time: 0.251414 Apr 29 08:53:48.116866 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 137/265] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 08:53:47 2022] GET /compute/v2.1/servers/8715736d-99f1-4f4c-af1f-c4bf3fc295d3 => generated 1522 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 08:53:49.129808 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-17ee734a-166a-45ac-9b82-174b7d224f32 tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] Action: 'create', calling method: .version_select at 0x7f623854c0d0>, body: {"keypair": {"name": "tempest-TestShelveInstance-1911035885"}} {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 29 08:53:49.148373 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-8e8b605a-32da-46db-ada9-7f8bcea37132 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Calling method '>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:53:49.149000 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-8e8b605a-32da-46db-ada9-7f8bcea37132 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] [instance: 8715736d-99f1-4f4c-af1f-c4bf3fc295d3] Fetching instance by UUID {{(pid=123458) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:53:49.159549 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-8e8b605a-32da-46db-ada9-7f8bcea37132 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:53:49.160402 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-8e8b605a-32da-46db-ada9-7f8bcea37132 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:53:49.161914 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-8e8b605a-32da-46db-ada9-7f8bcea37132 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:53:49.166727 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.quota [None req-17ee734a-166a-45ac-9b82-174b7d224f32 tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] Getting quotas for project 0436edb5348a4ad5a0b6b5979a7c54fa. Resources: {'key_pairs'} {{(pid=123459) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 29 08:53:49.167485 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-8e8b605a-32da-46db-ada9-7f8bcea37132 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:53:49.176178 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.quota [None req-17ee734a-166a-45ac-9b82-174b7d224f32 tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] Getting quotas for user dcf1c67873b7443084ea183c77698062 and project 0436edb5348a4ad5a0b6b5979a7c54fa. Resources: {'key_pairs'} {{(pid=123459) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 29 08:53:49.403829 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-8e8b605a-32da-46db-ada9-7f8bcea37132 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c18e88436f14dc7a2001220b87ce9ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60998f08c40446e787ead285e40665b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:53:49.413165 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-8e8b605a-32da-46db-ada9-7f8bcea37132 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] 10.222.0.31 "GET /compute/v2.1/servers/8715736d-99f1-4f4c-af1f-c4bf3fc295d3" status: 200 len: 1522 microversion: 2.1 time: 0.271355 Apr 29 08:53:49.413754 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 138/266] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 08:53:49 2022] GET /compute/v2.1/servers/8715736d-99f1-4f4c-af1f-c4bf3fc295d3 => generated 1522 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 08:53:49.439122 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.quota [None req-17ee734a-166a-45ac-9b82-174b7d224f32 tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] Getting quotas for project 0436edb5348a4ad5a0b6b5979a7c54fa. Resources: {'key_pairs'} {{(pid=123459) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 29 08:53:49.445050 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.quota [None req-17ee734a-166a-45ac-9b82-174b7d224f32 tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] Getting quotas for user dcf1c67873b7443084ea183c77698062 and project 0436edb5348a4ad5a0b6b5979a7c54fa. Resources: {'key_pairs'} {{(pid=123459) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 29 08:53:49.474629 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-17ee734a-166a-45ac-9b82-174b7d224f32 tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] 10.222.0.31 "POST /compute/v2.1/os-keypairs" status: 200 len: 2316 microversion: 2.1 time: 0.637213 Apr 29 08:53:49.476241 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 129/267] 10.222.0.31 () {60 vars in 1157 bytes} [Fri Apr 29 08:53:48 2022] POST /compute/v2.1/os-keypairs => generated 2316 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 08:53:50.434265 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-77e9d203-44a1-479c-a8fd-6ce953762513 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Calling method '>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:53:50.436400 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-77e9d203-44a1-479c-a8fd-6ce953762513 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] [instance: 8715736d-99f1-4f4c-af1f-c4bf3fc295d3] Fetching instance by UUID {{(pid=123458) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:53:50.445964 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-77e9d203-44a1-479c-a8fd-6ce953762513 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:53:50.447922 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-77e9d203-44a1-479c-a8fd-6ce953762513 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:53:50.449603 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-77e9d203-44a1-479c-a8fd-6ce953762513 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:53:50.450234 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-77e9d203-44a1-479c-a8fd-6ce953762513 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:53:50.615635 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-77e9d203-44a1-479c-a8fd-6ce953762513 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c18e88436f14dc7a2001220b87ce9ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60998f08c40446e787ead285e40665b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:53:50.626752 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-77e9d203-44a1-479c-a8fd-6ce953762513 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] 10.222.0.31 "GET /compute/v2.1/servers/8715736d-99f1-4f4c-af1f-c4bf3fc295d3" status: 200 len: 1522 microversion: 2.1 time: 0.198523 Apr 29 08:53:50.627336 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 139/268] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 08:53:50 2022] GET /compute/v2.1/servers/8715736d-99f1-4f4c-af1f-c4bf3fc295d3 => generated 1522 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 08:53:51.648035 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-168c3dda-bd49-4bf1-a3ec-29e7050b8780 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Calling method '>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:53:51.648685 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-168c3dda-bd49-4bf1-a3ec-29e7050b8780 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] [instance: 8715736d-99f1-4f4c-af1f-c4bf3fc295d3] Fetching instance by UUID {{(pid=123459) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:53:51.657299 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-168c3dda-bd49-4bf1-a3ec-29e7050b8780 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:53:51.658022 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-168c3dda-bd49-4bf1-a3ec-29e7050b8780 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:53:51.659643 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-168c3dda-bd49-4bf1-a3ec-29e7050b8780 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:53:51.660336 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-168c3dda-bd49-4bf1-a3ec-29e7050b8780 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:53:51.876180 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-168c3dda-bd49-4bf1-a3ec-29e7050b8780 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c18e88436f14dc7a2001220b87ce9ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60998f08c40446e787ead285e40665b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:53:51.889206 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-168c3dda-bd49-4bf1-a3ec-29e7050b8780 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] 10.222.0.31 "GET /compute/v2.1/servers/8715736d-99f1-4f4c-af1f-c4bf3fc295d3" status: 200 len: 1522 microversion: 2.1 time: 0.247820 Apr 29 08:53:51.891257 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 130/269] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 08:53:51 2022] GET /compute/v2.1/servers/8715736d-99f1-4f4c-af1f-c4bf3fc295d3 => generated 1522 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 08:53:52.907426 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-dbaece8d-72ce-4311-a127-6d548627ec34 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Calling method '>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:53:52.908269 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-dbaece8d-72ce-4311-a127-6d548627ec34 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] [instance: 8715736d-99f1-4f4c-af1f-c4bf3fc295d3] Fetching instance by UUID {{(pid=123458) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:53:52.916003 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-dbaece8d-72ce-4311-a127-6d548627ec34 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:53:52.921057 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-dbaece8d-72ce-4311-a127-6d548627ec34 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:53:52.922208 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-dbaece8d-72ce-4311-a127-6d548627ec34 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:53:52.922810 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-dbaece8d-72ce-4311-a127-6d548627ec34 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:53:53.109027 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-dbaece8d-72ce-4311-a127-6d548627ec34 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c18e88436f14dc7a2001220b87ce9ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60998f08c40446e787ead285e40665b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:53:53.121862 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-dbaece8d-72ce-4311-a127-6d548627ec34 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] 10.222.0.31 "GET /compute/v2.1/servers/8715736d-99f1-4f4c-af1f-c4bf3fc295d3" status: 200 len: 1522 microversion: 2.1 time: 0.218999 Apr 29 08:53:53.122484 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 140/270] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 08:53:52 2022] GET /compute/v2.1/servers/8715736d-99f1-4f4c-af1f-c4bf3fc295d3 => generated 1522 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 08:53:53.183323 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-de9606c4-4f5b-4dae-84a9-1d6be075b75e tempest-VolumesSnapshotTestJSON-1697003112 tempest-VolumesSnapshotTestJSON-1697003112-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ddfb2b26-7696-4eee-9ed1-ae752b66cb06", "device": "/dev/sdb"}} {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 29 08:53:53.185030 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-de9606c4-4f5b-4dae-84a9-1d6be075b75e tempest-VolumesSnapshotTestJSON-1697003112 tempest-VolumesSnapshotTestJSON-1697003112-project] [instance: 620e45e7-5ce1-4319-8b61-5aaff72e47aa] Fetching instance by UUID {{(pid=123459) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:53:53.192049 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-de9606c4-4f5b-4dae-84a9-1d6be075b75e tempest-VolumesSnapshotTestJSON-1697003112 tempest-VolumesSnapshotTestJSON-1697003112-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:53:53.192603 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-de9606c4-4f5b-4dae-84a9-1d6be075b75e tempest-VolumesSnapshotTestJSON-1697003112 tempest-VolumesSnapshotTestJSON-1697003112-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:53:53.194290 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-de9606c4-4f5b-4dae-84a9-1d6be075b75e tempest-VolumesSnapshotTestJSON-1697003112 tempest-VolumesSnapshotTestJSON-1697003112-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:53:53.194844 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-de9606c4-4f5b-4dae-84a9-1d6be075b75e tempest-VolumesSnapshotTestJSON-1697003112 tempest-VolumesSnapshotTestJSON-1697003112-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:53:53.494038 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-de9606c4-4f5b-4dae-84a9-1d6be075b75e tempest-VolumesSnapshotTestJSON-1697003112 tempest-VolumesSnapshotTestJSON-1697003112-project] 10.222.0.31 "POST /compute/v2.1/servers/620e45e7-5ce1-4319-8b61-5aaff72e47aa/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.317597 Apr 29 08:53:53.501041 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 131/271] 10.222.0.31 () {60 vars in 1322 bytes} [Fri Apr 29 08:53:53 2022] POST /compute/v2.1/servers/620e45e7-5ce1-4319-8b61-5aaff72e47aa/os-volume_attachments => generated 194 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 29 08:53:54.138633 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-e4a386d1-8211-4ab5-b913-06544521d65e tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Calling method '>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:53:54.139885 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-e4a386d1-8211-4ab5-b913-06544521d65e tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] [instance: 8715736d-99f1-4f4c-af1f-c4bf3fc295d3] Fetching instance by UUID {{(pid=123458) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:53:54.146398 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-e4a386d1-8211-4ab5-b913-06544521d65e tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:53:54.147184 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-e4a386d1-8211-4ab5-b913-06544521d65e tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:53:54.147975 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-e4a386d1-8211-4ab5-b913-06544521d65e tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:53:54.148612 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-e4a386d1-8211-4ab5-b913-06544521d65e tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:53:54.341237 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-e4a386d1-8211-4ab5-b913-06544521d65e tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c18e88436f14dc7a2001220b87ce9ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60998f08c40446e787ead285e40665b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:53:54.370033 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-e4a386d1-8211-4ab5-b913-06544521d65e tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] 10.222.0.31 "GET /compute/v2.1/servers/8715736d-99f1-4f4c-af1f-c4bf3fc295d3" status: 200 len: 1522 microversion: 2.1 time: 0.229341 Apr 29 08:53:54.370893 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 141/272] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 08:53:54 2022] GET /compute/v2.1/servers/8715736d-99f1-4f4c-af1f-c4bf3fc295d3 => generated 1522 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 08:53:55.389223 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-5fb74b7a-4cbb-4e5f-84d6-6805aa8ae2b5 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Calling method '>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:53:55.389845 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-5fb74b7a-4cbb-4e5f-84d6-6805aa8ae2b5 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] [instance: 8715736d-99f1-4f4c-af1f-c4bf3fc295d3] Fetching instance by UUID {{(pid=123459) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:53:55.396426 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-5fb74b7a-4cbb-4e5f-84d6-6805aa8ae2b5 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:53:55.396888 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-5fb74b7a-4cbb-4e5f-84d6-6805aa8ae2b5 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:53:55.397696 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-5fb74b7a-4cbb-4e5f-84d6-6805aa8ae2b5 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:53:55.398140 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-5fb74b7a-4cbb-4e5f-84d6-6805aa8ae2b5 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:53:55.576089 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-5fb74b7a-4cbb-4e5f-84d6-6805aa8ae2b5 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c18e88436f14dc7a2001220b87ce9ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60998f08c40446e787ead285e40665b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:53:55.585473 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-5fb74b7a-4cbb-4e5f-84d6-6805aa8ae2b5 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] 10.222.0.31 "GET /compute/v2.1/servers/8715736d-99f1-4f4c-af1f-c4bf3fc295d3" status: 200 len: 1522 microversion: 2.1 time: 0.201747 Apr 29 08:53:55.586302 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 132/273] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 08:53:55 2022] GET /compute/v2.1/servers/8715736d-99f1-4f4c-af1f-c4bf3fc295d3 => generated 1522 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 08:53:56.602872 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-b8d554c9-1f02-49f0-862f-2278d04224d4 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Calling method '>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:53:56.603496 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-b8d554c9-1f02-49f0-862f-2278d04224d4 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] [instance: 8715736d-99f1-4f4c-af1f-c4bf3fc295d3] Fetching instance by UUID {{(pid=123458) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:53:56.609874 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-b8d554c9-1f02-49f0-862f-2278d04224d4 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:53:56.610317 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-b8d554c9-1f02-49f0-862f-2278d04224d4 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:53:56.611651 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-b8d554c9-1f02-49f0-862f-2278d04224d4 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:53:56.611651 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-b8d554c9-1f02-49f0-862f-2278d04224d4 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:53:56.751055 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-b8d554c9-1f02-49f0-862f-2278d04224d4 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c18e88436f14dc7a2001220b87ce9ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60998f08c40446e787ead285e40665b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:53:56.757550 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-b8d554c9-1f02-49f0-862f-2278d04224d4 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] 10.222.0.31 "GET /compute/v2.1/servers/8715736d-99f1-4f4c-af1f-c4bf3fc295d3" status: 200 len: 1522 microversion: 2.1 time: 0.158391 Apr 29 08:53:56.758147 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 142/274] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 08:53:56 2022] GET /compute/v2.1/servers/8715736d-99f1-4f4c-af1f-c4bf3fc295d3 => generated 1522 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 08:53:57.774579 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-d0661291-4456-4a5f-b73c-0cd8ce1de1af tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Calling method '>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:53:57.775176 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-d0661291-4456-4a5f-b73c-0cd8ce1de1af tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] [instance: 8715736d-99f1-4f4c-af1f-c4bf3fc295d3] Fetching instance by UUID {{(pid=123459) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:53:57.783382 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-d0661291-4456-4a5f-b73c-0cd8ce1de1af tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:53:57.784030 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-d0661291-4456-4a5f-b73c-0cd8ce1de1af tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:53:57.784856 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-d0661291-4456-4a5f-b73c-0cd8ce1de1af tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:53:57.785294 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-d0661291-4456-4a5f-b73c-0cd8ce1de1af tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:53:57.941853 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-d0661291-4456-4a5f-b73c-0cd8ce1de1af tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c18e88436f14dc7a2001220b87ce9ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60998f08c40446e787ead285e40665b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:53:57.949356 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-d0661291-4456-4a5f-b73c-0cd8ce1de1af tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] 10.222.0.31 "GET /compute/v2.1/servers/8715736d-99f1-4f4c-af1f-c4bf3fc295d3" status: 200 len: 1522 microversion: 2.1 time: 0.178620 Apr 29 08:53:57.949938 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 133/275] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 08:53:57 2022] GET /compute/v2.1/servers/8715736d-99f1-4f4c-af1f-c4bf3fc295d3 => generated 1522 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 08:53:58.967657 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-482f2e71-cc65-4184-9599-d0a4241df027 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Calling method '>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:53:58.968299 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-482f2e71-cc65-4184-9599-d0a4241df027 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] [instance: 8715736d-99f1-4f4c-af1f-c4bf3fc295d3] Fetching instance by UUID {{(pid=123458) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:53:58.974341 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-482f2e71-cc65-4184-9599-d0a4241df027 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:53:58.974787 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-482f2e71-cc65-4184-9599-d0a4241df027 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:53:58.975555 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-482f2e71-cc65-4184-9599-d0a4241df027 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:53:58.976018 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-482f2e71-cc65-4184-9599-d0a4241df027 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:53:59.113888 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-482f2e71-cc65-4184-9599-d0a4241df027 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c18e88436f14dc7a2001220b87ce9ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60998f08c40446e787ead285e40665b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:53:59.122049 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-482f2e71-cc65-4184-9599-d0a4241df027 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] 10.222.0.31 "GET /compute/v2.1/servers/8715736d-99f1-4f4c-af1f-c4bf3fc295d3" status: 200 len: 1522 microversion: 2.1 time: 0.158877 Apr 29 08:53:59.122628 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 143/276] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 08:53:58 2022] GET /compute/v2.1/servers/8715736d-99f1-4f4c-af1f-c4bf3fc295d3 => generated 1522 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 08:54:00.139538 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-c1951dd9-a7a6-4704-8a61-2efcb87f5b64 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Calling method '>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:54:00.140167 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-c1951dd9-a7a6-4704-8a61-2efcb87f5b64 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] [instance: 8715736d-99f1-4f4c-af1f-c4bf3fc295d3] Fetching instance by UUID {{(pid=123459) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:54:00.146616 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-c1951dd9-a7a6-4704-8a61-2efcb87f5b64 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:54:00.147092 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-c1951dd9-a7a6-4704-8a61-2efcb87f5b64 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:54:00.147865 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-c1951dd9-a7a6-4704-8a61-2efcb87f5b64 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:54:00.148491 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-c1951dd9-a7a6-4704-8a61-2efcb87f5b64 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:54:00.287453 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-c1951dd9-a7a6-4704-8a61-2efcb87f5b64 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c18e88436f14dc7a2001220b87ce9ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60998f08c40446e787ead285e40665b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:54:00.295605 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-c1951dd9-a7a6-4704-8a61-2efcb87f5b64 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] 10.222.0.31 "GET /compute/v2.1/servers/8715736d-99f1-4f4c-af1f-c4bf3fc295d3" status: 200 len: 1522 microversion: 2.1 time: 0.159570 Apr 29 08:54:00.296177 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 134/277] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 08:54:00 2022] GET /compute/v2.1/servers/8715736d-99f1-4f4c-af1f-c4bf3fc295d3 => generated 1522 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 08:54:01.312648 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-cc896ecd-81e4-454f-a5e1-e4c97c61a2d8 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Calling method '>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:54:01.313284 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-cc896ecd-81e4-454f-a5e1-e4c97c61a2d8 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] [instance: 8715736d-99f1-4f4c-af1f-c4bf3fc295d3] Fetching instance by UUID {{(pid=123458) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:54:01.319532 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-cc896ecd-81e4-454f-a5e1-e4c97c61a2d8 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:54:01.320038 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-cc896ecd-81e4-454f-a5e1-e4c97c61a2d8 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:54:01.320896 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-cc896ecd-81e4-454f-a5e1-e4c97c61a2d8 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:54:01.321343 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-cc896ecd-81e4-454f-a5e1-e4c97c61a2d8 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:54:01.456554 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-cc896ecd-81e4-454f-a5e1-e4c97c61a2d8 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c18e88436f14dc7a2001220b87ce9ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60998f08c40446e787ead285e40665b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:54:01.464015 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-cc896ecd-81e4-454f-a5e1-e4c97c61a2d8 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] 10.222.0.31 "GET /compute/v2.1/servers/8715736d-99f1-4f4c-af1f-c4bf3fc295d3" status: 200 len: 1522 microversion: 2.1 time: 0.156343 Apr 29 08:54:01.464625 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 144/278] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 08:54:01 2022] GET /compute/v2.1/servers/8715736d-99f1-4f4c-af1f-c4bf3fc295d3 => generated 1522 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 08:54:02.481664 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-5c2decd7-f3a8-44af-96d8-d7e27b3bfc59 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Calling method '>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:54:02.482356 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-5c2decd7-f3a8-44af-96d8-d7e27b3bfc59 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] [instance: 8715736d-99f1-4f4c-af1f-c4bf3fc295d3] Fetching instance by UUID {{(pid=123459) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:54:02.489519 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-5c2decd7-f3a8-44af-96d8-d7e27b3bfc59 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:54:02.489964 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-5c2decd7-f3a8-44af-96d8-d7e27b3bfc59 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:54:02.490747 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-5c2decd7-f3a8-44af-96d8-d7e27b3bfc59 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:54:02.491182 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-5c2decd7-f3a8-44af-96d8-d7e27b3bfc59 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:54:02.630846 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-5c2decd7-f3a8-44af-96d8-d7e27b3bfc59 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c18e88436f14dc7a2001220b87ce9ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60998f08c40446e787ead285e40665b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:54:02.638525 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-5c2decd7-f3a8-44af-96d8-d7e27b3bfc59 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] 10.222.0.31 "GET /compute/v2.1/servers/8715736d-99f1-4f4c-af1f-c4bf3fc295d3" status: 200 len: 1522 microversion: 2.1 time: 0.160755 Apr 29 08:54:02.639101 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 135/279] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 08:54:02 2022] GET /compute/v2.1/servers/8715736d-99f1-4f4c-af1f-c4bf3fc295d3 => generated 1522 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 08:54:03.654846 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-f67bcce8-301f-4a9b-b676-0b8f2573105d tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Calling method '>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:54:03.655462 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-f67bcce8-301f-4a9b-b676-0b8f2573105d tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] [instance: 8715736d-99f1-4f4c-af1f-c4bf3fc295d3] Fetching instance by UUID {{(pid=123458) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:54:03.663021 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-f67bcce8-301f-4a9b-b676-0b8f2573105d tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:54:03.663472 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-f67bcce8-301f-4a9b-b676-0b8f2573105d tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:54:03.664296 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-f67bcce8-301f-4a9b-b676-0b8f2573105d tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:54:03.664736 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-f67bcce8-301f-4a9b-b676-0b8f2573105d tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:54:03.799487 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-f67bcce8-301f-4a9b-b676-0b8f2573105d tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c18e88436f14dc7a2001220b87ce9ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60998f08c40446e787ead285e40665b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:54:03.806990 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-f67bcce8-301f-4a9b-b676-0b8f2573105d tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] 10.222.0.31 "GET /compute/v2.1/servers/8715736d-99f1-4f4c-af1f-c4bf3fc295d3" status: 200 len: 1522 microversion: 2.1 time: 0.155967 Apr 29 08:54:03.807573 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 145/280] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 08:54:03 2022] GET /compute/v2.1/servers/8715736d-99f1-4f4c-af1f-c4bf3fc295d3 => generated 1522 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 08:54:04.823728 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-0c9b5b44-edf2-44ba-9d26-49b05274d4c4 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Calling method '>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:54:04.824361 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-0c9b5b44-edf2-44ba-9d26-49b05274d4c4 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] [instance: 8715736d-99f1-4f4c-af1f-c4bf3fc295d3] Fetching instance by UUID {{(pid=123459) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:54:04.830878 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-0c9b5b44-edf2-44ba-9d26-49b05274d4c4 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:54:04.831326 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-0c9b5b44-edf2-44ba-9d26-49b05274d4c4 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:54:04.832106 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-0c9b5b44-edf2-44ba-9d26-49b05274d4c4 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:54:04.832573 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-0c9b5b44-edf2-44ba-9d26-49b05274d4c4 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:54:04.967916 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-0c9b5b44-edf2-44ba-9d26-49b05274d4c4 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c18e88436f14dc7a2001220b87ce9ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60998f08c40446e787ead285e40665b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:54:04.976200 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-0c9b5b44-edf2-44ba-9d26-49b05274d4c4 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] 10.222.0.31 "GET /compute/v2.1/servers/8715736d-99f1-4f4c-af1f-c4bf3fc295d3" status: 200 len: 1522 microversion: 2.1 time: 0.156257 Apr 29 08:54:04.976771 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 136/281] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 08:54:04 2022] GET /compute/v2.1/servers/8715736d-99f1-4f4c-af1f-c4bf3fc295d3 => generated 1522 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 08:54:05.993189 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-bd408507-9016-4ac9-93bf-fe9ea996987a tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Calling method '>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:54:05.993808 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-bd408507-9016-4ac9-93bf-fe9ea996987a tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] [instance: 8715736d-99f1-4f4c-af1f-c4bf3fc295d3] Fetching instance by UUID {{(pid=123458) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:54:06.001188 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-bd408507-9016-4ac9-93bf-fe9ea996987a tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:54:06.001647 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-bd408507-9016-4ac9-93bf-fe9ea996987a tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:54:06.002449 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-bd408507-9016-4ac9-93bf-fe9ea996987a tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:54:06.002885 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-bd408507-9016-4ac9-93bf-fe9ea996987a tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:54:06.133845 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-bd408507-9016-4ac9-93bf-fe9ea996987a tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c18e88436f14dc7a2001220b87ce9ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60998f08c40446e787ead285e40665b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:54:06.141255 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-bd408507-9016-4ac9-93bf-fe9ea996987a tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] 10.222.0.31 "GET /compute/v2.1/servers/8715736d-99f1-4f4c-af1f-c4bf3fc295d3" status: 200 len: 1522 microversion: 2.1 time: 0.151894 Apr 29 08:54:06.141827 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 146/282] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 08:54:05 2022] GET /compute/v2.1/servers/8715736d-99f1-4f4c-af1f-c4bf3fc295d3 => generated 1522 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 08:54:07.159106 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-9fbe9e66-8e6e-4351-b28b-5d1dbb29a6e5 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Calling method '>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:54:07.159636 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-9fbe9e66-8e6e-4351-b28b-5d1dbb29a6e5 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] [instance: 8715736d-99f1-4f4c-af1f-c4bf3fc295d3] Fetching instance by UUID {{(pid=123459) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:54:07.166061 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-9fbe9e66-8e6e-4351-b28b-5d1dbb29a6e5 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:54:07.166507 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-9fbe9e66-8e6e-4351-b28b-5d1dbb29a6e5 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:54:07.167282 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-9fbe9e66-8e6e-4351-b28b-5d1dbb29a6e5 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:54:07.167720 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-9fbe9e66-8e6e-4351-b28b-5d1dbb29a6e5 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:54:07.306557 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-9fbe9e66-8e6e-4351-b28b-5d1dbb29a6e5 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c18e88436f14dc7a2001220b87ce9ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60998f08c40446e787ead285e40665b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:54:07.314121 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-9fbe9e66-8e6e-4351-b28b-5d1dbb29a6e5 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] 10.222.0.31 "GET /compute/v2.1/servers/8715736d-99f1-4f4c-af1f-c4bf3fc295d3" status: 200 len: 1522 microversion: 2.1 time: 0.159994 Apr 29 08:54:07.314692 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 137/283] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 08:54:07 2022] GET /compute/v2.1/servers/8715736d-99f1-4f4c-af1f-c4bf3fc295d3 => generated 1522 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 08:54:08.331598 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-ae723cf8-fbc6-4726-bbc3-31e598973175 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Calling method '>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:54:08.332245 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-ae723cf8-fbc6-4726-bbc3-31e598973175 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] [instance: 8715736d-99f1-4f4c-af1f-c4bf3fc295d3] Fetching instance by UUID {{(pid=123458) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:54:08.338214 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-ae723cf8-fbc6-4726-bbc3-31e598973175 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:54:08.338678 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-ae723cf8-fbc6-4726-bbc3-31e598973175 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:54:08.339462 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-ae723cf8-fbc6-4726-bbc3-31e598973175 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:54:08.339903 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-ae723cf8-fbc6-4726-bbc3-31e598973175 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:54:08.472268 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-ae723cf8-fbc6-4726-bbc3-31e598973175 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c18e88436f14dc7a2001220b87ce9ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60998f08c40446e787ead285e40665b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:54:08.479473 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-ae723cf8-fbc6-4726-bbc3-31e598973175 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] 10.222.0.31 "GET /compute/v2.1/servers/8715736d-99f1-4f4c-af1f-c4bf3fc295d3" status: 200 len: 1522 microversion: 2.1 time: 0.152962 Apr 29 08:54:08.480032 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 147/284] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 08:54:08 2022] GET /compute/v2.1/servers/8715736d-99f1-4f4c-af1f-c4bf3fc295d3 => generated 1522 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 08:54:09.496766 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-e8b2aed0-a6ce-4d1c-89e5-7f43ca046a71 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Calling method '>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:54:09.497380 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-e8b2aed0-a6ce-4d1c-89e5-7f43ca046a71 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] [instance: 8715736d-99f1-4f4c-af1f-c4bf3fc295d3] Fetching instance by UUID {{(pid=123459) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:54:09.504828 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-e8b2aed0-a6ce-4d1c-89e5-7f43ca046a71 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:54:09.505784 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-e8b2aed0-a6ce-4d1c-89e5-7f43ca046a71 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:54:09.506056 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-e8b2aed0-a6ce-4d1c-89e5-7f43ca046a71 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:54:09.506497 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-e8b2aed0-a6ce-4d1c-89e5-7f43ca046a71 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:54:09.636756 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-e8b2aed0-a6ce-4d1c-89e5-7f43ca046a71 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c18e88436f14dc7a2001220b87ce9ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60998f08c40446e787ead285e40665b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:54:09.644355 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-e8b2aed0-a6ce-4d1c-89e5-7f43ca046a71 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] 10.222.0.31 "GET /compute/v2.1/servers/8715736d-99f1-4f4c-af1f-c4bf3fc295d3" status: 200 len: 1522 microversion: 2.1 time: 0.151351 Apr 29 08:54:09.644923 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 138/285] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 08:54:09 2022] GET /compute/v2.1/servers/8715736d-99f1-4f4c-af1f-c4bf3fc295d3 => generated 1522 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 08:54:10.661863 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-fa594d19-f75f-4655-b8e3-3da905950c00 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Calling method '>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:54:10.662470 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-fa594d19-f75f-4655-b8e3-3da905950c00 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] [instance: 8715736d-99f1-4f4c-af1f-c4bf3fc295d3] Fetching instance by UUID {{(pid=123458) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:54:10.668511 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-fa594d19-f75f-4655-b8e3-3da905950c00 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:54:10.668962 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-fa594d19-f75f-4655-b8e3-3da905950c00 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:54:10.669735 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-fa594d19-f75f-4655-b8e3-3da905950c00 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:54:10.670172 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-fa594d19-f75f-4655-b8e3-3da905950c00 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:54:10.818402 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-fa594d19-f75f-4655-b8e3-3da905950c00 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c18e88436f14dc7a2001220b87ce9ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60998f08c40446e787ead285e40665b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:54:10.826133 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-fa594d19-f75f-4655-b8e3-3da905950c00 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] 10.222.0.31 "GET /compute/v2.1/servers/8715736d-99f1-4f4c-af1f-c4bf3fc295d3" status: 200 len: 1522 microversion: 2.1 time: 0.168721 Apr 29 08:54:10.826706 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 148/286] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 08:54:10 2022] GET /compute/v2.1/servers/8715736d-99f1-4f4c-af1f-c4bf3fc295d3 => generated 1522 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 08:54:11.843382 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-e6467b53-4215-4cd2-ada3-bb8e64ec65c0 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Calling method '>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:54:11.844032 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-e6467b53-4215-4cd2-ada3-bb8e64ec65c0 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] [instance: 8715736d-99f1-4f4c-af1f-c4bf3fc295d3] Fetching instance by UUID {{(pid=123459) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:54:11.852320 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-e6467b53-4215-4cd2-ada3-bb8e64ec65c0 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:54:11.852773 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-e6467b53-4215-4cd2-ada3-bb8e64ec65c0 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:54:11.853599 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-e6467b53-4215-4cd2-ada3-bb8e64ec65c0 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:54:11.854039 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-e6467b53-4215-4cd2-ada3-bb8e64ec65c0 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:54:12.011141 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-e6467b53-4215-4cd2-ada3-bb8e64ec65c0 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c18e88436f14dc7a2001220b87ce9ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60998f08c40446e787ead285e40665b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:54:12.019334 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-e6467b53-4215-4cd2-ada3-bb8e64ec65c0 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] 10.222.0.31 "GET /compute/v2.1/servers/8715736d-99f1-4f4c-af1f-c4bf3fc295d3" status: 200 len: 1522 microversion: 2.1 time: 0.180259 Apr 29 08:54:12.019915 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 139/287] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 08:54:11 2022] GET /compute/v2.1/servers/8715736d-99f1-4f4c-af1f-c4bf3fc295d3 => generated 1522 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 08:54:13.036938 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-33dcb108-d987-4411-9249-88de3ef3d414 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Calling method '>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:54:13.037467 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-33dcb108-d987-4411-9249-88de3ef3d414 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] [instance: 8715736d-99f1-4f4c-af1f-c4bf3fc295d3] Fetching instance by UUID {{(pid=123458) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:54:13.043568 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-33dcb108-d987-4411-9249-88de3ef3d414 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:54:13.043991 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-33dcb108-d987-4411-9249-88de3ef3d414 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:54:13.044817 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-33dcb108-d987-4411-9249-88de3ef3d414 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:54:13.045249 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-33dcb108-d987-4411-9249-88de3ef3d414 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:54:13.177439 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-33dcb108-d987-4411-9249-88de3ef3d414 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c18e88436f14dc7a2001220b87ce9ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60998f08c40446e787ead285e40665b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:54:13.184828 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-33dcb108-d987-4411-9249-88de3ef3d414 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] 10.222.0.31 "GET /compute/v2.1/servers/8715736d-99f1-4f4c-af1f-c4bf3fc295d3" status: 200 len: 1522 microversion: 2.1 time: 0.152395 Apr 29 08:54:13.185402 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 149/288] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 08:54:13 2022] GET /compute/v2.1/servers/8715736d-99f1-4f4c-af1f-c4bf3fc295d3 => generated 1522 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 29 08:54:14.201705 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-032a91b1-e7a1-469a-a381-53a75e907b26 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Calling method '>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:54:14.202330 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-032a91b1-e7a1-469a-a381-53a75e907b26 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] [instance: 8715736d-99f1-4f4c-af1f-c4bf3fc295d3] Fetching instance by UUID {{(pid=123459) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:54:14.210764 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-032a91b1-e7a1-469a-a381-53a75e907b26 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:54:14.213786 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-032a91b1-e7a1-469a-a381-53a75e907b26 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:54:14.214664 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-032a91b1-e7a1-469a-a381-53a75e907b26 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:54:14.215139 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-032a91b1-e7a1-469a-a381-53a75e907b26 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:54:14.362155 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-032a91b1-e7a1-469a-a381-53a75e907b26 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c18e88436f14dc7a2001220b87ce9ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60998f08c40446e787ead285e40665b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:54:14.369857 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-032a91b1-e7a1-469a-a381-53a75e907b26 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] 10.222.0.31 "GET /compute/v2.1/servers/8715736d-99f1-4f4c-af1f-c4bf3fc295d3" status: 200 len: 1522 microversion: 2.1 time: 0.171986 Apr 29 08:54:14.370421 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 140/289] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 08:54:14 2022] GET /compute/v2.1/servers/8715736d-99f1-4f4c-af1f-c4bf3fc295d3 => generated 1522 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 08:54:15.386805 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-eccac255-5660-4388-93a8-ae3d71271e8f tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Calling method '>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:54:15.387422 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-eccac255-5660-4388-93a8-ae3d71271e8f tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] [instance: 8715736d-99f1-4f4c-af1f-c4bf3fc295d3] Fetching instance by UUID {{(pid=123458) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:54:15.395045 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-eccac255-5660-4388-93a8-ae3d71271e8f tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:54:15.395496 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-eccac255-5660-4388-93a8-ae3d71271e8f tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:54:15.396327 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-eccac255-5660-4388-93a8-ae3d71271e8f tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:54:15.396769 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-eccac255-5660-4388-93a8-ae3d71271e8f tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:54:15.532058 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-eccac255-5660-4388-93a8-ae3d71271e8f tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c18e88436f14dc7a2001220b87ce9ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60998f08c40446e787ead285e40665b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:54:15.539990 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-eccac255-5660-4388-93a8-ae3d71271e8f tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] 10.222.0.31 "GET /compute/v2.1/servers/8715736d-99f1-4f4c-af1f-c4bf3fc295d3" status: 200 len: 1522 microversion: 2.1 time: 0.157060 Apr 29 08:54:15.540580 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 150/290] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 08:54:15 2022] GET /compute/v2.1/servers/8715736d-99f1-4f4c-af1f-c4bf3fc295d3 => generated 1522 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 08:54:16.556704 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-1bc9cd51-788c-409d-be27-f152905a1434 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Calling method '>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:54:16.557316 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-1bc9cd51-788c-409d-be27-f152905a1434 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] [instance: 8715736d-99f1-4f4c-af1f-c4bf3fc295d3] Fetching instance by UUID {{(pid=123459) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:54:16.563894 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-1bc9cd51-788c-409d-be27-f152905a1434 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:54:16.564382 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-1bc9cd51-788c-409d-be27-f152905a1434 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:54:16.565691 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-1bc9cd51-788c-409d-be27-f152905a1434 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:54:16.566141 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-1bc9cd51-788c-409d-be27-f152905a1434 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:54:16.695270 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-1bc9cd51-788c-409d-be27-f152905a1434 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c18e88436f14dc7a2001220b87ce9ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60998f08c40446e787ead285e40665b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:54:16.702649 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-1bc9cd51-788c-409d-be27-f152905a1434 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] 10.222.0.31 "GET /compute/v2.1/servers/8715736d-99f1-4f4c-af1f-c4bf3fc295d3" status: 200 len: 1522 microversion: 2.1 time: 0.149742 Apr 29 08:54:16.703222 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 141/291] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 08:54:16 2022] GET /compute/v2.1/servers/8715736d-99f1-4f4c-af1f-c4bf3fc295d3 => generated 1522 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 08:54:17.720506 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-10622956-1bd7-4376-af7f-549f12dd7849 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Calling method '>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:54:17.721249 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-10622956-1bd7-4376-af7f-549f12dd7849 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] [instance: 8715736d-99f1-4f4c-af1f-c4bf3fc295d3] Fetching instance by UUID {{(pid=123458) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:54:17.727406 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-10622956-1bd7-4376-af7f-549f12dd7849 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:54:17.727857 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-10622956-1bd7-4376-af7f-549f12dd7849 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:54:17.728666 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-10622956-1bd7-4376-af7f-549f12dd7849 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:54:17.729102 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-10622956-1bd7-4376-af7f-549f12dd7849 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:54:17.863112 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-10622956-1bd7-4376-af7f-549f12dd7849 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c18e88436f14dc7a2001220b87ce9ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60998f08c40446e787ead285e40665b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:54:17.870745 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-10622956-1bd7-4376-af7f-549f12dd7849 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] 10.222.0.31 "GET /compute/v2.1/servers/8715736d-99f1-4f4c-af1f-c4bf3fc295d3" status: 200 len: 1522 microversion: 2.1 time: 0.154113 Apr 29 08:54:17.871309 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 151/292] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 08:54:17 2022] GET /compute/v2.1/servers/8715736d-99f1-4f4c-af1f-c4bf3fc295d3 => generated 1522 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 08:54:18.886651 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-8607f94d-cb28-4bd2-8b98-d844ed5e577c tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Calling method '>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:54:18.887257 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-8607f94d-cb28-4bd2-8b98-d844ed5e577c tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] [instance: 8715736d-99f1-4f4c-af1f-c4bf3fc295d3] Fetching instance by UUID {{(pid=123459) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:54:18.900216 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-8607f94d-cb28-4bd2-8b98-d844ed5e577c tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:54:18.900667 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-8607f94d-cb28-4bd2-8b98-d844ed5e577c tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:54:18.901450 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-8607f94d-cb28-4bd2-8b98-d844ed5e577c tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:54:18.902017 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-8607f94d-cb28-4bd2-8b98-d844ed5e577c tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:54:19.054013 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-8607f94d-cb28-4bd2-8b98-d844ed5e577c tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c18e88436f14dc7a2001220b87ce9ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60998f08c40446e787ead285e40665b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:54:19.063365 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-8607f94d-cb28-4bd2-8b98-d844ed5e577c tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] 10.222.0.31 "GET /compute/v2.1/servers/8715736d-99f1-4f4c-af1f-c4bf3fc295d3" status: 200 len: 1522 microversion: 2.1 time: 0.180467 Apr 29 08:54:19.063938 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 142/293] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 08:54:18 2022] GET /compute/v2.1/servers/8715736d-99f1-4f4c-af1f-c4bf3fc295d3 => generated 1522 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 08:54:20.080408 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-98ced558-2f7e-4c90-bfd3-bab879157f1a tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Calling method '>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:54:20.081279 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-98ced558-2f7e-4c90-bfd3-bab879157f1a tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] [instance: 8715736d-99f1-4f4c-af1f-c4bf3fc295d3] Fetching instance by UUID {{(pid=123458) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:54:20.090650 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-98ced558-2f7e-4c90-bfd3-bab879157f1a tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:54:20.091142 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-98ced558-2f7e-4c90-bfd3-bab879157f1a tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:54:20.092018 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-98ced558-2f7e-4c90-bfd3-bab879157f1a tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:54:20.092476 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-98ced558-2f7e-4c90-bfd3-bab879157f1a tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:54:20.229071 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-98ced558-2f7e-4c90-bfd3-bab879157f1a tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c18e88436f14dc7a2001220b87ce9ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60998f08c40446e787ead285e40665b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:54:20.237127 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-98ced558-2f7e-4c90-bfd3-bab879157f1a tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] 10.222.0.31 "GET /compute/v2.1/servers/8715736d-99f1-4f4c-af1f-c4bf3fc295d3" status: 200 len: 1522 microversion: 2.1 time: 0.160068 Apr 29 08:54:20.238052 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 152/294] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 08:54:20 2022] GET /compute/v2.1/servers/8715736d-99f1-4f4c-af1f-c4bf3fc295d3 => generated 1522 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 08:54:21.254872 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-4188bfa6-377c-4663-8d4b-3a23bd0c136a tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Calling method '>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:54:21.255630 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-4188bfa6-377c-4663-8d4b-3a23bd0c136a tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] [instance: 8715736d-99f1-4f4c-af1f-c4bf3fc295d3] Fetching instance by UUID {{(pid=123459) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:54:21.263109 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-4188bfa6-377c-4663-8d4b-3a23bd0c136a tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:54:21.263565 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-4188bfa6-377c-4663-8d4b-3a23bd0c136a tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:54:21.264381 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-4188bfa6-377c-4663-8d4b-3a23bd0c136a tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:54:21.264824 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-4188bfa6-377c-4663-8d4b-3a23bd0c136a tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:54:21.407990 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-4188bfa6-377c-4663-8d4b-3a23bd0c136a tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c18e88436f14dc7a2001220b87ce9ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60998f08c40446e787ead285e40665b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:54:21.417460 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-4188bfa6-377c-4663-8d4b-3a23bd0c136a tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] 10.222.0.31 "GET /compute/v2.1/servers/8715736d-99f1-4f4c-af1f-c4bf3fc295d3" status: 200 len: 1522 microversion: 2.1 time: 0.166606 Apr 29 08:54:21.418072 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 143/295] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 08:54:21 2022] GET /compute/v2.1/servers/8715736d-99f1-4f4c-af1f-c4bf3fc295d3 => generated 1522 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 08:54:22.441055 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-46e4a3c8-14cb-43c2-910d-01af79253baa tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Calling method '>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:54:22.441727 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-46e4a3c8-14cb-43c2-910d-01af79253baa tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] [instance: 8715736d-99f1-4f4c-af1f-c4bf3fc295d3] Fetching instance by UUID {{(pid=123458) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:54:22.450301 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-46e4a3c8-14cb-43c2-910d-01af79253baa tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:54:22.450301 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-46e4a3c8-14cb-43c2-910d-01af79253baa tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:54:22.451126 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-46e4a3c8-14cb-43c2-910d-01af79253baa tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:54:22.451566 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-46e4a3c8-14cb-43c2-910d-01af79253baa tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:54:22.597065 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-46e4a3c8-14cb-43c2-910d-01af79253baa tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c18e88436f14dc7a2001220b87ce9ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60998f08c40446e787ead285e40665b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:54:22.604222 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-46e4a3c8-14cb-43c2-910d-01af79253baa tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] 10.222.0.31 "GET /compute/v2.1/servers/8715736d-99f1-4f4c-af1f-c4bf3fc295d3" status: 200 len: 1522 microversion: 2.1 time: 0.167571 Apr 29 08:54:22.604783 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 153/296] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 08:54:22 2022] GET /compute/v2.1/servers/8715736d-99f1-4f4c-af1f-c4bf3fc295d3 => generated 1522 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 08:54:23.621569 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-75106edd-790f-42e7-a03c-7ab42a5ad260 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Calling method '>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:54:23.622121 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-75106edd-790f-42e7-a03c-7ab42a5ad260 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] [instance: 8715736d-99f1-4f4c-af1f-c4bf3fc295d3] Fetching instance by UUID {{(pid=123459) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:54:23.628632 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-75106edd-790f-42e7-a03c-7ab42a5ad260 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:54:23.629086 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-75106edd-790f-42e7-a03c-7ab42a5ad260 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:54:23.629873 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-75106edd-790f-42e7-a03c-7ab42a5ad260 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:54:23.630340 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-75106edd-790f-42e7-a03c-7ab42a5ad260 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:54:23.778138 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-75106edd-790f-42e7-a03c-7ab42a5ad260 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c18e88436f14dc7a2001220b87ce9ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60998f08c40446e787ead285e40665b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:54:23.786141 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-75106edd-790f-42e7-a03c-7ab42a5ad260 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] 10.222.0.31 "GET /compute/v2.1/servers/8715736d-99f1-4f4c-af1f-c4bf3fc295d3" status: 200 len: 1522 microversion: 2.1 time: 0.168448 Apr 29 08:54:23.786710 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 144/297] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 08:54:23 2022] GET /compute/v2.1/servers/8715736d-99f1-4f4c-af1f-c4bf3fc295d3 => generated 1522 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 08:54:24.803650 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-346737d8-ebd0-4ff6-a085-b3ea9959fe77 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Calling method '>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:54:24.804292 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-346737d8-ebd0-4ff6-a085-b3ea9959fe77 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] [instance: 8715736d-99f1-4f4c-af1f-c4bf3fc295d3] Fetching instance by UUID {{(pid=123458) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:54:24.810437 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-346737d8-ebd0-4ff6-a085-b3ea9959fe77 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:54:24.810885 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-346737d8-ebd0-4ff6-a085-b3ea9959fe77 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:54:24.811687 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-346737d8-ebd0-4ff6-a085-b3ea9959fe77 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:54:24.812123 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-346737d8-ebd0-4ff6-a085-b3ea9959fe77 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:54:24.943544 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-346737d8-ebd0-4ff6-a085-b3ea9959fe77 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c18e88436f14dc7a2001220b87ce9ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60998f08c40446e787ead285e40665b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:54:24.950869 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-346737d8-ebd0-4ff6-a085-b3ea9959fe77 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] 10.222.0.31 "GET /compute/v2.1/servers/8715736d-99f1-4f4c-af1f-c4bf3fc295d3" status: 200 len: 1522 microversion: 2.1 time: 0.151712 Apr 29 08:54:24.951452 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 154/298] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 08:54:24 2022] GET /compute/v2.1/servers/8715736d-99f1-4f4c-af1f-c4bf3fc295d3 => generated 1522 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 08:54:25.966879 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-ef873783-64b1-4735-91e3-55dd9caf4cfa tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Calling method '>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:54:25.967485 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-ef873783-64b1-4735-91e3-55dd9caf4cfa tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] [instance: 8715736d-99f1-4f4c-af1f-c4bf3fc295d3] Fetching instance by UUID {{(pid=123459) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:54:25.974293 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-ef873783-64b1-4735-91e3-55dd9caf4cfa tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:54:25.974737 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-ef873783-64b1-4735-91e3-55dd9caf4cfa tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:54:25.975511 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-ef873783-64b1-4735-91e3-55dd9caf4cfa tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:54:25.975943 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-ef873783-64b1-4735-91e3-55dd9caf4cfa tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:54:26.112159 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-ef873783-64b1-4735-91e3-55dd9caf4cfa tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c18e88436f14dc7a2001220b87ce9ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60998f08c40446e787ead285e40665b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:54:26.120454 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-ef873783-64b1-4735-91e3-55dd9caf4cfa tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] 10.222.0.31 "GET /compute/v2.1/servers/8715736d-99f1-4f4c-af1f-c4bf3fc295d3" status: 200 len: 1522 microversion: 2.1 time: 0.157385 Apr 29 08:54:26.121038 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 145/299] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 08:54:25 2022] GET /compute/v2.1/servers/8715736d-99f1-4f4c-af1f-c4bf3fc295d3 => generated 1522 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 08:54:27.140113 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-b5645824-fba2-48d7-aae3-c7f0c0091fff tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Calling method '>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:54:27.140745 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-b5645824-fba2-48d7-aae3-c7f0c0091fff tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] [instance: 8715736d-99f1-4f4c-af1f-c4bf3fc295d3] Fetching instance by UUID {{(pid=123458) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:54:27.147863 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-b5645824-fba2-48d7-aae3-c7f0c0091fff tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:54:27.148344 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-b5645824-fba2-48d7-aae3-c7f0c0091fff tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:54:27.149128 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-b5645824-fba2-48d7-aae3-c7f0c0091fff tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:54:27.149567 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-b5645824-fba2-48d7-aae3-c7f0c0091fff tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:54:27.513726 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-b5645824-fba2-48d7-aae3-c7f0c0091fff tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c18e88436f14dc7a2001220b87ce9ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60998f08c40446e787ead285e40665b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:54:27.521532 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-b5645824-fba2-48d7-aae3-c7f0c0091fff tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] 10.222.0.31 "GET /compute/v2.1/servers/8715736d-99f1-4f4c-af1f-c4bf3fc295d3" status: 200 len: 1522 microversion: 2.1 time: 0.385365 Apr 29 08:54:27.522108 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 155/300] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 08:54:27 2022] GET /compute/v2.1/servers/8715736d-99f1-4f4c-af1f-c4bf3fc295d3 => generated 1522 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 08:54:28.539350 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-2af0c0bc-3b35-49aa-8d4e-07ee69c5f829 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Calling method '>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:54:28.539879 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-2af0c0bc-3b35-49aa-8d4e-07ee69c5f829 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] [instance: 8715736d-99f1-4f4c-af1f-c4bf3fc295d3] Fetching instance by UUID {{(pid=123459) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:54:28.546207 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-2af0c0bc-3b35-49aa-8d4e-07ee69c5f829 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:54:28.546656 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-2af0c0bc-3b35-49aa-8d4e-07ee69c5f829 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:54:28.547419 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-2af0c0bc-3b35-49aa-8d4e-07ee69c5f829 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:54:28.547856 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-2af0c0bc-3b35-49aa-8d4e-07ee69c5f829 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:54:28.678084 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-2af0c0bc-3b35-49aa-8d4e-07ee69c5f829 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c18e88436f14dc7a2001220b87ce9ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60998f08c40446e787ead285e40665b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:54:28.685647 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-2af0c0bc-3b35-49aa-8d4e-07ee69c5f829 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] 10.222.0.31 "GET /compute/v2.1/servers/8715736d-99f1-4f4c-af1f-c4bf3fc295d3" status: 200 len: 1522 microversion: 2.1 time: 0.150366 Apr 29 08:54:28.686225 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 146/301] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 08:54:28 2022] GET /compute/v2.1/servers/8715736d-99f1-4f4c-af1f-c4bf3fc295d3 => generated 1522 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 08:54:29.702798 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-9d433ea2-070d-4b73-b4b8-b7a0cc91d926 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Calling method '>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:54:29.703562 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-9d433ea2-070d-4b73-b4b8-b7a0cc91d926 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] [instance: 8715736d-99f1-4f4c-af1f-c4bf3fc295d3] Fetching instance by UUID {{(pid=123458) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:54:29.712689 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-9d433ea2-070d-4b73-b4b8-b7a0cc91d926 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:54:29.713235 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-9d433ea2-070d-4b73-b4b8-b7a0cc91d926 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:54:29.714047 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-9d433ea2-070d-4b73-b4b8-b7a0cc91d926 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:54:29.714638 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-9d433ea2-070d-4b73-b4b8-b7a0cc91d926 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:54:29.873956 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-9d433ea2-070d-4b73-b4b8-b7a0cc91d926 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c18e88436f14dc7a2001220b87ce9ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60998f08c40446e787ead285e40665b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:54:29.882306 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-9d433ea2-070d-4b73-b4b8-b7a0cc91d926 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] 10.222.0.31 "GET /compute/v2.1/servers/8715736d-99f1-4f4c-af1f-c4bf3fc295d3" status: 200 len: 1522 microversion: 2.1 time: 0.183363 Apr 29 08:54:29.882906 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 156/302] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 08:54:29 2022] GET /compute/v2.1/servers/8715736d-99f1-4f4c-af1f-c4bf3fc295d3 => generated 1522 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 08:54:30.567106 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 29 08:54:30.567653 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: Fri Apr 29 08:54:30 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 29 08:54:30.900761 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-f658f92f-097b-48e2-aa7b-2c03a72da71a tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Calling method '>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:54:30.901359 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-f658f92f-097b-48e2-aa7b-2c03a72da71a tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] [instance: 8715736d-99f1-4f4c-af1f-c4bf3fc295d3] Fetching instance by UUID {{(pid=123459) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:54:30.908934 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-f658f92f-097b-48e2-aa7b-2c03a72da71a tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:54:30.909971 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-f658f92f-097b-48e2-aa7b-2c03a72da71a tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:54:30.910742 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-f658f92f-097b-48e2-aa7b-2c03a72da71a tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:54:30.911169 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-f658f92f-097b-48e2-aa7b-2c03a72da71a tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:54:31.070164 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-f658f92f-097b-48e2-aa7b-2c03a72da71a tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c18e88436f14dc7a2001220b87ce9ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60998f08c40446e787ead285e40665b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:54:31.079191 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-f658f92f-097b-48e2-aa7b-2c03a72da71a tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] 10.222.0.31 "GET /compute/v2.1/servers/8715736d-99f1-4f4c-af1f-c4bf3fc295d3" status: 200 len: 1522 microversion: 2.1 time: 0.183449 Apr 29 08:54:31.079690 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 147/303] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 08:54:30 2022] GET /compute/v2.1/servers/8715736d-99f1-4f4c-af1f-c4bf3fc295d3 => generated 1522 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 08:54:32.101595 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-1a929665-91c4-464e-ba88-3f432a279404 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Calling method '>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:54:32.102290 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-1a929665-91c4-464e-ba88-3f432a279404 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] [instance: 8715736d-99f1-4f4c-af1f-c4bf3fc295d3] Fetching instance by UUID {{(pid=123458) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:54:32.108331 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-1a929665-91c4-464e-ba88-3f432a279404 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:54:32.108779 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-1a929665-91c4-464e-ba88-3f432a279404 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:54:32.109554 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-1a929665-91c4-464e-ba88-3f432a279404 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:54:32.109987 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-1a929665-91c4-464e-ba88-3f432a279404 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:54:32.252114 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-1a929665-91c4-464e-ba88-3f432a279404 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c18e88436f14dc7a2001220b87ce9ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60998f08c40446e787ead285e40665b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:54:32.260264 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-1a929665-91c4-464e-ba88-3f432a279404 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] 10.222.0.31 "GET /compute/v2.1/servers/8715736d-99f1-4f4c-af1f-c4bf3fc295d3" status: 200 len: 1522 microversion: 2.1 time: 0.165277 Apr 29 08:54:32.260823 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 157/304] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 08:54:32 2022] GET /compute/v2.1/servers/8715736d-99f1-4f4c-af1f-c4bf3fc295d3 => generated 1522 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 08:54:33.277549 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-a3eac33d-ff89-45cb-9843-0d62a3364af9 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Calling method '>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:54:33.278164 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-a3eac33d-ff89-45cb-9843-0d62a3364af9 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] [instance: 8715736d-99f1-4f4c-af1f-c4bf3fc295d3] Fetching instance by UUID {{(pid=123459) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:54:33.285347 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-a3eac33d-ff89-45cb-9843-0d62a3364af9 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:54:33.285995 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-a3eac33d-ff89-45cb-9843-0d62a3364af9 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:54:33.286779 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-a3eac33d-ff89-45cb-9843-0d62a3364af9 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:54:33.287228 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-a3eac33d-ff89-45cb-9843-0d62a3364af9 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:54:33.421973 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-a3eac33d-ff89-45cb-9843-0d62a3364af9 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c18e88436f14dc7a2001220b87ce9ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60998f08c40446e787ead285e40665b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:54:33.429374 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-a3eac33d-ff89-45cb-9843-0d62a3364af9 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] 10.222.0.31 "GET /compute/v2.1/servers/8715736d-99f1-4f4c-af1f-c4bf3fc295d3" status: 200 len: 1522 microversion: 2.1 time: 0.155617 Apr 29 08:54:33.429942 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 148/305] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 08:54:33 2022] GET /compute/v2.1/servers/8715736d-99f1-4f4c-af1f-c4bf3fc295d3 => generated 1522 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 08:54:34.446877 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-93aac760-8f77-4a14-868c-6eda175d484a tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Calling method '>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:54:34.447478 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-93aac760-8f77-4a14-868c-6eda175d484a tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] [instance: 8715736d-99f1-4f4c-af1f-c4bf3fc295d3] Fetching instance by UUID {{(pid=123458) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:54:34.453423 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-93aac760-8f77-4a14-868c-6eda175d484a tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:54:34.453863 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-93aac760-8f77-4a14-868c-6eda175d484a tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:54:34.454634 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-93aac760-8f77-4a14-868c-6eda175d484a tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:54:34.455065 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-93aac760-8f77-4a14-868c-6eda175d484a tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:54:34.585033 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-93aac760-8f77-4a14-868c-6eda175d484a tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c18e88436f14dc7a2001220b87ce9ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60998f08c40446e787ead285e40665b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:54:34.592743 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-93aac760-8f77-4a14-868c-6eda175d484a tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] 10.222.0.31 "GET /compute/v2.1/servers/8715736d-99f1-4f4c-af1f-c4bf3fc295d3" status: 200 len: 1522 microversion: 2.1 time: 0.149901 Apr 29 08:54:34.593306 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 158/306] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 08:54:34 2022] GET /compute/v2.1/servers/8715736d-99f1-4f4c-af1f-c4bf3fc295d3 => generated 1522 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 08:54:35.105368 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 29 08:54:35.105577 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: Fri Apr 29 08:54:35 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 29 08:54:35.609546 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-a4ca42be-f659-4f96-8b73-319b456cb12c tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Calling method '>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:54:35.610072 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-a4ca42be-f659-4f96-8b73-319b456cb12c tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] [instance: 8715736d-99f1-4f4c-af1f-c4bf3fc295d3] Fetching instance by UUID {{(pid=123459) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:54:35.617159 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-a4ca42be-f659-4f96-8b73-319b456cb12c tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:54:35.617608 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-a4ca42be-f659-4f96-8b73-319b456cb12c tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:54:35.618364 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-a4ca42be-f659-4f96-8b73-319b456cb12c tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:54:35.618793 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-a4ca42be-f659-4f96-8b73-319b456cb12c tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:54:35.749567 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-a4ca42be-f659-4f96-8b73-319b456cb12c tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c18e88436f14dc7a2001220b87ce9ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60998f08c40446e787ead285e40665b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:54:35.757478 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-a4ca42be-f659-4f96-8b73-319b456cb12c tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] 10.222.0.31 "GET /compute/v2.1/servers/8715736d-99f1-4f4c-af1f-c4bf3fc295d3" status: 200 len: 1522 microversion: 2.1 time: 0.151960 Apr 29 08:54:35.758036 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 149/307] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 08:54:35 2022] GET /compute/v2.1/servers/8715736d-99f1-4f4c-af1f-c4bf3fc295d3 => generated 1522 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 08:54:36.774928 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-d738f2b3-8345-4bd1-b9f1-9542c6d3a5e5 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Calling method '>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:54:36.775535 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-d738f2b3-8345-4bd1-b9f1-9542c6d3a5e5 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] [instance: 8715736d-99f1-4f4c-af1f-c4bf3fc295d3] Fetching instance by UUID {{(pid=123458) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:54:36.781749 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-d738f2b3-8345-4bd1-b9f1-9542c6d3a5e5 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:54:36.782202 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-d738f2b3-8345-4bd1-b9f1-9542c6d3a5e5 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:54:36.782979 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-d738f2b3-8345-4bd1-b9f1-9542c6d3a5e5 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:54:36.783414 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-d738f2b3-8345-4bd1-b9f1-9542c6d3a5e5 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:54:36.924841 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-d738f2b3-8345-4bd1-b9f1-9542c6d3a5e5 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c18e88436f14dc7a2001220b87ce9ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60998f08c40446e787ead285e40665b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:54:36.933381 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-d738f2b3-8345-4bd1-b9f1-9542c6d3a5e5 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] 10.222.0.31 "GET /compute/v2.1/servers/8715736d-99f1-4f4c-af1f-c4bf3fc295d3" status: 200 len: 1502 microversion: 2.1 time: 0.162201 Apr 29 08:54:36.934196 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 159/308] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 08:54:36 2022] GET /compute/v2.1/servers/8715736d-99f1-4f4c-af1f-c4bf3fc295d3 => generated 1502 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 08:54:36.951132 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-62d1ae5f-5c18-49f1-be43-74160c53a894 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Calling method '>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:54:36.951728 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-62d1ae5f-5c18-49f1-be43-74160c53a894 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] [instance: 4e972e2b-7b5e-4a5f-87a1-3642aad3ac24] Fetching instance by UUID {{(pid=123459) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:54:36.959100 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-62d1ae5f-5c18-49f1-be43-74160c53a894 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:54:36.959662 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-62d1ae5f-5c18-49f1-be43-74160c53a894 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:54:36.960351 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-62d1ae5f-5c18-49f1-be43-74160c53a894 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:54:36.960787 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-62d1ae5f-5c18-49f1-be43-74160c53a894 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:54:37.102829 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-62d1ae5f-5c18-49f1-be43-74160c53a894 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c18e88436f14dc7a2001220b87ce9ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60998f08c40446e787ead285e40665b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:54:37.110397 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-62d1ae5f-5c18-49f1-be43-74160c53a894 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] 10.222.0.31 "GET /compute/v2.1/servers/4e972e2b-7b5e-4a5f-87a1-3642aad3ac24" status: 200 len: 1516 microversion: 2.1 time: 0.163135 Apr 29 08:54:37.111084 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 150/309] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 08:54:36 2022] GET /compute/v2.1/servers/4e972e2b-7b5e-4a5f-87a1-3642aad3ac24 => generated 1516 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 29 08:54:37.524193 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-cbb308c7-d580-47e6-bd95-2549b5aa5be2 tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1865719688", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1911035885", "security_groups": [{"name": "tempest-secgroup-smoke-1876456731"}], "networks": [{"uuid": "25bd8405-5461-41fe-854e-bd663e55c337"}], "block_device_mapping_v2": [{"uuid": "afd2d6e3-30ad-4161-a405-a8605cae649c", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 29 08:54:37.653189 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.network.neutron [None req-cbb308c7-d580-47e6-bd95-2549b5aa5be2 tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] validate_networks() for [('25bd8405-5461-41fe-854e-bd663e55c337', None, None, None, None, None)] {{(pid=123458) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 29 08:54:38.056616 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.virt.hardware [None req-cbb308c7-d580-47e6-bd95-2549b5aa5be2 tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] Flavor limits 0:0:0 {{(pid=123458) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 29 08:54:38.057214 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.virt.hardware [None req-cbb308c7-d580-47e6-bd95-2549b5aa5be2 tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] Image limits 0:0:0 {{(pid=123458) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 29 08:54:38.057495 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.virt.hardware [None req-cbb308c7-d580-47e6-bd95-2549b5aa5be2 tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] Flavor pref 0:0:0 {{(pid=123458) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 29 08:54:38.057902 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.virt.hardware [None req-cbb308c7-d580-47e6-bd95-2549b5aa5be2 tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] Image pref 0:0:0 {{(pid=123458) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 29 08:54:38.058313 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.virt.hardware [None req-cbb308c7-d580-47e6-bd95-2549b5aa5be2 tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123458) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 29 08:54:38.068380 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-cbb308c7-d580-47e6-bd95-2549b5aa5be2 tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:54:38.068828 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-cbb308c7-d580-47e6-bd95-2549b5aa5be2 tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:54:38.069626 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-cbb308c7-d580-47e6-bd95-2549b5aa5be2 tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:54:38.070057 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-cbb308c7-d580-47e6-bd95-2549b5aa5be2 tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:54:38.087186 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.quota [None req-cbb308c7-d580-47e6-bd95-2549b5aa5be2 tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] Getting quotas for project 0436edb5348a4ad5a0b6b5979a7c54fa. Resources: {'instances', 'cores', 'ram'} {{(pid=123458) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 29 08:54:38.091101 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.quota [None req-cbb308c7-d580-47e6-bd95-2549b5aa5be2 tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] Getting quotas for user dcf1c67873b7443084ea183c77698062 and project 0436edb5348a4ad5a0b6b5979a7c54fa. Resources: {'instances', 'cores', 'ram'} {{(pid=123458) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 29 08:54:38.152273 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-cbb308c7-d580-47e6-bd95-2549b5aa5be2 tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] Going to run 1 instances... {{(pid=123458) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 29 08:54:38.155472 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-cbb308c7-d580-47e6-bd95-2549b5aa5be2 tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] [instance: d83c29d2-6435-4edc-827b-2c37a66fb199] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='afd2d6e3-30ad-4161-a405-a8605cae649c',volume_size=None,volume_type=None)] {{(pid=123458) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 29 08:54:38.295845 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-cbb308c7-d580-47e6-bd95-2549b5aa5be2 tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] 10.222.0.31 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.775416 Apr 29 08:54:38.296533 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 160/310] 10.222.0.31 () {60 vars in 1146 bytes} [Fri Apr 29 08:54:37 2022] POST /compute/v2.1/servers => generated 406 bytes in 777 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 29 08:54:38.307477 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-9d242734-2d4c-4348-b24c-86a98ff58516 tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] Calling method '>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:54:38.308246 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-9d242734-2d4c-4348-b24c-86a98ff58516 tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] [instance: d83c29d2-6435-4edc-827b-2c37a66fb199] Fetching instance by UUID {{(pid=123459) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:54:38.370700 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-9d242734-2d4c-4348-b24c-86a98ff58516 tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcf1c67873b7443084ea183c77698062', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0436edb5348a4ad5a0b6b5979a7c54fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:54:38.380802 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-9d242734-2d4c-4348-b24c-86a98ff58516 tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] 10.222.0.31 "GET /compute/v2.1/servers/d83c29d2-6435-4edc-827b-2c37a66fb199" status: 200 len: 1089 microversion: 2.1 time: 0.076844 Apr 29 08:54:38.381463 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 151/311] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 08:54:38 2022] GET /compute/v2.1/servers/d83c29d2-6435-4edc-827b-2c37a66fb199 => generated 1089 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 08:54:38.820792 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-ee0da24c-f394-4acb-a966-7af2436283a8 tempest-VolumesSnapshotTestJSON-1697003112 tempest-VolumesSnapshotTestJSON-1697003112-project] Calling method '>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:54:38.821652 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-ee0da24c-f394-4acb-a966-7af2436283a8 tempest-VolumesSnapshotTestJSON-1697003112 tempest-VolumesSnapshotTestJSON-1697003112-project] [instance: 620e45e7-5ce1-4319-8b61-5aaff72e47aa] Fetching instance by UUID {{(pid=123458) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:54:38.828918 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-ee0da24c-f394-4acb-a966-7af2436283a8 tempest-VolumesSnapshotTestJSON-1697003112 tempest-VolumesSnapshotTestJSON-1697003112-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:54:38.829675 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-ee0da24c-f394-4acb-a966-7af2436283a8 tempest-VolumesSnapshotTestJSON-1697003112 tempest-VolumesSnapshotTestJSON-1697003112-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:54:38.833483 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-ee0da24c-f394-4acb-a966-7af2436283a8 tempest-VolumesSnapshotTestJSON-1697003112 tempest-VolumesSnapshotTestJSON-1697003112-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:54:38.833483 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-ee0da24c-f394-4acb-a966-7af2436283a8 tempest-VolumesSnapshotTestJSON-1697003112 tempest-VolumesSnapshotTestJSON-1697003112-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:54:38.995547 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.objects.instance [None req-ee0da24c-f394-4acb-a966-7af2436283a8 tempest-VolumesSnapshotTestJSON-1697003112 tempest-VolumesSnapshotTestJSON-1697003112-project] Lazy-loading 'services' on Instance uuid 620e45e7-5ce1-4319-8b61-5aaff72e47aa {{(pid=123458) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 29 08:54:39.262384 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-ee0da24c-f394-4acb-a966-7af2436283a8 tempest-VolumesSnapshotTestJSON-1697003112 tempest-VolumesSnapshotTestJSON-1697003112-project] 10.222.0.31 "DELETE /compute/v2.1/servers/620e45e7-5ce1-4319-8b61-5aaff72e47aa/os-volume_attachments/ddfb2b26-7696-4eee-9ed1-ae752b66cb06" status: 202 len: 0 microversion: 2.1 time: 0.447226 Apr 29 08:54:39.263295 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 161/312] 10.222.0.31 () {58 vars in 1415 bytes} [Fri Apr 29 08:54:38 2022] DELETE /compute/v2.1/servers/620e45e7-5ce1-4319-8b61-5aaff72e47aa/os-volume_attachments/ddfb2b26-7696-4eee-9ed1-ae752b66cb06 => generated 0 bytes in 449 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Apr 29 08:54:39.400507 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-70423fa1-4026-40be-b6d3-499743886371 tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] Calling method '>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:54:39.401196 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-70423fa1-4026-40be-b6d3-499743886371 tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] [instance: d83c29d2-6435-4edc-827b-2c37a66fb199] Fetching instance by UUID {{(pid=123459) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:54:39.413208 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-70423fa1-4026-40be-b6d3-499743886371 tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:54:39.413747 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-70423fa1-4026-40be-b6d3-499743886371 tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:54:39.414609 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-70423fa1-4026-40be-b6d3-499743886371 tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:54:39.415661 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-70423fa1-4026-40be-b6d3-499743886371 tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:54:39.508364 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-70423fa1-4026-40be-b6d3-499743886371 tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcf1c67873b7443084ea183c77698062', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0436edb5348a4ad5a0b6b5979a7c54fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:54:39.518087 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-70423fa1-4026-40be-b6d3-499743886371 tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] 10.222.0.31 "GET /compute/v2.1/servers/d83c29d2-6435-4edc-827b-2c37a66fb199" status: 200 len: 1195 microversion: 2.1 time: 0.122135 Apr 29 08:54:39.518959 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 152/313] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 08:54:39 2022] GET /compute/v2.1/servers/d83c29d2-6435-4edc-827b-2c37a66fb199 => generated 1195 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 08:54:40.536342 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-0b64ce46-b5a1-45e1-a738-b9687859242a tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] Calling method '>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:54:40.537054 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-0b64ce46-b5a1-45e1-a738-b9687859242a tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] [instance: d83c29d2-6435-4edc-827b-2c37a66fb199] Fetching instance by UUID {{(pid=123458) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:54:40.543549 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-0b64ce46-b5a1-45e1-a738-b9687859242a tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:54:40.543981 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-0b64ce46-b5a1-45e1-a738-b9687859242a tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:54:40.544787 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-0b64ce46-b5a1-45e1-a738-b9687859242a tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:54:40.545214 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-0b64ce46-b5a1-45e1-a738-b9687859242a tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:54:40.612687 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-0b64ce46-b5a1-45e1-a738-b9687859242a tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcf1c67873b7443084ea183c77698062', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0436edb5348a4ad5a0b6b5979a7c54fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:54:40.623668 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-0b64ce46-b5a1-45e1-a738-b9687859242a tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] 10.222.0.31 "GET /compute/v2.1/servers/d83c29d2-6435-4edc-827b-2c37a66fb199" status: 200 len: 1205 microversion: 2.1 time: 0.091667 Apr 29 08:54:40.624291 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 162/314] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 08:54:40 2022] GET /compute/v2.1/servers/d83c29d2-6435-4edc-827b-2c37a66fb199 => generated 1205 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 08:54:40.638322 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-474d3171-1530-4e60-bb98-be610ea46ba6 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 29 08:54:40.639393 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-474d3171-1530-4e60-bb98-be610ea46ba6 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] [instance: 4e972e2b-7b5e-4a5f-87a1-3642aad3ac24] Fetching instance by UUID {{(pid=123459) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:54:40.647199 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-474d3171-1530-4e60-bb98-be610ea46ba6 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:54:40.647714 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-474d3171-1530-4e60-bb98-be610ea46ba6 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:54:40.648609 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-474d3171-1530-4e60-bb98-be610ea46ba6 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:54:40.649136 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-474d3171-1530-4e60-bb98-be610ea46ba6 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:54:40.673484 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.objects.instance [None req-474d3171-1530-4e60-bb98-be610ea46ba6 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lazy-loading 'flavor' on Instance uuid 4e972e2b-7b5e-4a5f-87a1-3642aad3ac24 {{(pid=123459) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 29 08:54:40.754674 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-474d3171-1530-4e60-bb98-be610ea46ba6 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] 10.222.0.31 "POST /compute/v2.1/servers/4e972e2b-7b5e-4a5f-87a1-3642aad3ac24/action" status: 200 len: 32 microversion: 2.1 time: 0.122578 Apr 29 08:54:40.755285 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 153/315] 10.222.0.31 () {60 vars in 1277 bytes} [Fri Apr 29 08:54:40 2022] POST /compute/v2.1/servers/4e972e2b-7b5e-4a5f-87a1-3642aad3ac24/action => generated 32 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 29 08:54:40.764946 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-29e30f01-e821-4a99-bff0-0dca9e47f3f1 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Calling method '>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:54:40.765619 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-29e30f01-e821-4a99-bff0-0dca9e47f3f1 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] [instance: 4e972e2b-7b5e-4a5f-87a1-3642aad3ac24] Fetching instance by UUID {{(pid=123458) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:54:40.772451 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-29e30f01-e821-4a99-bff0-0dca9e47f3f1 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:54:40.772906 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-29e30f01-e821-4a99-bff0-0dca9e47f3f1 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:54:40.773725 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-29e30f01-e821-4a99-bff0-0dca9e47f3f1 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:54:40.774165 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-29e30f01-e821-4a99-bff0-0dca9e47f3f1 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:54:40.930538 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-29e30f01-e821-4a99-bff0-0dca9e47f3f1 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c18e88436f14dc7a2001220b87ce9ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60998f08c40446e787ead285e40665b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:54:40.941273 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-29e30f01-e821-4a99-bff0-0dca9e47f3f1 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] 10.222.0.31 "GET /compute/v2.1/servers/4e972e2b-7b5e-4a5f-87a1-3642aad3ac24" status: 200 len: 1522 microversion: 2.1 time: 0.179454 Apr 29 08:54:40.951877 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 163/316] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 08:54:40 2022] GET /compute/v2.1/servers/4e972e2b-7b5e-4a5f-87a1-3642aad3ac24 => generated 1522 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 08:54:41.643501 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-d1df4a3d-af69-4968-8024-2c32061b23b3 tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] Calling method '>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:54:41.644105 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-d1df4a3d-af69-4968-8024-2c32061b23b3 tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] [instance: d83c29d2-6435-4edc-827b-2c37a66fb199] Fetching instance by UUID {{(pid=123459) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:54:41.650888 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-d1df4a3d-af69-4968-8024-2c32061b23b3 tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:54:41.651331 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-d1df4a3d-af69-4968-8024-2c32061b23b3 tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:54:41.652106 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-d1df4a3d-af69-4968-8024-2c32061b23b3 tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:54:41.652560 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-d1df4a3d-af69-4968-8024-2c32061b23b3 tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:54:41.720062 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-d1df4a3d-af69-4968-8024-2c32061b23b3 tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcf1c67873b7443084ea183c77698062', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0436edb5348a4ad5a0b6b5979a7c54fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:54:41.728740 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-d1df4a3d-af69-4968-8024-2c32061b23b3 tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] 10.222.0.31 "GET /compute/v2.1/servers/d83c29d2-6435-4edc-827b-2c37a66fb199" status: 200 len: 1205 microversion: 2.1 time: 0.090027 Apr 29 08:54:41.729381 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 154/317] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 08:54:41 2022] GET /compute/v2.1/servers/d83c29d2-6435-4edc-827b-2c37a66fb199 => generated 1205 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 08:54:41.958951 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-0a0372c8-819b-4c3f-a10a-432148370e3b tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Calling method '>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:54:41.959600 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-0a0372c8-819b-4c3f-a10a-432148370e3b tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] [instance: 4e972e2b-7b5e-4a5f-87a1-3642aad3ac24] Fetching instance by UUID {{(pid=123458) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:54:41.965703 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-0a0372c8-819b-4c3f-a10a-432148370e3b tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:54:41.966146 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-0a0372c8-819b-4c3f-a10a-432148370e3b tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:54:41.966917 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-0a0372c8-819b-4c3f-a10a-432148370e3b tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:54:41.967345 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-0a0372c8-819b-4c3f-a10a-432148370e3b tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:54:42.138169 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-0a0372c8-819b-4c3f-a10a-432148370e3b tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c18e88436f14dc7a2001220b87ce9ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60998f08c40446e787ead285e40665b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:54:42.147336 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-0a0372c8-819b-4c3f-a10a-432148370e3b tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] 10.222.0.31 "GET /compute/v2.1/servers/4e972e2b-7b5e-4a5f-87a1-3642aad3ac24" status: 200 len: 1522 microversion: 2.1 time: 0.192159 Apr 29 08:54:42.147980 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 164/318] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 08:54:41 2022] GET /compute/v2.1/servers/4e972e2b-7b5e-4a5f-87a1-3642aad3ac24 => generated 1522 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 08:54:42.753558 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-e4c35994-aada-462a-8b38-f83a6fa8a4b6 tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] Calling method '>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:54:42.754558 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-e4c35994-aada-462a-8b38-f83a6fa8a4b6 tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] [instance: d83c29d2-6435-4edc-827b-2c37a66fb199] Fetching instance by UUID {{(pid=123459) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:54:42.761698 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-e4c35994-aada-462a-8b38-f83a6fa8a4b6 tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:54:42.762141 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-e4c35994-aada-462a-8b38-f83a6fa8a4b6 tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:54:42.762910 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-e4c35994-aada-462a-8b38-f83a6fa8a4b6 tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:54:42.763340 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-e4c35994-aada-462a-8b38-f83a6fa8a4b6 tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:54:42.842865 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-e4c35994-aada-462a-8b38-f83a6fa8a4b6 tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcf1c67873b7443084ea183c77698062', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0436edb5348a4ad5a0b6b5979a7c54fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:54:42.853714 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-e4c35994-aada-462a-8b38-f83a6fa8a4b6 tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] 10.222.0.31 "GET /compute/v2.1/servers/d83c29d2-6435-4edc-827b-2c37a66fb199" status: 200 len: 1205 microversion: 2.1 time: 0.104226 Apr 29 08:54:42.854405 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 155/319] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 08:54:42 2022] GET /compute/v2.1/servers/d83c29d2-6435-4edc-827b-2c37a66fb199 => generated 1205 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 08:54:43.167297 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-5b450894-6374-42dc-95e4-9c12cdc19add tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Calling method '>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:54:43.168673 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-5b450894-6374-42dc-95e4-9c12cdc19add tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] [instance: 4e972e2b-7b5e-4a5f-87a1-3642aad3ac24] Fetching instance by UUID {{(pid=123458) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:54:43.180679 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-5b450894-6374-42dc-95e4-9c12cdc19add tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:54:43.181496 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-5b450894-6374-42dc-95e4-9c12cdc19add tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:54:43.182784 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-5b450894-6374-42dc-95e4-9c12cdc19add tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:54:43.183515 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-5b450894-6374-42dc-95e4-9c12cdc19add tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:54:43.386036 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-5b450894-6374-42dc-95e4-9c12cdc19add tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c18e88436f14dc7a2001220b87ce9ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60998f08c40446e787ead285e40665b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:54:43.399737 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-5b450894-6374-42dc-95e4-9c12cdc19add tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] 10.222.0.31 "GET /compute/v2.1/servers/4e972e2b-7b5e-4a5f-87a1-3642aad3ac24" status: 200 len: 1522 microversion: 2.1 time: 0.236216 Apr 29 08:54:43.400754 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 165/320] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 08:54:43 2022] GET /compute/v2.1/servers/4e972e2b-7b5e-4a5f-87a1-3642aad3ac24 => generated 1522 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 08:54:43.874964 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-3d53f440-dce4-402e-8146-b1a2144f7b1b tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] Calling method '>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:54:43.875756 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-3d53f440-dce4-402e-8146-b1a2144f7b1b tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] [instance: d83c29d2-6435-4edc-827b-2c37a66fb199] Fetching instance by UUID {{(pid=123459) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:54:43.884973 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-3d53f440-dce4-402e-8146-b1a2144f7b1b tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:54:43.885386 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-3d53f440-dce4-402e-8146-b1a2144f7b1b tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:54:43.886283 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-3d53f440-dce4-402e-8146-b1a2144f7b1b tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:54:43.886831 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-3d53f440-dce4-402e-8146-b1a2144f7b1b tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:54:43.980998 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-3d53f440-dce4-402e-8146-b1a2144f7b1b tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcf1c67873b7443084ea183c77698062', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0436edb5348a4ad5a0b6b5979a7c54fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:54:43.989671 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-3d53f440-dce4-402e-8146-b1a2144f7b1b tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] 10.222.0.31 "GET /compute/v2.1/servers/d83c29d2-6435-4edc-827b-2c37a66fb199" status: 200 len: 1205 microversion: 2.1 time: 0.118797 Apr 29 08:54:43.990199 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 156/321] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 08:54:43 2022] GET /compute/v2.1/servers/d83c29d2-6435-4edc-827b-2c37a66fb199 => generated 1205 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 29 08:54:44.426934 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-e8e5166a-dafa-43f4-91b8-e35a83fc9860 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Calling method '>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:54:44.427677 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-e8e5166a-dafa-43f4-91b8-e35a83fc9860 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] [instance: 4e972e2b-7b5e-4a5f-87a1-3642aad3ac24] Fetching instance by UUID {{(pid=123458) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:54:44.434051 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-e8e5166a-dafa-43f4-91b8-e35a83fc9860 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:54:44.434521 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-e8e5166a-dafa-43f4-91b8-e35a83fc9860 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:54:44.435341 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-e8e5166a-dafa-43f4-91b8-e35a83fc9860 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:54:44.435787 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-e8e5166a-dafa-43f4-91b8-e35a83fc9860 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:54:44.612797 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-e8e5166a-dafa-43f4-91b8-e35a83fc9860 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c18e88436f14dc7a2001220b87ce9ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60998f08c40446e787ead285e40665b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:54:44.626977 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-e8e5166a-dafa-43f4-91b8-e35a83fc9860 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] 10.222.0.31 "GET /compute/v2.1/servers/4e972e2b-7b5e-4a5f-87a1-3642aad3ac24" status: 200 len: 1522 microversion: 2.1 time: 0.204547 Apr 29 08:54:44.627873 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 166/322] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 08:54:44 2022] GET /compute/v2.1/servers/4e972e2b-7b5e-4a5f-87a1-3642aad3ac24 => generated 1522 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 08:54:45.008238 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-1f0d3881-cc5a-4d59-ab80-c23d21514bd8 tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] Calling method '>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:54:45.010747 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-1f0d3881-cc5a-4d59-ab80-c23d21514bd8 tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] [instance: d83c29d2-6435-4edc-827b-2c37a66fb199] Fetching instance by UUID {{(pid=123459) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:54:45.015660 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-1f0d3881-cc5a-4d59-ab80-c23d21514bd8 tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:54:45.016113 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-1f0d3881-cc5a-4d59-ab80-c23d21514bd8 tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:54:45.016937 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-1f0d3881-cc5a-4d59-ab80-c23d21514bd8 tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:54:45.017378 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-1f0d3881-cc5a-4d59-ab80-c23d21514bd8 tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:54:45.095433 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-1f0d3881-cc5a-4d59-ab80-c23d21514bd8 tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcf1c67873b7443084ea183c77698062', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0436edb5348a4ad5a0b6b5979a7c54fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:54:45.116451 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-1f0d3881-cc5a-4d59-ab80-c23d21514bd8 tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] 10.222.0.31 "GET /compute/v2.1/servers/d83c29d2-6435-4edc-827b-2c37a66fb199" status: 200 len: 1205 microversion: 2.1 time: 0.103446 Apr 29 08:54:45.116451 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 157/323] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 08:54:45 2022] GET /compute/v2.1/servers/d83c29d2-6435-4edc-827b-2c37a66fb199 => generated 1205 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 29 08:54:45.654167 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-c6a601c9-4595-44d3-bf7d-769eeba3a614 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Calling method '>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:54:45.655761 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-c6a601c9-4595-44d3-bf7d-769eeba3a614 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] [instance: 4e972e2b-7b5e-4a5f-87a1-3642aad3ac24] Fetching instance by UUID {{(pid=123458) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:54:45.677481 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-c6a601c9-4595-44d3-bf7d-769eeba3a614 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:54:45.679046 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-c6a601c9-4595-44d3-bf7d-769eeba3a614 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:54:45.680934 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-c6a601c9-4595-44d3-bf7d-769eeba3a614 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:54:45.682868 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-c6a601c9-4595-44d3-bf7d-769eeba3a614 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:54:46.029316 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-c6a601c9-4595-44d3-bf7d-769eeba3a614 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c18e88436f14dc7a2001220b87ce9ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60998f08c40446e787ead285e40665b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:54:46.039065 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-c6a601c9-4595-44d3-bf7d-769eeba3a614 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] 10.222.0.31 "GET /compute/v2.1/servers/4e972e2b-7b5e-4a5f-87a1-3642aad3ac24" status: 200 len: 1522 microversion: 2.1 time: 0.396316 Apr 29 08:54:46.039711 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 167/324] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 08:54:45 2022] GET /compute/v2.1/servers/4e972e2b-7b5e-4a5f-87a1-3642aad3ac24 => generated 1522 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 08:54:46.140753 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-9db31a1d-61da-4f9f-907c-c10d14ec2bc2 tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] Calling method '>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:54:46.141930 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-9db31a1d-61da-4f9f-907c-c10d14ec2bc2 tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] [instance: d83c29d2-6435-4edc-827b-2c37a66fb199] Fetching instance by UUID {{(pid=123459) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:54:46.164402 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-9db31a1d-61da-4f9f-907c-c10d14ec2bc2 tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:54:46.165057 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-9db31a1d-61da-4f9f-907c-c10d14ec2bc2 tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:54:46.167795 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-9db31a1d-61da-4f9f-907c-c10d14ec2bc2 tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:54:46.168918 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-9db31a1d-61da-4f9f-907c-c10d14ec2bc2 tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:54:46.510391 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-9db31a1d-61da-4f9f-907c-c10d14ec2bc2 tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcf1c67873b7443084ea183c77698062', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0436edb5348a4ad5a0b6b5979a7c54fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:54:46.520357 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-9db31a1d-61da-4f9f-907c-c10d14ec2bc2 tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] 10.222.0.31 "GET /compute/v2.1/servers/d83c29d2-6435-4edc-827b-2c37a66fb199" status: 200 len: 1273 microversion: 2.1 time: 0.397548 Apr 29 08:54:46.521646 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 158/325] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 08:54:46 2022] GET /compute/v2.1/servers/d83c29d2-6435-4edc-827b-2c37a66fb199 => generated 1273 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 08:54:46.845812 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-0b0758d8-4893-4520-ab00-4d7211c2d48d tempest-VolumesSnapshotTestJSON-1697003112 tempest-VolumesSnapshotTestJSON-1697003112-project] Calling method '>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:54:46.847468 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-0b0758d8-4893-4520-ab00-4d7211c2d48d tempest-VolumesSnapshotTestJSON-1697003112 tempest-VolumesSnapshotTestJSON-1697003112-project] [instance: 620e45e7-5ce1-4319-8b61-5aaff72e47aa] Fetching instance by UUID {{(pid=123458) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:54:46.854481 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-0b0758d8-4893-4520-ab00-4d7211c2d48d tempest-VolumesSnapshotTestJSON-1697003112 tempest-VolumesSnapshotTestJSON-1697003112-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:54:46.855199 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-0b0758d8-4893-4520-ab00-4d7211c2d48d tempest-VolumesSnapshotTestJSON-1697003112 tempest-VolumesSnapshotTestJSON-1697003112-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:54:46.855998 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-0b0758d8-4893-4520-ab00-4d7211c2d48d tempest-VolumesSnapshotTestJSON-1697003112 tempest-VolumesSnapshotTestJSON-1697003112-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:54:46.856702 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-0b0758d8-4893-4520-ab00-4d7211c2d48d tempest-VolumesSnapshotTestJSON-1697003112 tempest-VolumesSnapshotTestJSON-1697003112-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:54:46.894685 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-0b0758d8-4893-4520-ab00-4d7211c2d48d tempest-VolumesSnapshotTestJSON-1697003112 tempest-VolumesSnapshotTestJSON-1697003112-project] [instance: 620e45e7-5ce1-4319-8b61-5aaff72e47aa] Going to try to terminate instance {{(pid=123458) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 29 08:54:47.023172 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-0b0758d8-4893-4520-ab00-4d7211c2d48d tempest-VolumesSnapshotTestJSON-1697003112 tempest-VolumesSnapshotTestJSON-1697003112-project] 10.222.0.31 "DELETE /compute/v2.1/servers/620e45e7-5ce1-4319-8b61-5aaff72e47aa" status: 204 len: 0 microversion: 2.1 time: 0.180924 Apr 29 08:54:47.024398 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 168/326] 10.222.0.31 () {58 vars in 1238 bytes} [Fri Apr 29 08:54:46 2022] DELETE /compute/v2.1/servers/620e45e7-5ce1-4319-8b61-5aaff72e47aa => generated 0 bytes in 183 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Apr 29 08:54:47.035293 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-ee158189-0520-4516-8e59-314592d4a8f4 tempest-VolumesSnapshotTestJSON-1697003112 tempest-VolumesSnapshotTestJSON-1697003112-project] Calling method '>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:54:47.036508 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-ee158189-0520-4516-8e59-314592d4a8f4 tempest-VolumesSnapshotTestJSON-1697003112 tempest-VolumesSnapshotTestJSON-1697003112-project] [instance: 620e45e7-5ce1-4319-8b61-5aaff72e47aa] Fetching instance by UUID {{(pid=123459) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:54:47.044829 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-ee158189-0520-4516-8e59-314592d4a8f4 tempest-VolumesSnapshotTestJSON-1697003112 tempest-VolumesSnapshotTestJSON-1697003112-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:54:47.046144 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-ee158189-0520-4516-8e59-314592d4a8f4 tempest-VolumesSnapshotTestJSON-1697003112 tempest-VolumesSnapshotTestJSON-1697003112-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:54:47.047195 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-ee158189-0520-4516-8e59-314592d4a8f4 tempest-VolumesSnapshotTestJSON-1697003112 tempest-VolumesSnapshotTestJSON-1697003112-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:54:47.047938 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-ee158189-0520-4516-8e59-314592d4a8f4 tempest-VolumesSnapshotTestJSON-1697003112 tempest-VolumesSnapshotTestJSON-1697003112-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:54:47.065301 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-b9d08b77-1920-4b3a-9c56-be905ccecbc8 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Calling method '>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:54:47.068074 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-b9d08b77-1920-4b3a-9c56-be905ccecbc8 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] [instance: 4e972e2b-7b5e-4a5f-87a1-3642aad3ac24] Fetching instance by UUID {{(pid=123458) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:54:47.079064 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-b9d08b77-1920-4b3a-9c56-be905ccecbc8 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:54:47.080312 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-b9d08b77-1920-4b3a-9c56-be905ccecbc8 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:54:47.083343 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-b9d08b77-1920-4b3a-9c56-be905ccecbc8 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:54:47.084437 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-b9d08b77-1920-4b3a-9c56-be905ccecbc8 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:54:47.362886 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-b9d08b77-1920-4b3a-9c56-be905ccecbc8 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c18e88436f14dc7a2001220b87ce9ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60998f08c40446e787ead285e40665b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:54:47.377077 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-b9d08b77-1920-4b3a-9c56-be905ccecbc8 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] 10.222.0.31 "GET /compute/v2.1/servers/4e972e2b-7b5e-4a5f-87a1-3642aad3ac24" status: 200 len: 1522 microversion: 2.1 time: 0.316487 Apr 29 08:54:47.379085 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 169/327] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 08:54:47 2022] GET /compute/v2.1/servers/4e972e2b-7b5e-4a5f-87a1-3642aad3ac24 => generated 1522 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 08:54:47.402049 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-ee158189-0520-4516-8e59-314592d4a8f4 tempest-VolumesSnapshotTestJSON-1697003112 tempest-VolumesSnapshotTestJSON-1697003112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a210cf812fb54682ac28a13a5dce0563', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c0d26c7abcc4bc7b175ac175bb5f2ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:54:47.424287 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-ee158189-0520-4516-8e59-314592d4a8f4 tempest-VolumesSnapshotTestJSON-1697003112 tempest-VolumesSnapshotTestJSON-1697003112-project] 10.222.0.31 "GET /compute/v2.1/servers/620e45e7-5ce1-4319-8b61-5aaff72e47aa" status: 200 len: 1514 microversion: 2.1 time: 0.395062 Apr 29 08:54:47.425248 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 159/328] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 08:54:47 2022] GET /compute/v2.1/servers/620e45e7-5ce1-4319-8b61-5aaff72e47aa => generated 1514 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 29 08:54:47.544252 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-9d74520b-2a58-4456-a4d0-f224479e1230 tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] Calling method '>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:54:47.546883 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-9d74520b-2a58-4456-a4d0-f224479e1230 tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] [instance: d83c29d2-6435-4edc-827b-2c37a66fb199] Fetching instance by UUID {{(pid=123458) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:54:47.564920 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-9d74520b-2a58-4456-a4d0-f224479e1230 tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:54:47.566985 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-9d74520b-2a58-4456-a4d0-f224479e1230 tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:54:47.568603 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-9d74520b-2a58-4456-a4d0-f224479e1230 tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:54:47.569763 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-9d74520b-2a58-4456-a4d0-f224479e1230 tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:54:47.646137 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [req-25b04b50-8dc4-4165-a2cd-e5a2c50395a9 req-cb23ad60-296d-4210-9963-b6a956e1e0d6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d83c29d2-6435-4edc-827b-2c37a66fb199", "tag": "67bd0bd8-da3b-4ea7-9bf9-bfddba4f2c80"}]} {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 29 08:54:47.664584 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [req-25b04b50-8dc4-4165-a2cd-e5a2c50395a9 req-cb23ad60-296d-4210-9963-b6a956e1e0d6 service nova] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:54:47.665521 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [req-25b04b50-8dc4-4165-a2cd-e5a2c50395a9 req-cb23ad60-296d-4210-9963-b6a956e1e0d6 service nova] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:54:47.688964 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.compute.server_external_events [req-25b04b50-8dc4-4165-a2cd-e5a2c50395a9 req-cb23ad60-296d-4210-9963-b6a956e1e0d6 service nova] Creating event network-changed:67bd0bd8-da3b-4ea7-9bf9-bfddba4f2c80 for instance d83c29d2-6435-4edc-827b-2c37a66fb199 on hv-cinder-83987 Apr 29 08:54:47.697971 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [req-25b04b50-8dc4-4165-a2cd-e5a2c50395a9 req-cb23ad60-296d-4210-9963-b6a956e1e0d6 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058814 Apr 29 08:54:47.698922 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 160/329] 10.222.0.31 () {64 vars in 1317 bytes} [Fri Apr 29 08:54:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 29 08:54:47.848502 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-9d74520b-2a58-4456-a4d0-f224479e1230 tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcf1c67873b7443084ea183c77698062', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0436edb5348a4ad5a0b6b5979a7c54fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:54:47.856780 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-9d74520b-2a58-4456-a4d0-f224479e1230 tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] 10.222.0.31 "GET /compute/v2.1/servers/d83c29d2-6435-4edc-827b-2c37a66fb199" status: 200 len: 1261 microversion: 2.1 time: 0.321351 Apr 29 08:54:47.857702 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 170/330] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 08:54:47 2022] GET /compute/v2.1/servers/d83c29d2-6435-4edc-827b-2c37a66fb199 => generated 1261 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 08:54:48.397638 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-853d2312-bb2b-4131-88c2-b167015ae292 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Calling method '>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:54:48.398344 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-853d2312-bb2b-4131-88c2-b167015ae292 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] [instance: 4e972e2b-7b5e-4a5f-87a1-3642aad3ac24] Fetching instance by UUID {{(pid=123459) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:54:48.405684 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-853d2312-bb2b-4131-88c2-b167015ae292 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:54:48.406468 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-853d2312-bb2b-4131-88c2-b167015ae292 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:54:48.406911 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-853d2312-bb2b-4131-88c2-b167015ae292 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:54:48.407347 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-853d2312-bb2b-4131-88c2-b167015ae292 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:54:48.445540 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-5dce78c6-ebf2-4922-a748-914d6dcd6c0a tempest-VolumesSnapshotTestJSON-1697003112 tempest-VolumesSnapshotTestJSON-1697003112-project] Calling method '>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:54:48.447045 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-5dce78c6-ebf2-4922-a748-914d6dcd6c0a tempest-VolumesSnapshotTestJSON-1697003112 tempest-VolumesSnapshotTestJSON-1697003112-project] [instance: 620e45e7-5ce1-4319-8b61-5aaff72e47aa] Fetching instance by UUID {{(pid=123458) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:54:48.457921 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-5dce78c6-ebf2-4922-a748-914d6dcd6c0a tempest-VolumesSnapshotTestJSON-1697003112 tempest-VolumesSnapshotTestJSON-1697003112-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:54:48.458477 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-5dce78c6-ebf2-4922-a748-914d6dcd6c0a tempest-VolumesSnapshotTestJSON-1697003112 tempest-VolumesSnapshotTestJSON-1697003112-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:54:48.459471 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-5dce78c6-ebf2-4922-a748-914d6dcd6c0a tempest-VolumesSnapshotTestJSON-1697003112 tempest-VolumesSnapshotTestJSON-1697003112-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:54:48.459983 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-5dce78c6-ebf2-4922-a748-914d6dcd6c0a tempest-VolumesSnapshotTestJSON-1697003112 tempest-VolumesSnapshotTestJSON-1697003112-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:54:48.635257 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-853d2312-bb2b-4131-88c2-b167015ae292 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c18e88436f14dc7a2001220b87ce9ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60998f08c40446e787ead285e40665b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:54:48.642750 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-853d2312-bb2b-4131-88c2-b167015ae292 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] 10.222.0.31 "GET /compute/v2.1/servers/4e972e2b-7b5e-4a5f-87a1-3642aad3ac24" status: 200 len: 1522 microversion: 2.1 time: 0.250660 Apr 29 08:54:48.643862 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 161/331] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 08:54:48 2022] GET /compute/v2.1/servers/4e972e2b-7b5e-4a5f-87a1-3642aad3ac24 => generated 1522 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 29 08:54:48.653227 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-5dce78c6-ebf2-4922-a748-914d6dcd6c0a tempest-VolumesSnapshotTestJSON-1697003112 tempest-VolumesSnapshotTestJSON-1697003112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a210cf812fb54682ac28a13a5dce0563', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c0d26c7abcc4bc7b175ac175bb5f2ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:54:48.663953 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-5dce78c6-ebf2-4922-a748-914d6dcd6c0a tempest-VolumesSnapshotTestJSON-1697003112 tempest-VolumesSnapshotTestJSON-1697003112-project] 10.222.0.31 "GET /compute/v2.1/servers/620e45e7-5ce1-4319-8b61-5aaff72e47aa" status: 200 len: 1514 microversion: 2.1 time: 0.225896 Apr 29 08:54:48.664569 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 171/332] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 08:54:48 2022] GET /compute/v2.1/servers/620e45e7-5ce1-4319-8b61-5aaff72e47aa => generated 1514 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 29 08:54:48.875117 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-3e11c3e7-37d8-417f-9d14-2aeb3ed97126 tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] Calling method '>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:54:48.875948 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-3e11c3e7-37d8-417f-9d14-2aeb3ed97126 tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] [instance: d83c29d2-6435-4edc-827b-2c37a66fb199] Fetching instance by UUID {{(pid=123459) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:54:48.882919 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-3e11c3e7-37d8-417f-9d14-2aeb3ed97126 tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:54:48.883363 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-3e11c3e7-37d8-417f-9d14-2aeb3ed97126 tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:54:48.884168 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-3e11c3e7-37d8-417f-9d14-2aeb3ed97126 tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:54:48.884642 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-3e11c3e7-37d8-417f-9d14-2aeb3ed97126 tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:54:49.036215 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-3e11c3e7-37d8-417f-9d14-2aeb3ed97126 tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcf1c67873b7443084ea183c77698062', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0436edb5348a4ad5a0b6b5979a7c54fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:54:49.044072 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-3e11c3e7-37d8-417f-9d14-2aeb3ed97126 tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] 10.222.0.31 "GET /compute/v2.1/servers/d83c29d2-6435-4edc-827b-2c37a66fb199" status: 200 len: 1261 microversion: 2.1 time: 0.173108 Apr 29 08:54:49.044937 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 162/333] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 08:54:48 2022] GET /compute/v2.1/servers/d83c29d2-6435-4edc-827b-2c37a66fb199 => generated 1261 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 08:54:49.661928 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-23ab0e02-8fa2-495c-9bcf-7edd26612985 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Calling method '>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:54:49.662566 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-23ab0e02-8fa2-495c-9bcf-7edd26612985 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] [instance: 4e972e2b-7b5e-4a5f-87a1-3642aad3ac24] Fetching instance by UUID {{(pid=123458) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:54:49.669976 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-23ab0e02-8fa2-495c-9bcf-7edd26612985 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:54:49.670737 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-23ab0e02-8fa2-495c-9bcf-7edd26612985 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:54:49.671522 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-23ab0e02-8fa2-495c-9bcf-7edd26612985 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:54:49.671965 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-23ab0e02-8fa2-495c-9bcf-7edd26612985 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:54:49.681761 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-06385964-3201-4cd9-b309-8a89f3678a7e tempest-VolumesSnapshotTestJSON-1697003112 tempest-VolumesSnapshotTestJSON-1697003112-project] Calling method '>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:54:49.683048 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-06385964-3201-4cd9-b309-8a89f3678a7e tempest-VolumesSnapshotTestJSON-1697003112 tempest-VolumesSnapshotTestJSON-1697003112-project] [instance: 620e45e7-5ce1-4319-8b61-5aaff72e47aa] Fetching instance by UUID {{(pid=123459) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:54:49.690504 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-06385964-3201-4cd9-b309-8a89f3678a7e tempest-VolumesSnapshotTestJSON-1697003112 tempest-VolumesSnapshotTestJSON-1697003112-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:54:49.691113 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-06385964-3201-4cd9-b309-8a89f3678a7e tempest-VolumesSnapshotTestJSON-1697003112 tempest-VolumesSnapshotTestJSON-1697003112-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:54:49.692268 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-06385964-3201-4cd9-b309-8a89f3678a7e tempest-VolumesSnapshotTestJSON-1697003112 tempest-VolumesSnapshotTestJSON-1697003112-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:54:49.693025 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-06385964-3201-4cd9-b309-8a89f3678a7e tempest-VolumesSnapshotTestJSON-1697003112 tempest-VolumesSnapshotTestJSON-1697003112-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:54:49.864168 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-06385964-3201-4cd9-b309-8a89f3678a7e tempest-VolumesSnapshotTestJSON-1697003112 tempest-VolumesSnapshotTestJSON-1697003112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a210cf812fb54682ac28a13a5dce0563', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c0d26c7abcc4bc7b175ac175bb5f2ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:54:49.873677 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-06385964-3201-4cd9-b309-8a89f3678a7e tempest-VolumesSnapshotTestJSON-1697003112 tempest-VolumesSnapshotTestJSON-1697003112-project] 10.222.0.31 "GET /compute/v2.1/servers/620e45e7-5ce1-4319-8b61-5aaff72e47aa" status: 200 len: 1514 microversion: 2.1 time: 0.195377 Apr 29 08:54:49.874357 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 163/334] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 08:54:49 2022] GET /compute/v2.1/servers/620e45e7-5ce1-4319-8b61-5aaff72e47aa => generated 1514 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 29 08:54:49.935307 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-23ab0e02-8fa2-495c-9bcf-7edd26612985 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c18e88436f14dc7a2001220b87ce9ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60998f08c40446e787ead285e40665b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:54:49.944068 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-23ab0e02-8fa2-495c-9bcf-7edd26612985 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] 10.222.0.31 "GET /compute/v2.1/servers/4e972e2b-7b5e-4a5f-87a1-3642aad3ac24" status: 200 len: 1522 microversion: 2.1 time: 0.287468 Apr 29 08:54:49.944820 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 172/335] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 08:54:49 2022] GET /compute/v2.1/servers/4e972e2b-7b5e-4a5f-87a1-3642aad3ac24 => generated 1522 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 08:54:50.062062 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-38f51e43-e411-42bd-a452-53f2cadc74da tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] Calling method '>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:54:50.063144 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-38f51e43-e411-42bd-a452-53f2cadc74da tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] [instance: d83c29d2-6435-4edc-827b-2c37a66fb199] Fetching instance by UUID {{(pid=123459) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:54:50.071251 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-38f51e43-e411-42bd-a452-53f2cadc74da tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:54:50.071673 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-38f51e43-e411-42bd-a452-53f2cadc74da tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:54:50.072686 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-38f51e43-e411-42bd-a452-53f2cadc74da tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:54:50.073126 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-38f51e43-e411-42bd-a452-53f2cadc74da tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:54:50.125913 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [req-1f477596-e4e3-42f4-af78-eb98d6b2aadc req-0009498d-eb03-43f8-bc78-91df6081841f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "620e45e7-5ce1-4319-8b61-5aaff72e47aa", "name": "network-vif-deleted", "tag": "3213a42c-c1bc-4b54-aae9-e15a4aa846ef"}]} {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 29 08:54:50.133767 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [req-1f477596-e4e3-42f4-af78-eb98d6b2aadc req-0009498d-eb03-43f8-bc78-91df6081841f service nova] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:54:50.134207 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [req-1f477596-e4e3-42f4-af78-eb98d6b2aadc req-0009498d-eb03-43f8-bc78-91df6081841f service nova] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:54:50.146489 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.compute.server_external_events [req-1f477596-e4e3-42f4-af78-eb98d6b2aadc req-0009498d-eb03-43f8-bc78-91df6081841f service nova] Creating event network-vif-deleted:3213a42c-c1bc-4b54-aae9-e15a4aa846ef for instance 620e45e7-5ce1-4319-8b61-5aaff72e47aa on hv-cinder-83987 Apr 29 08:54:50.151704 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [req-1f477596-e4e3-42f4-af78-eb98d6b2aadc req-0009498d-eb03-43f8-bc78-91df6081841f service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029975 Apr 29 08:54:50.152698 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 173/336] 10.222.0.31 () {64 vars in 1317 bytes} [Fri Apr 29 08:54:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 29 08:54:50.220164 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-38f51e43-e411-42bd-a452-53f2cadc74da tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcf1c67873b7443084ea183c77698062', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0436edb5348a4ad5a0b6b5979a7c54fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:54:50.227740 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-38f51e43-e411-42bd-a452-53f2cadc74da tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] 10.222.0.31 "GET /compute/v2.1/servers/d83c29d2-6435-4edc-827b-2c37a66fb199" status: 200 len: 1261 microversion: 2.1 time: 0.169934 Apr 29 08:54:50.228328 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 164/337] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 08:54:50 2022] GET /compute/v2.1/servers/d83c29d2-6435-4edc-827b-2c37a66fb199 => generated 1261 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 08:54:50.891437 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-fd20d324-b9dd-4093-addc-57ae5da54cb2 tempest-VolumesSnapshotTestJSON-1697003112 tempest-VolumesSnapshotTestJSON-1697003112-project] Calling method '>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:54:50.892149 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-fd20d324-b9dd-4093-addc-57ae5da54cb2 tempest-VolumesSnapshotTestJSON-1697003112 tempest-VolumesSnapshotTestJSON-1697003112-project] [instance: 620e45e7-5ce1-4319-8b61-5aaff72e47aa] Fetching instance by UUID {{(pid=123458) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:54:50.898409 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-fd20d324-b9dd-4093-addc-57ae5da54cb2 tempest-VolumesSnapshotTestJSON-1697003112 tempest-VolumesSnapshotTestJSON-1697003112-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:54:50.898865 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-fd20d324-b9dd-4093-addc-57ae5da54cb2 tempest-VolumesSnapshotTestJSON-1697003112 tempest-VolumesSnapshotTestJSON-1697003112-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:54:50.899639 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-fd20d324-b9dd-4093-addc-57ae5da54cb2 tempest-VolumesSnapshotTestJSON-1697003112 tempest-VolumesSnapshotTestJSON-1697003112-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:54:50.900073 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-fd20d324-b9dd-4093-addc-57ae5da54cb2 tempest-VolumesSnapshotTestJSON-1697003112 tempest-VolumesSnapshotTestJSON-1697003112-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:54:50.960966 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-22951bca-9e94-491e-8790-39b862f97049 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Calling method '>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:54:50.962230 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-22951bca-9e94-491e-8790-39b862f97049 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] [instance: 4e972e2b-7b5e-4a5f-87a1-3642aad3ac24] Fetching instance by UUID {{(pid=123459) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:54:50.968842 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-22951bca-9e94-491e-8790-39b862f97049 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:54:50.969292 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-22951bca-9e94-491e-8790-39b862f97049 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:54:50.970071 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-22951bca-9e94-491e-8790-39b862f97049 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:54:50.970717 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-22951bca-9e94-491e-8790-39b862f97049 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:54:50.981180 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-fd20d324-b9dd-4093-addc-57ae5da54cb2 tempest-VolumesSnapshotTestJSON-1697003112 tempest-VolumesSnapshotTestJSON-1697003112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a210cf812fb54682ac28a13a5dce0563', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c0d26c7abcc4bc7b175ac175bb5f2ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:54:50.990969 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-fd20d324-b9dd-4093-addc-57ae5da54cb2 tempest-VolumesSnapshotTestJSON-1697003112 tempest-VolumesSnapshotTestJSON-1697003112-project] 10.222.0.31 "GET /compute/v2.1/servers/620e45e7-5ce1-4319-8b61-5aaff72e47aa" status: 200 len: 1303 microversion: 2.1 time: 0.103673 Apr 29 08:54:50.991761 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 174/338] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 08:54:50 2022] GET /compute/v2.1/servers/620e45e7-5ce1-4319-8b61-5aaff72e47aa => generated 1303 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 08:54:51.119536 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-22951bca-9e94-491e-8790-39b862f97049 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c18e88436f14dc7a2001220b87ce9ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60998f08c40446e787ead285e40665b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:54:51.127249 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-22951bca-9e94-491e-8790-39b862f97049 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] 10.222.0.31 "GET /compute/v2.1/servers/4e972e2b-7b5e-4a5f-87a1-3642aad3ac24" status: 200 len: 1522 microversion: 2.1 time: 0.170403 Apr 29 08:54:51.127963 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 165/339] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 08:54:50 2022] GET /compute/v2.1/servers/4e972e2b-7b5e-4a5f-87a1-3642aad3ac24 => generated 1522 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 29 08:54:51.246715 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-9c8e1c6a-2943-4cb4-94d6-d6070c3c8db6 tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] Calling method '>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:54:51.247339 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-9c8e1c6a-2943-4cb4-94d6-d6070c3c8db6 tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] [instance: d83c29d2-6435-4edc-827b-2c37a66fb199] Fetching instance by UUID {{(pid=123458) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:54:51.254437 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-9c8e1c6a-2943-4cb4-94d6-d6070c3c8db6 tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:54:51.254997 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-9c8e1c6a-2943-4cb4-94d6-d6070c3c8db6 tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:54:51.255788 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-9c8e1c6a-2943-4cb4-94d6-d6070c3c8db6 tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:54:51.256290 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-9c8e1c6a-2943-4cb4-94d6-d6070c3c8db6 tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:54:51.428857 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-9c8e1c6a-2943-4cb4-94d6-d6070c3c8db6 tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcf1c67873b7443084ea183c77698062', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0436edb5348a4ad5a0b6b5979a7c54fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:54:51.446770 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-9c8e1c6a-2943-4cb4-94d6-d6070c3c8db6 tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] 10.222.0.31 "GET /compute/v2.1/servers/d83c29d2-6435-4edc-827b-2c37a66fb199" status: 200 len: 1261 microversion: 2.1 time: 0.203856 Apr 29 08:54:51.448112 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 175/340] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 08:54:51 2022] GET /compute/v2.1/servers/d83c29d2-6435-4edc-827b-2c37a66fb199 => generated 1261 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 08:54:52.009599 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-868fd1aa-88e3-413f-8ebb-6be0346f3a51 tempest-VolumesSnapshotTestJSON-1697003112 tempest-VolumesSnapshotTestJSON-1697003112-project] Calling method '>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:54:52.010138 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-868fd1aa-88e3-413f-8ebb-6be0346f3a51 tempest-VolumesSnapshotTestJSON-1697003112 tempest-VolumesSnapshotTestJSON-1697003112-project] [instance: 620e45e7-5ce1-4319-8b61-5aaff72e47aa] Fetching instance by UUID {{(pid=123459) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:54:52.016125 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-868fd1aa-88e3-413f-8ebb-6be0346f3a51 tempest-VolumesSnapshotTestJSON-1697003112 tempest-VolumesSnapshotTestJSON-1697003112-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:54:52.016599 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-868fd1aa-88e3-413f-8ebb-6be0346f3a51 tempest-VolumesSnapshotTestJSON-1697003112 tempest-VolumesSnapshotTestJSON-1697003112-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:54:52.017486 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-868fd1aa-88e3-413f-8ebb-6be0346f3a51 tempest-VolumesSnapshotTestJSON-1697003112 tempest-VolumesSnapshotTestJSON-1697003112-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:54:52.017795 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-868fd1aa-88e3-413f-8ebb-6be0346f3a51 tempest-VolumesSnapshotTestJSON-1697003112 tempest-VolumesSnapshotTestJSON-1697003112-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:54:52.031535 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.wsgi [None req-868fd1aa-88e3-413f-8ebb-6be0346f3a51 tempest-VolumesSnapshotTestJSON-1697003112 tempest-VolumesSnapshotTestJSON-1697003112-project] HTTP exception thrown: Instance 620e45e7-5ce1-4319-8b61-5aaff72e47aa could not be found. Apr 29 08:54:52.032124 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-868fd1aa-88e3-413f-8ebb-6be0346f3a51 tempest-VolumesSnapshotTestJSON-1697003112 tempest-VolumesSnapshotTestJSON-1697003112-project] Returning 404 to user: Instance 620e45e7-5ce1-4319-8b61-5aaff72e47aa could not be found. {{(pid=123459) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 29 08:54:52.032979 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-868fd1aa-88e3-413f-8ebb-6be0346f3a51 tempest-VolumesSnapshotTestJSON-1697003112 tempest-VolumesSnapshotTestJSON-1697003112-project] 10.222.0.31 "GET /compute/v2.1/servers/620e45e7-5ce1-4319-8b61-5aaff72e47aa" status: 404 len: 111 microversion: 2.1 time: 0.027660 Apr 29 08:54:52.033521 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 166/341] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 08:54:52 2022] GET /compute/v2.1/servers/620e45e7-5ce1-4319-8b61-5aaff72e47aa => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 29 08:54:52.144340 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-c8b9526d-fc75-4f7d-b117-ce580415e2ca tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Calling method '>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:54:52.145700 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-c8b9526d-fc75-4f7d-b117-ce580415e2ca tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] [instance: 4e972e2b-7b5e-4a5f-87a1-3642aad3ac24] Fetching instance by UUID {{(pid=123458) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:54:52.151948 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-c8b9526d-fc75-4f7d-b117-ce580415e2ca tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:54:52.152430 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-c8b9526d-fc75-4f7d-b117-ce580415e2ca tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:54:52.153224 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-c8b9526d-fc75-4f7d-b117-ce580415e2ca tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:54:52.153662 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-c8b9526d-fc75-4f7d-b117-ce580415e2ca tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:54:52.302551 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-c8b9526d-fc75-4f7d-b117-ce580415e2ca tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c18e88436f14dc7a2001220b87ce9ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60998f08c40446e787ead285e40665b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:54:52.316470 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-c8b9526d-fc75-4f7d-b117-ce580415e2ca tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] 10.222.0.31 "GET /compute/v2.1/servers/4e972e2b-7b5e-4a5f-87a1-3642aad3ac24" status: 200 len: 1522 microversion: 2.1 time: 0.175105 Apr 29 08:54:52.316470 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 176/342] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 08:54:52 2022] GET /compute/v2.1/servers/4e972e2b-7b5e-4a5f-87a1-3642aad3ac24 => generated 1522 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 08:54:52.464695 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-0b9735f6-2911-4ece-b534-92f532f5e8ff tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] Calling method '>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:54:52.465316 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-0b9735f6-2911-4ece-b534-92f532f5e8ff tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] [instance: d83c29d2-6435-4edc-827b-2c37a66fb199] Fetching instance by UUID {{(pid=123459) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:54:52.472107 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-0b9735f6-2911-4ece-b534-92f532f5e8ff tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:54:52.472718 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-0b9735f6-2911-4ece-b534-92f532f5e8ff tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:54:52.473541 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-0b9735f6-2911-4ece-b534-92f532f5e8ff tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:54:52.473985 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-0b9735f6-2911-4ece-b534-92f532f5e8ff tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:54:52.603439 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-0b9735f6-2911-4ece-b534-92f532f5e8ff tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcf1c67873b7443084ea183c77698062', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0436edb5348a4ad5a0b6b5979a7c54fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:54:52.610787 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-0b9735f6-2911-4ece-b534-92f532f5e8ff tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] 10.222.0.31 "GET /compute/v2.1/servers/d83c29d2-6435-4edc-827b-2c37a66fb199" status: 200 len: 1261 microversion: 2.1 time: 0.149974 Apr 29 08:54:52.611339 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 167/343] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 08:54:52 2022] GET /compute/v2.1/servers/d83c29d2-6435-4edc-827b-2c37a66fb199 => generated 1261 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 08:54:53.333890 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-ff747479-08a5-4e51-a72c-aae41022f7bc tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Calling method '>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:54:53.334498 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-ff747479-08a5-4e51-a72c-aae41022f7bc tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] [instance: 4e972e2b-7b5e-4a5f-87a1-3642aad3ac24] Fetching instance by UUID {{(pid=123458) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:54:53.340774 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-ff747479-08a5-4e51-a72c-aae41022f7bc tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:54:53.342250 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-ff747479-08a5-4e51-a72c-aae41022f7bc tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:54:53.342250 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-ff747479-08a5-4e51-a72c-aae41022f7bc tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:54:53.342250 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-ff747479-08a5-4e51-a72c-aae41022f7bc tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:54:53.476812 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-ff747479-08a5-4e51-a72c-aae41022f7bc tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c18e88436f14dc7a2001220b87ce9ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60998f08c40446e787ead285e40665b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:54:53.484647 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-ff747479-08a5-4e51-a72c-aae41022f7bc tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] 10.222.0.31 "GET /compute/v2.1/servers/4e972e2b-7b5e-4a5f-87a1-3642aad3ac24" status: 200 len: 1522 microversion: 2.1 time: 0.154530 Apr 29 08:54:53.485157 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 177/344] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 08:54:53 2022] GET /compute/v2.1/servers/4e972e2b-7b5e-4a5f-87a1-3642aad3ac24 => generated 1522 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 08:54:53.567993 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-3c6db43a-7d9f-4313-a869-67abdad30d3a tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Calling method '>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:54:53.568619 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-3c6db43a-7d9f-4313-a869-67abdad30d3a tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] [instance: 0f9c17b6-b1a2-4ec6-ba8c-2097a8c8ccb7] Fetching instance by UUID {{(pid=123459) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:54:53.574950 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-3c6db43a-7d9f-4313-a869-67abdad30d3a tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:54:53.575400 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-3c6db43a-7d9f-4313-a869-67abdad30d3a tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:54:53.576217 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-3c6db43a-7d9f-4313-a869-67abdad30d3a tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:54:53.576656 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-3c6db43a-7d9f-4313-a869-67abdad30d3a tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:54:53.603390 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-3c6db43a-7d9f-4313-a869-67abdad30d3a tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] 10.222.0.31 "GET /compute/v2.1/servers/0f9c17b6-b1a2-4ec6-ba8c-2097a8c8ccb7/ips" status: 200 len: 150 microversion: 2.1 time: 0.040201 Apr 29 08:54:53.604411 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 168/345] 10.222.0.31 () {58 vars in 1247 bytes} [Fri Apr 29 08:54:53 2022] GET /compute/v2.1/servers/0f9c17b6-b1a2-4ec6-ba8c-2097a8c8ccb7/ips => generated 150 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 29 08:54:53.628666 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-e784d7ce-cecd-4ea2-aa69-c956d696a4f0 tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] Calling method '>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:54:53.629312 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-e784d7ce-cecd-4ea2-aa69-c956d696a4f0 tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] [instance: d83c29d2-6435-4edc-827b-2c37a66fb199] Fetching instance by UUID {{(pid=123458) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:54:53.635461 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-e784d7ce-cecd-4ea2-aa69-c956d696a4f0 tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:54:53.636057 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-e784d7ce-cecd-4ea2-aa69-c956d696a4f0 tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:54:53.636954 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-e784d7ce-cecd-4ea2-aa69-c956d696a4f0 tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:54:53.637400 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-e784d7ce-cecd-4ea2-aa69-c956d696a4f0 tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:54:53.775843 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-e784d7ce-cecd-4ea2-aa69-c956d696a4f0 tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcf1c67873b7443084ea183c77698062', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0436edb5348a4ad5a0b6b5979a7c54fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:54:53.783183 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-e784d7ce-cecd-4ea2-aa69-c956d696a4f0 tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] 10.222.0.31 "GET /compute/v2.1/servers/d83c29d2-6435-4edc-827b-2c37a66fb199" status: 200 len: 1261 microversion: 2.1 time: 0.159020 Apr 29 08:54:53.784546 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 178/346] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 08:54:53 2022] GET /compute/v2.1/servers/d83c29d2-6435-4edc-827b-2c37a66fb199 => generated 1261 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 08:54:54.502301 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-19434080-691e-48dd-aff0-bb1bd0cc102a tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Calling method '>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:54:54.503792 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-19434080-691e-48dd-aff0-bb1bd0cc102a tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] [instance: 4e972e2b-7b5e-4a5f-87a1-3642aad3ac24] Fetching instance by UUID {{(pid=123459) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:54:54.509959 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-19434080-691e-48dd-aff0-bb1bd0cc102a tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:54:54.510421 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-19434080-691e-48dd-aff0-bb1bd0cc102a tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:54:54.511259 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-19434080-691e-48dd-aff0-bb1bd0cc102a tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:54:54.511645 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-19434080-691e-48dd-aff0-bb1bd0cc102a tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:54:54.644820 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-19434080-691e-48dd-aff0-bb1bd0cc102a tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c18e88436f14dc7a2001220b87ce9ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60998f08c40446e787ead285e40665b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:54:54.652127 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-19434080-691e-48dd-aff0-bb1bd0cc102a tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] 10.222.0.31 "GET /compute/v2.1/servers/4e972e2b-7b5e-4a5f-87a1-3642aad3ac24" status: 200 len: 1522 microversion: 2.1 time: 0.153677 Apr 29 08:54:54.652711 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 169/347] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 08:54:54 2022] GET /compute/v2.1/servers/4e972e2b-7b5e-4a5f-87a1-3642aad3ac24 => generated 1522 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 08:54:54.802710 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-aff49838-1e02-4bce-999b-148df1330267 tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] Calling method '>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:54:54.803227 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-aff49838-1e02-4bce-999b-148df1330267 tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] [instance: d83c29d2-6435-4edc-827b-2c37a66fb199] Fetching instance by UUID {{(pid=123458) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:54:54.809339 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-aff49838-1e02-4bce-999b-148df1330267 tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:54:54.809788 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-aff49838-1e02-4bce-999b-148df1330267 tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:54:54.810563 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-aff49838-1e02-4bce-999b-148df1330267 tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:54:54.811004 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-aff49838-1e02-4bce-999b-148df1330267 tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:54:54.942039 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-aff49838-1e02-4bce-999b-148df1330267 tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcf1c67873b7443084ea183c77698062', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0436edb5348a4ad5a0b6b5979a7c54fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:54:54.949518 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-aff49838-1e02-4bce-999b-148df1330267 tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] 10.222.0.31 "GET /compute/v2.1/servers/d83c29d2-6435-4edc-827b-2c37a66fb199" status: 200 len: 1261 microversion: 2.1 time: 0.151782 Apr 29 08:54:54.950741 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 179/348] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 08:54:54 2022] GET /compute/v2.1/servers/d83c29d2-6435-4edc-827b-2c37a66fb199 => generated 1261 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 08:54:55.670157 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-c14decdf-3e5b-4347-a3e2-75e6cd71e5a8 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Calling method '>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:54:55.670677 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-c14decdf-3e5b-4347-a3e2-75e6cd71e5a8 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] [instance: 4e972e2b-7b5e-4a5f-87a1-3642aad3ac24] Fetching instance by UUID {{(pid=123459) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:54:55.677661 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-c14decdf-3e5b-4347-a3e2-75e6cd71e5a8 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:54:55.678099 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-c14decdf-3e5b-4347-a3e2-75e6cd71e5a8 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:54:55.678853 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-c14decdf-3e5b-4347-a3e2-75e6cd71e5a8 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:54:55.679280 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-c14decdf-3e5b-4347-a3e2-75e6cd71e5a8 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:54:55.805300 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-c14decdf-3e5b-4347-a3e2-75e6cd71e5a8 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c18e88436f14dc7a2001220b87ce9ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60998f08c40446e787ead285e40665b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:54:55.812667 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-c14decdf-3e5b-4347-a3e2-75e6cd71e5a8 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] 10.222.0.31 "GET /compute/v2.1/servers/4e972e2b-7b5e-4a5f-87a1-3642aad3ac24" status: 200 len: 1522 microversion: 2.1 time: 0.146443 Apr 29 08:54:55.813225 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 170/349] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 08:54:55 2022] GET /compute/v2.1/servers/4e972e2b-7b5e-4a5f-87a1-3642aad3ac24 => generated 1522 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 08:54:55.828851 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-97cf50b3-6b02-4bb2-8246-0b453b02282d tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Calling method '>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:54:55.829380 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-97cf50b3-6b02-4bb2-8246-0b453b02282d tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] [instance: 406b5ad6-698e-457f-93f4-cdfd45fb3e8e] Fetching instance by UUID {{(pid=123458) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:54:55.836430 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-97cf50b3-6b02-4bb2-8246-0b453b02282d tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:54:55.836883 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-97cf50b3-6b02-4bb2-8246-0b453b02282d tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:54:55.837665 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-97cf50b3-6b02-4bb2-8246-0b453b02282d tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:54:55.838132 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-97cf50b3-6b02-4bb2-8246-0b453b02282d tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:54:55.861674 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-97cf50b3-6b02-4bb2-8246-0b453b02282d tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] 10.222.0.31 "GET /compute/v2.1/servers/406b5ad6-698e-457f-93f4-cdfd45fb3e8e/ips" status: 200 len: 153 microversion: 2.20 time: 0.036686 Apr 29 08:54:55.862235 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 180/350] 10.222.0.31 () {60 vars in 1288 bytes} [Fri Apr 29 08:54:55 2022] GET /compute/v2.1/servers/406b5ad6-698e-457f-93f4-cdfd45fb3e8e/ips => generated 153 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 29 08:54:55.967262 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-1ae695d1-2d5f-4ddd-be2b-c7163508b257 tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] Calling method '>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:54:55.967871 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-1ae695d1-2d5f-4ddd-be2b-c7163508b257 tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] [instance: d83c29d2-6435-4edc-827b-2c37a66fb199] Fetching instance by UUID {{(pid=123459) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:54:55.974635 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-1ae695d1-2d5f-4ddd-be2b-c7163508b257 tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:54:55.975081 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-1ae695d1-2d5f-4ddd-be2b-c7163508b257 tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:54:55.975852 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-1ae695d1-2d5f-4ddd-be2b-c7163508b257 tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:54:55.976313 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-1ae695d1-2d5f-4ddd-be2b-c7163508b257 tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:54:56.119539 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-1ae695d1-2d5f-4ddd-be2b-c7163508b257 tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcf1c67873b7443084ea183c77698062', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0436edb5348a4ad5a0b6b5979a7c54fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:54:56.127529 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-1ae695d1-2d5f-4ddd-be2b-c7163508b257 tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] 10.222.0.31 "GET /compute/v2.1/servers/d83c29d2-6435-4edc-827b-2c37a66fb199" status: 200 len: 1261 microversion: 2.1 time: 0.164268 Apr 29 08:54:56.128104 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 171/351] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 08:54:55 2022] GET /compute/v2.1/servers/d83c29d2-6435-4edc-827b-2c37a66fb199 => generated 1261 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 08:54:56.829716 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-cd06c61f-2f58-4bd6-8a25-409860f0bbaa tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Calling method '>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:54:56.830282 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-cd06c61f-2f58-4bd6-8a25-409860f0bbaa tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] [instance: 4e972e2b-7b5e-4a5f-87a1-3642aad3ac24] Fetching instance by UUID {{(pid=123458) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:54:56.836452 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-cd06c61f-2f58-4bd6-8a25-409860f0bbaa tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:54:56.836905 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-cd06c61f-2f58-4bd6-8a25-409860f0bbaa tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:54:56.837710 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-cd06c61f-2f58-4bd6-8a25-409860f0bbaa tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:54:56.838144 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-cd06c61f-2f58-4bd6-8a25-409860f0bbaa tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:54:56.971751 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-cd06c61f-2f58-4bd6-8a25-409860f0bbaa tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c18e88436f14dc7a2001220b87ce9ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60998f08c40446e787ead285e40665b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:54:56.980076 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-cd06c61f-2f58-4bd6-8a25-409860f0bbaa tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] 10.222.0.31 "GET /compute/v2.1/servers/4e972e2b-7b5e-4a5f-87a1-3642aad3ac24" status: 200 len: 1522 microversion: 2.1 time: 0.154266 Apr 29 08:54:56.980677 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 181/352] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 08:54:56 2022] GET /compute/v2.1/servers/4e972e2b-7b5e-4a5f-87a1-3642aad3ac24 => generated 1522 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 08:54:57.146323 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-a610f260-64a2-4ef5-a5a0-669ca8bfcff3 tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] Calling method '>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:54:57.146877 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-a610f260-64a2-4ef5-a5a0-669ca8bfcff3 tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] [instance: d83c29d2-6435-4edc-827b-2c37a66fb199] Fetching instance by UUID {{(pid=123459) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:54:57.153351 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-a610f260-64a2-4ef5-a5a0-669ca8bfcff3 tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:54:57.153797 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-a610f260-64a2-4ef5-a5a0-669ca8bfcff3 tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:54:57.154566 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-a610f260-64a2-4ef5-a5a0-669ca8bfcff3 tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:54:57.155003 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-a610f260-64a2-4ef5-a5a0-669ca8bfcff3 tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:54:57.295172 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-a610f260-64a2-4ef5-a5a0-669ca8bfcff3 tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcf1c67873b7443084ea183c77698062', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0436edb5348a4ad5a0b6b5979a7c54fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:54:57.303060 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-a610f260-64a2-4ef5-a5a0-669ca8bfcff3 tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] 10.222.0.31 "GET /compute/v2.1/servers/d83c29d2-6435-4edc-827b-2c37a66fb199" status: 200 len: 1261 microversion: 2.1 time: 0.161240 Apr 29 08:54:57.303633 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 172/353] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 08:54:57 2022] GET /compute/v2.1/servers/d83c29d2-6435-4edc-827b-2c37a66fb199 => generated 1261 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 08:54:57.999534 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-61e07b7d-3ad3-49b2-9a5d-f6bbb8d5337b tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Calling method '>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:54:58.000174 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-61e07b7d-3ad3-49b2-9a5d-f6bbb8d5337b tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] [instance: 4e972e2b-7b5e-4a5f-87a1-3642aad3ac24] Fetching instance by UUID {{(pid=123458) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:54:58.007152 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-61e07b7d-3ad3-49b2-9a5d-f6bbb8d5337b tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:54:58.007605 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-61e07b7d-3ad3-49b2-9a5d-f6bbb8d5337b tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:54:58.008430 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-61e07b7d-3ad3-49b2-9a5d-f6bbb8d5337b tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:54:58.008869 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-61e07b7d-3ad3-49b2-9a5d-f6bbb8d5337b tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:54:58.156154 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-61e07b7d-3ad3-49b2-9a5d-f6bbb8d5337b tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c18e88436f14dc7a2001220b87ce9ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60998f08c40446e787ead285e40665b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:54:58.164504 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-61e07b7d-3ad3-49b2-9a5d-f6bbb8d5337b tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] 10.222.0.31 "GET /compute/v2.1/servers/4e972e2b-7b5e-4a5f-87a1-3642aad3ac24" status: 200 len: 1522 microversion: 2.1 time: 0.169865 Apr 29 08:54:58.165089 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 182/354] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 08:54:57 2022] GET /compute/v2.1/servers/4e972e2b-7b5e-4a5f-87a1-3642aad3ac24 => generated 1522 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 29 08:54:58.319909 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-28abb1a8-62f6-42b3-b964-cdf4366cd353 tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] Calling method '>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:54:58.320561 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-28abb1a8-62f6-42b3-b964-cdf4366cd353 tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] [instance: d83c29d2-6435-4edc-827b-2c37a66fb199] Fetching instance by UUID {{(pid=123459) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:54:58.327102 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-28abb1a8-62f6-42b3-b964-cdf4366cd353 tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:54:58.327554 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-28abb1a8-62f6-42b3-b964-cdf4366cd353 tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:54:58.328379 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-28abb1a8-62f6-42b3-b964-cdf4366cd353 tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:54:58.328821 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-28abb1a8-62f6-42b3-b964-cdf4366cd353 tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:54:58.474993 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-28abb1a8-62f6-42b3-b964-cdf4366cd353 tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcf1c67873b7443084ea183c77698062', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0436edb5348a4ad5a0b6b5979a7c54fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:54:58.483965 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-28abb1a8-62f6-42b3-b964-cdf4366cd353 tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] 10.222.0.31 "GET /compute/v2.1/servers/d83c29d2-6435-4edc-827b-2c37a66fb199" status: 200 len: 1261 microversion: 2.1 time: 0.168321 Apr 29 08:54:58.484582 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 173/355] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 08:54:58 2022] GET /compute/v2.1/servers/d83c29d2-6435-4edc-827b-2c37a66fb199 => generated 1261 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 08:54:58.719354 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-6997e4ff-0a04-4098-8513-433261de54f9 tempest-VolumesNegativeTest-45234477 tempest-VolumesNegativeTest-45234477-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1003784688", "imageRef": "e0678f88-0b68-4453-b569-29fd065e544e", "flavorRef": "452"}} {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 29 08:54:58.776839 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.network.neutron [None req-6997e4ff-0a04-4098-8513-433261de54f9 tempest-VolumesNegativeTest-45234477 tempest-VolumesNegativeTest-45234477-project] validate_networks() for None {{(pid=123458) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 29 08:54:59.057887 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.virt.hardware [None req-6997e4ff-0a04-4098-8513-433261de54f9 tempest-VolumesNegativeTest-45234477 tempest-VolumesNegativeTest-45234477-project] Flavor limits 0:0:0 {{(pid=123458) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 29 08:54:59.058480 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.virt.hardware [None req-6997e4ff-0a04-4098-8513-433261de54f9 tempest-VolumesNegativeTest-45234477 tempest-VolumesNegativeTest-45234477-project] Image limits 0:0:0 {{(pid=123458) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 29 08:54:59.058774 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.virt.hardware [None req-6997e4ff-0a04-4098-8513-433261de54f9 tempest-VolumesNegativeTest-45234477 tempest-VolumesNegativeTest-45234477-project] Flavor pref 0:0:0 {{(pid=123458) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 29 08:54:59.059186 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.virt.hardware [None req-6997e4ff-0a04-4098-8513-433261de54f9 tempest-VolumesNegativeTest-45234477 tempest-VolumesNegativeTest-45234477-project] Image pref 0:0:0 {{(pid=123458) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 29 08:54:59.059596 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.virt.hardware [None req-6997e4ff-0a04-4098-8513-433261de54f9 tempest-VolumesNegativeTest-45234477 tempest-VolumesNegativeTest-45234477-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123458) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 29 08:54:59.070878 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-6997e4ff-0a04-4098-8513-433261de54f9 tempest-VolumesNegativeTest-45234477 tempest-VolumesNegativeTest-45234477-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:54:59.071516 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-6997e4ff-0a04-4098-8513-433261de54f9 tempest-VolumesNegativeTest-45234477 tempest-VolumesNegativeTest-45234477-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:54:59.072671 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-6997e4ff-0a04-4098-8513-433261de54f9 tempest-VolumesNegativeTest-45234477 tempest-VolumesNegativeTest-45234477-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:54:59.073325 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-6997e4ff-0a04-4098-8513-433261de54f9 tempest-VolumesNegativeTest-45234477 tempest-VolumesNegativeTest-45234477-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:54:59.092359 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.quota [None req-6997e4ff-0a04-4098-8513-433261de54f9 tempest-VolumesNegativeTest-45234477 tempest-VolumesNegativeTest-45234477-project] Getting quotas for project 3c9877c06a2445a3a34c5d35bafeb7a8. Resources: {'instances', 'cores', 'ram'} {{(pid=123458) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 29 08:54:59.096333 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.quota [None req-6997e4ff-0a04-4098-8513-433261de54f9 tempest-VolumesNegativeTest-45234477 tempest-VolumesNegativeTest-45234477-project] Getting quotas for user 340cefa576c947d08978a99d288304c0 and project 3c9877c06a2445a3a34c5d35bafeb7a8. Resources: {'instances', 'cores', 'ram'} {{(pid=123458) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 29 08:54:59.107386 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-6997e4ff-0a04-4098-8513-433261de54f9 tempest-VolumesNegativeTest-45234477 tempest-VolumesNegativeTest-45234477-project] Going to run 1 instances... {{(pid=123458) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 29 08:54:59.109689 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-6997e4ff-0a04-4098-8513-433261de54f9 tempest-VolumesNegativeTest-45234477 tempest-VolumesNegativeTest-45234477-project] [instance: 1bcda922-2a2b-4382-9d9e-f083519473d8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e0678f88-0b68-4453-b569-29fd065e544e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123458) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 29 08:54:59.163588 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-6997e4ff-0a04-4098-8513-433261de54f9 tempest-VolumesNegativeTest-45234477 tempest-VolumesNegativeTest-45234477-project] 10.222.0.31 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.447665 Apr 29 08:54:59.165228 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 183/356] 10.222.0.31 () {60 vars in 1146 bytes} [Fri Apr 29 08:54:58 2022] POST /compute/v2.1/servers => generated 380 bytes in 450 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 29 08:54:59.179748 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-8c253a50-00a5-47cc-8833-a441f7a58c45 tempest-VolumesNegativeTest-45234477 tempest-VolumesNegativeTest-45234477-project] Calling method '>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:54:59.180636 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-8c253a50-00a5-47cc-8833-a441f7a58c45 tempest-VolumesNegativeTest-45234477 tempest-VolumesNegativeTest-45234477-project] [instance: 1bcda922-2a2b-4382-9d9e-f083519473d8] Fetching instance by UUID {{(pid=123459) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:54:59.185970 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-ffbdc7c2-55a4-4982-a260-6e4099696033 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Calling method '>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:54:59.186598 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-ffbdc7c2-55a4-4982-a260-6e4099696033 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] [instance: 4e972e2b-7b5e-4a5f-87a1-3642aad3ac24] Fetching instance by UUID {{(pid=123458) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:54:59.204161 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-ffbdc7c2-55a4-4982-a260-6e4099696033 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:54:59.204607 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-ffbdc7c2-55a4-4982-a260-6e4099696033 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:54:59.205402 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-ffbdc7c2-55a4-4982-a260-6e4099696033 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:54:59.205841 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-ffbdc7c2-55a4-4982-a260-6e4099696033 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:54:59.258395 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-8c253a50-00a5-47cc-8833-a441f7a58c45 tempest-VolumesNegativeTest-45234477 tempest-VolumesNegativeTest-45234477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '340cefa576c947d08978a99d288304c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c9877c06a2445a3a34c5d35bafeb7a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:54:59.265804 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-8c253a50-00a5-47cc-8833-a441f7a58c45 tempest-VolumesNegativeTest-45234477 tempest-VolumesNegativeTest-45234477-project] 10.222.0.31 "GET /compute/v2.1/servers/1bcda922-2a2b-4382-9d9e-f083519473d8" status: 200 len: 1215 microversion: 2.1 time: 0.092859 Apr 29 08:54:59.266379 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 174/357] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 08:54:59 2022] GET /compute/v2.1/servers/1bcda922-2a2b-4382-9d9e-f083519473d8 => generated 1215 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 08:54:59.275377 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-e343e498-79cb-46cb-9490-36ee04bf395d tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "af72dd7a-5864-4258-8196-4826f92aa0d4"}} {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 29 08:54:59.276646 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-e343e498-79cb-46cb-9490-36ee04bf395d tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] [instance: 0f9c17b6-b1a2-4ec6-ba8c-2097a8c8ccb7] Fetching instance by UUID {{(pid=123459) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:54:59.283383 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-e343e498-79cb-46cb-9490-36ee04bf395d tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:54:59.283916 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-e343e498-79cb-46cb-9490-36ee04bf395d tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:54:59.287011 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-e343e498-79cb-46cb-9490-36ee04bf395d tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:54:59.288204 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-e343e498-79cb-46cb-9490-36ee04bf395d tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:54:59.399739 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-ffbdc7c2-55a4-4982-a260-6e4099696033 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c18e88436f14dc7a2001220b87ce9ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60998f08c40446e787ead285e40665b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:54:59.409841 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-ffbdc7c2-55a4-4982-a260-6e4099696033 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] 10.222.0.31 "GET /compute/v2.1/servers/4e972e2b-7b5e-4a5f-87a1-3642aad3ac24" status: 200 len: 1522 microversion: 2.1 time: 0.228429 Apr 29 08:54:59.411459 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 184/358] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 08:54:59 2022] GET /compute/v2.1/servers/4e972e2b-7b5e-4a5f-87a1-3642aad3ac24 => generated 1522 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 08:54:59.501806 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-f6ae0304-77cb-45d8-8c15-3378b6e6c17f tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] Calling method '>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:54:59.502455 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-f6ae0304-77cb-45d8-8c15-3378b6e6c17f tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] [instance: d83c29d2-6435-4edc-827b-2c37a66fb199] Fetching instance by UUID {{(pid=123458) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:54:59.533303 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-f6ae0304-77cb-45d8-8c15-3378b6e6c17f tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:54:59.534077 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-f6ae0304-77cb-45d8-8c15-3378b6e6c17f tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.024s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:54:59.534741 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-f6ae0304-77cb-45d8-8c15-3378b6e6c17f tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:54:59.535183 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-f6ae0304-77cb-45d8-8c15-3378b6e6c17f tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:54:59.642308 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-e343e498-79cb-46cb-9490-36ee04bf395d tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] 10.222.0.31 "POST /compute/v2.1/servers/0f9c17b6-b1a2-4ec6-ba8c-2097a8c8ccb7/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.374684 Apr 29 08:54:59.644189 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 175/359] 10.222.0.31 () {60 vars in 1322 bytes} [Fri Apr 29 08:54:59 2022] POST /compute/v2.1/servers/0f9c17b6-b1a2-4ec6-ba8c-2097a8c8ccb7/os-volume_attachments => generated 194 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 29 08:54:59.788180 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-f6ae0304-77cb-45d8-8c15-3378b6e6c17f tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcf1c67873b7443084ea183c77698062', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0436edb5348a4ad5a0b6b5979a7c54fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:54:59.802779 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-f6ae0304-77cb-45d8-8c15-3378b6e6c17f tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] 10.222.0.31 "GET /compute/v2.1/servers/d83c29d2-6435-4edc-827b-2c37a66fb199" status: 200 len: 1261 microversion: 2.1 time: 0.305073 Apr 29 08:54:59.804391 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 185/360] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 08:54:59 2022] GET /compute/v2.1/servers/d83c29d2-6435-4edc-827b-2c37a66fb199 => generated 1261 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 08:54:59.876565 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-1741ef88-3e1d-4446-9761-bd57fd9bb72a tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 29 08:54:59.878793 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-1741ef88-3e1d-4446-9761-bd57fd9bb72a tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] [instance: 406b5ad6-698e-457f-93f4-cdfd45fb3e8e] Fetching instance by UUID {{(pid=123459) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:54:59.921266 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-1741ef88-3e1d-4446-9761-bd57fd9bb72a tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:54:59.921999 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-1741ef88-3e1d-4446-9761-bd57fd9bb72a tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:54:59.930964 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-1741ef88-3e1d-4446-9761-bd57fd9bb72a tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:54:59.931439 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-1741ef88-3e1d-4446-9761-bd57fd9bb72a tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:54:59.960465 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.objects.instance [None req-1741ef88-3e1d-4446-9761-bd57fd9bb72a tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lazy-loading 'flavor' on Instance uuid 406b5ad6-698e-457f-93f4-cdfd45fb3e8e {{(pid=123459) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 29 08:55:00.286212 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-83800e5d-1441-457e-9da1-0e4709dc88cb tempest-VolumesNegativeTest-45234477 tempest-VolumesNegativeTest-45234477-project] Calling method '>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:55:00.288664 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-83800e5d-1441-457e-9da1-0e4709dc88cb tempest-VolumesNegativeTest-45234477 tempest-VolumesNegativeTest-45234477-project] [instance: 1bcda922-2a2b-4382-9d9e-f083519473d8] Fetching instance by UUID {{(pid=123458) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:55:00.299163 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-83800e5d-1441-457e-9da1-0e4709dc88cb tempest-VolumesNegativeTest-45234477 tempest-VolumesNegativeTest-45234477-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:55:00.299993 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-83800e5d-1441-457e-9da1-0e4709dc88cb tempest-VolumesNegativeTest-45234477 tempest-VolumesNegativeTest-45234477-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:55:00.301970 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-83800e5d-1441-457e-9da1-0e4709dc88cb tempest-VolumesNegativeTest-45234477 tempest-VolumesNegativeTest-45234477-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:55:00.302769 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-83800e5d-1441-457e-9da1-0e4709dc88cb tempest-VolumesNegativeTest-45234477 tempest-VolumesNegativeTest-45234477-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:55:00.315649 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-1741ef88-3e1d-4446-9761-bd57fd9bb72a tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] 10.222.0.31 "POST /compute/v2.1/servers/406b5ad6-698e-457f-93f4-cdfd45fb3e8e/action" status: 202 len: 0 microversion: 2.20 time: 0.449114 Apr 29 08:55:00.316389 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 176/361] 10.222.0.31 () {62 vars in 1318 bytes} [Fri Apr 29 08:54:59 2022] POST /compute/v2.1/servers/406b5ad6-698e-457f-93f4-cdfd45fb3e8e/action => generated 0 bytes in 451 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Apr 29 08:55:00.325788 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-8f5c117a-3651-4026-ae35-1533d2f42165 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Calling method '>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:55:00.326492 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-8f5c117a-3651-4026-ae35-1533d2f42165 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] [instance: 406b5ad6-698e-457f-93f4-cdfd45fb3e8e] Fetching instance by UUID {{(pid=123459) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:55:00.333410 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-8f5c117a-3651-4026-ae35-1533d2f42165 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:55:00.333864 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-8f5c117a-3651-4026-ae35-1533d2f42165 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:55:00.334662 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-8f5c117a-3651-4026-ae35-1533d2f42165 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:55:00.335102 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-8f5c117a-3651-4026-ae35-1533d2f42165 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:55:00.388484 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-83800e5d-1441-457e-9da1-0e4709dc88cb tempest-VolumesNegativeTest-45234477 tempest-VolumesNegativeTest-45234477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '340cefa576c947d08978a99d288304c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c9877c06a2445a3a34c5d35bafeb7a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:55:00.396181 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-83800e5d-1441-457e-9da1-0e4709dc88cb tempest-VolumesNegativeTest-45234477 tempest-VolumesNegativeTest-45234477-project] 10.222.0.31 "GET /compute/v2.1/servers/1bcda922-2a2b-4382-9d9e-f083519473d8" status: 200 len: 1267 microversion: 2.1 time: 0.117076 Apr 29 08:55:00.397000 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 186/362] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 08:55:00 2022] GET /compute/v2.1/servers/1bcda922-2a2b-4382-9d9e-f083519473d8 => generated 1267 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 29 08:55:00.432561 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-54cc56b2-de77-47c0-bc07-a5374fd68128 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Calling method '>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:55:00.433313 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-54cc56b2-de77-47c0-bc07-a5374fd68128 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] [instance: 4e972e2b-7b5e-4a5f-87a1-3642aad3ac24] Fetching instance by UUID {{(pid=123458) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:55:00.442966 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-54cc56b2-de77-47c0-bc07-a5374fd68128 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:55:00.443722 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-54cc56b2-de77-47c0-bc07-a5374fd68128 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:55:00.445059 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-54cc56b2-de77-47c0-bc07-a5374fd68128 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:55:00.445735 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-54cc56b2-de77-47c0-bc07-a5374fd68128 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:55:00.486403 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-8f5c117a-3651-4026-ae35-1533d2f42165 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:55:00.495416 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-8f5c117a-3651-4026-ae35-1533d2f42165 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:55:00.496954 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-8f5c117a-3651-4026-ae35-1533d2f42165 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:55:00.498309 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-8f5c117a-3651-4026-ae35-1533d2f42165 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] 10.222.0.31 "GET /compute/v2.1/servers/406b5ad6-698e-457f-93f4-cdfd45fb3e8e" status: 200 len: 1726 microversion: 2.20 time: 0.176932 Apr 29 08:55:00.498883 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 177/363] 10.222.0.31 () {60 vars in 1276 bytes} [Fri Apr 29 08:55:00 2022] GET /compute/v2.1/servers/406b5ad6-698e-457f-93f4-cdfd45fb3e8e => generated 1726 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 29 08:55:00.590457 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-54cc56b2-de77-47c0-bc07-a5374fd68128 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c18e88436f14dc7a2001220b87ce9ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60998f08c40446e787ead285e40665b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:55:00.598496 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-54cc56b2-de77-47c0-bc07-a5374fd68128 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] 10.222.0.31 "GET /compute/v2.1/servers/4e972e2b-7b5e-4a5f-87a1-3642aad3ac24" status: 200 len: 1522 microversion: 2.1 time: 0.169781 Apr 29 08:55:00.599301 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 187/364] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 08:55:00 2022] GET /compute/v2.1/servers/4e972e2b-7b5e-4a5f-87a1-3642aad3ac24 => generated 1522 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 08:55:00.823579 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-c5687c99-4dde-4e24-99e2-63fd167d7b66 tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] Calling method '>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:55:00.824212 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-c5687c99-4dde-4e24-99e2-63fd167d7b66 tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] [instance: d83c29d2-6435-4edc-827b-2c37a66fb199] Fetching instance by UUID {{(pid=123459) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:55:00.830858 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-c5687c99-4dde-4e24-99e2-63fd167d7b66 tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:55:00.831504 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-c5687c99-4dde-4e24-99e2-63fd167d7b66 tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:55:00.832461 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-c5687c99-4dde-4e24-99e2-63fd167d7b66 tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:55:00.832987 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-c5687c99-4dde-4e24-99e2-63fd167d7b66 tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:55:00.971895 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-c5687c99-4dde-4e24-99e2-63fd167d7b66 tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcf1c67873b7443084ea183c77698062', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0436edb5348a4ad5a0b6b5979a7c54fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:55:00.980643 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-c5687c99-4dde-4e24-99e2-63fd167d7b66 tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] 10.222.0.31 "GET /compute/v2.1/servers/d83c29d2-6435-4edc-827b-2c37a66fb199" status: 200 len: 1261 microversion: 2.1 time: 0.160706 Apr 29 08:55:00.981227 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 178/365] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 08:55:00 2022] GET /compute/v2.1/servers/d83c29d2-6435-4edc-827b-2c37a66fb199 => generated 1261 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 08:55:01.413439 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-9e764082-16e3-486c-afa3-2f5fee1dbe81 tempest-VolumesNegativeTest-45234477 tempest-VolumesNegativeTest-45234477-project] Calling method '>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:55:01.414052 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-9e764082-16e3-486c-afa3-2f5fee1dbe81 tempest-VolumesNegativeTest-45234477 tempest-VolumesNegativeTest-45234477-project] [instance: 1bcda922-2a2b-4382-9d9e-f083519473d8] Fetching instance by UUID {{(pid=123458) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:55:01.424355 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-9e764082-16e3-486c-afa3-2f5fee1dbe81 tempest-VolumesNegativeTest-45234477 tempest-VolumesNegativeTest-45234477-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:55:01.425048 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-9e764082-16e3-486c-afa3-2f5fee1dbe81 tempest-VolumesNegativeTest-45234477 tempest-VolumesNegativeTest-45234477-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:55:01.426430 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-9e764082-16e3-486c-afa3-2f5fee1dbe81 tempest-VolumesNegativeTest-45234477 tempest-VolumesNegativeTest-45234477-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:55:01.427230 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-9e764082-16e3-486c-afa3-2f5fee1dbe81 tempest-VolumesNegativeTest-45234477 tempest-VolumesNegativeTest-45234477-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:55:01.491674 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-9e764082-16e3-486c-afa3-2f5fee1dbe81 tempest-VolumesNegativeTest-45234477 tempest-VolumesNegativeTest-45234477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '340cefa576c947d08978a99d288304c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c9877c06a2445a3a34c5d35bafeb7a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:55:01.499468 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-9e764082-16e3-486c-afa3-2f5fee1dbe81 tempest-VolumesNegativeTest-45234477 tempest-VolumesNegativeTest-45234477-project] 10.222.0.31 "GET /compute/v2.1/servers/1bcda922-2a2b-4382-9d9e-f083519473d8" status: 200 len: 1275 microversion: 2.1 time: 0.090203 Apr 29 08:55:01.500042 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 188/366] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 08:55:01 2022] GET /compute/v2.1/servers/1bcda922-2a2b-4382-9d9e-f083519473d8 => generated 1275 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 08:55:01.521500 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-d2312e9a-0498-47be-98c9-67282f240bb3 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Calling method '>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:55:01.522109 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-d2312e9a-0498-47be-98c9-67282f240bb3 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] [instance: 406b5ad6-698e-457f-93f4-cdfd45fb3e8e] Fetching instance by UUID {{(pid=123459) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:55:01.529946 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-d2312e9a-0498-47be-98c9-67282f240bb3 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:55:01.530394 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-d2312e9a-0498-47be-98c9-67282f240bb3 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:55:01.531177 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-d2312e9a-0498-47be-98c9-67282f240bb3 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:55:01.531613 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-d2312e9a-0498-47be-98c9-67282f240bb3 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:55:01.615732 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-608c67a5-e7e3-45a9-ac29-afedcab53c0c tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Calling method '>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:55:01.616812 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-608c67a5-e7e3-45a9-ac29-afedcab53c0c tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] [instance: 4e972e2b-7b5e-4a5f-87a1-3642aad3ac24] Fetching instance by UUID {{(pid=123458) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:55:01.624286 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-608c67a5-e7e3-45a9-ac29-afedcab53c0c tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:55:01.624829 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-608c67a5-e7e3-45a9-ac29-afedcab53c0c tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:55:01.625687 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-608c67a5-e7e3-45a9-ac29-afedcab53c0c tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:55:01.626197 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-608c67a5-e7e3-45a9-ac29-afedcab53c0c tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:55:01.672818 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-d2312e9a-0498-47be-98c9-67282f240bb3 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:55:01.681125 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-d2312e9a-0498-47be-98c9-67282f240bb3 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:55:01.682623 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-d2312e9a-0498-47be-98c9-67282f240bb3 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:55:01.683809 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-d2312e9a-0498-47be-98c9-67282f240bb3 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] 10.222.0.31 "GET /compute/v2.1/servers/406b5ad6-698e-457f-93f4-cdfd45fb3e8e" status: 200 len: 1726 microversion: 2.20 time: 0.166917 Apr 29 08:55:01.684405 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 179/367] 10.222.0.31 () {60 vars in 1276 bytes} [Fri Apr 29 08:55:01 2022] GET /compute/v2.1/servers/406b5ad6-698e-457f-93f4-cdfd45fb3e8e => generated 1726 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 29 08:55:01.765116 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-608c67a5-e7e3-45a9-ac29-afedcab53c0c tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c18e88436f14dc7a2001220b87ce9ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60998f08c40446e787ead285e40665b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:55:01.773037 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-608c67a5-e7e3-45a9-ac29-afedcab53c0c tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] 10.222.0.31 "GET /compute/v2.1/servers/4e972e2b-7b5e-4a5f-87a1-3642aad3ac24" status: 200 len: 1522 microversion: 2.1 time: 0.161840 Apr 29 08:55:01.773607 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 189/368] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 08:55:01 2022] GET /compute/v2.1/servers/4e972e2b-7b5e-4a5f-87a1-3642aad3ac24 => generated 1522 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 08:55:01.998408 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-908d9009-ad59-4b89-89bb-b4752a069b32 tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] Calling method '>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:55:01.999040 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-908d9009-ad59-4b89-89bb-b4752a069b32 tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] [instance: d83c29d2-6435-4edc-827b-2c37a66fb199] Fetching instance by UUID {{(pid=123459) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:55:02.005577 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-908d9009-ad59-4b89-89bb-b4752a069b32 tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:55:02.006015 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-908d9009-ad59-4b89-89bb-b4752a069b32 tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:55:02.006773 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-908d9009-ad59-4b89-89bb-b4752a069b32 tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:55:02.007202 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-908d9009-ad59-4b89-89bb-b4752a069b32 tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:55:02.146101 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-908d9009-ad59-4b89-89bb-b4752a069b32 tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcf1c67873b7443084ea183c77698062', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0436edb5348a4ad5a0b6b5979a7c54fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:55:02.153715 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-908d9009-ad59-4b89-89bb-b4752a069b32 tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] 10.222.0.31 "GET /compute/v2.1/servers/d83c29d2-6435-4edc-827b-2c37a66fb199" status: 200 len: 1261 microversion: 2.1 time: 0.158993 Apr 29 08:55:02.154293 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 180/369] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 08:55:01 2022] GET /compute/v2.1/servers/d83c29d2-6435-4edc-827b-2c37a66fb199 => generated 1261 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 08:55:02.518598 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-e8ac1620-3c44-40ec-8434-12aedd737428 tempest-VolumesNegativeTest-45234477 tempest-VolumesNegativeTest-45234477-project] Calling method '>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:55:02.519206 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-e8ac1620-3c44-40ec-8434-12aedd737428 tempest-VolumesNegativeTest-45234477 tempest-VolumesNegativeTest-45234477-project] [instance: 1bcda922-2a2b-4382-9d9e-f083519473d8] Fetching instance by UUID {{(pid=123458) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:55:02.526129 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-e8ac1620-3c44-40ec-8434-12aedd737428 tempest-VolumesNegativeTest-45234477 tempest-VolumesNegativeTest-45234477-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:55:02.526575 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-e8ac1620-3c44-40ec-8434-12aedd737428 tempest-VolumesNegativeTest-45234477 tempest-VolumesNegativeTest-45234477-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:55:02.527350 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-e8ac1620-3c44-40ec-8434-12aedd737428 tempest-VolumesNegativeTest-45234477 tempest-VolumesNegativeTest-45234477-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:55:02.527785 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-e8ac1620-3c44-40ec-8434-12aedd737428 tempest-VolumesNegativeTest-45234477 tempest-VolumesNegativeTest-45234477-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:55:02.592766 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-e8ac1620-3c44-40ec-8434-12aedd737428 tempest-VolumesNegativeTest-45234477 tempest-VolumesNegativeTest-45234477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '340cefa576c947d08978a99d288304c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c9877c06a2445a3a34c5d35bafeb7a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:55:02.600491 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-e8ac1620-3c44-40ec-8434-12aedd737428 tempest-VolumesNegativeTest-45234477 tempest-VolumesNegativeTest-45234477-project] 10.222.0.31 "GET /compute/v2.1/servers/1bcda922-2a2b-4382-9d9e-f083519473d8" status: 200 len: 1275 microversion: 2.1 time: 0.085739 Apr 29 08:55:02.601098 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 190/370] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 08:55:02 2022] GET /compute/v2.1/servers/1bcda922-2a2b-4382-9d9e-f083519473d8 => generated 1275 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 08:55:02.703781 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-f9eafd76-8c54-44fd-84d7-fc229958af96 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Calling method '>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:55:02.704410 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-f9eafd76-8c54-44fd-84d7-fc229958af96 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] [instance: 406b5ad6-698e-457f-93f4-cdfd45fb3e8e] Fetching instance by UUID {{(pid=123459) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:55:02.710485 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-f9eafd76-8c54-44fd-84d7-fc229958af96 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:55:02.710925 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-f9eafd76-8c54-44fd-84d7-fc229958af96 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:55:02.711697 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-f9eafd76-8c54-44fd-84d7-fc229958af96 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:55:02.712162 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-f9eafd76-8c54-44fd-84d7-fc229958af96 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:55:02.790362 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-25e5aa0d-6f24-4085-91d5-da285e1c40b9 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Calling method '>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:55:02.790943 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-25e5aa0d-6f24-4085-91d5-da285e1c40b9 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] [instance: 4e972e2b-7b5e-4a5f-87a1-3642aad3ac24] Fetching instance by UUID {{(pid=123458) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:55:02.796935 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-25e5aa0d-6f24-4085-91d5-da285e1c40b9 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:55:02.797389 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-25e5aa0d-6f24-4085-91d5-da285e1c40b9 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:55:02.798173 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-25e5aa0d-6f24-4085-91d5-da285e1c40b9 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:55:02.798608 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-25e5aa0d-6f24-4085-91d5-da285e1c40b9 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:55:02.842954 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-f9eafd76-8c54-44fd-84d7-fc229958af96 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:55:02.851020 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-f9eafd76-8c54-44fd-84d7-fc229958af96 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:55:02.852905 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-f9eafd76-8c54-44fd-84d7-fc229958af96 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:55:02.853675 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-f9eafd76-8c54-44fd-84d7-fc229958af96 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] 10.222.0.31 "GET /compute/v2.1/servers/406b5ad6-698e-457f-93f4-cdfd45fb3e8e" status: 200 len: 1726 microversion: 2.20 time: 0.154076 Apr 29 08:55:02.854567 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 181/371] 10.222.0.31 () {60 vars in 1276 bytes} [Fri Apr 29 08:55:02 2022] GET /compute/v2.1/servers/406b5ad6-698e-457f-93f4-cdfd45fb3e8e => generated 1726 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 29 08:55:02.929370 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-25e5aa0d-6f24-4085-91d5-da285e1c40b9 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c18e88436f14dc7a2001220b87ce9ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60998f08c40446e787ead285e40665b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:55:02.936981 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-25e5aa0d-6f24-4085-91d5-da285e1c40b9 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] 10.222.0.31 "GET /compute/v2.1/servers/4e972e2b-7b5e-4a5f-87a1-3642aad3ac24" status: 200 len: 1522 microversion: 2.1 time: 0.150647 Apr 29 08:55:02.937589 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 191/372] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 08:55:02 2022] GET /compute/v2.1/servers/4e972e2b-7b5e-4a5f-87a1-3642aad3ac24 => generated 1522 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 29 08:55:03.170811 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-cb28ac1d-6e08-4976-b604-4daea1823b9a tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] Calling method '>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:55:03.171347 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-cb28ac1d-6e08-4976-b604-4daea1823b9a tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] [instance: d83c29d2-6435-4edc-827b-2c37a66fb199] Fetching instance by UUID {{(pid=123459) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:55:03.178467 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-cb28ac1d-6e08-4976-b604-4daea1823b9a tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:55:03.178959 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-cb28ac1d-6e08-4976-b604-4daea1823b9a tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:55:03.179727 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-cb28ac1d-6e08-4976-b604-4daea1823b9a tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:55:03.180184 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-cb28ac1d-6e08-4976-b604-4daea1823b9a tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:55:03.313197 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-cb28ac1d-6e08-4976-b604-4daea1823b9a tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcf1c67873b7443084ea183c77698062', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0436edb5348a4ad5a0b6b5979a7c54fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:55:03.320746 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-cb28ac1d-6e08-4976-b604-4daea1823b9a tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] 10.222.0.31 "GET /compute/v2.1/servers/d83c29d2-6435-4edc-827b-2c37a66fb199" status: 200 len: 1261 microversion: 2.1 time: 0.153754 Apr 29 08:55:03.321327 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 182/373] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 08:55:03 2022] GET /compute/v2.1/servers/d83c29d2-6435-4edc-827b-2c37a66fb199 => generated 1261 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 08:55:03.617527 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-1fa6738f-e421-470b-80db-da38723d29fa tempest-VolumesNegativeTest-45234477 tempest-VolumesNegativeTest-45234477-project] Calling method '>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:55:03.618275 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-1fa6738f-e421-470b-80db-da38723d29fa tempest-VolumesNegativeTest-45234477 tempest-VolumesNegativeTest-45234477-project] [instance: 1bcda922-2a2b-4382-9d9e-f083519473d8] Fetching instance by UUID {{(pid=123458) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:55:03.624201 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-1fa6738f-e421-470b-80db-da38723d29fa tempest-VolumesNegativeTest-45234477 tempest-VolumesNegativeTest-45234477-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:55:03.624643 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-1fa6738f-e421-470b-80db-da38723d29fa tempest-VolumesNegativeTest-45234477 tempest-VolumesNegativeTest-45234477-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:55:03.625419 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-1fa6738f-e421-470b-80db-da38723d29fa tempest-VolumesNegativeTest-45234477 tempest-VolumesNegativeTest-45234477-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:55:03.625852 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-1fa6738f-e421-470b-80db-da38723d29fa tempest-VolumesNegativeTest-45234477 tempest-VolumesNegativeTest-45234477-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:55:03.685935 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-1fa6738f-e421-470b-80db-da38723d29fa tempest-VolumesNegativeTest-45234477 tempest-VolumesNegativeTest-45234477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '340cefa576c947d08978a99d288304c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c9877c06a2445a3a34c5d35bafeb7a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:55:03.693690 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-1fa6738f-e421-470b-80db-da38723d29fa tempest-VolumesNegativeTest-45234477 tempest-VolumesNegativeTest-45234477-project] 10.222.0.31 "GET /compute/v2.1/servers/1bcda922-2a2b-4382-9d9e-f083519473d8" status: 200 len: 1275 microversion: 2.1 time: 0.080254 Apr 29 08:55:03.694264 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 192/374] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 08:55:03 2022] GET /compute/v2.1/servers/1bcda922-2a2b-4382-9d9e-f083519473d8 => generated 1275 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 29 08:55:03.873149 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-c3b7c778-0b31-4d40-9cad-4f0716608351 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Calling method '>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:55:03.873695 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-c3b7c778-0b31-4d40-9cad-4f0716608351 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] [instance: 406b5ad6-698e-457f-93f4-cdfd45fb3e8e] Fetching instance by UUID {{(pid=123459) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:55:03.880043 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-c3b7c778-0b31-4d40-9cad-4f0716608351 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:55:03.880517 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-c3b7c778-0b31-4d40-9cad-4f0716608351 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:55:03.881318 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-c3b7c778-0b31-4d40-9cad-4f0716608351 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:55:03.881752 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-c3b7c778-0b31-4d40-9cad-4f0716608351 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:55:03.953740 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-ac02c8ca-c9c3-4a1b-891e-d1c983e1d466 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Calling method '>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:55:03.954203 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-ac02c8ca-c9c3-4a1b-891e-d1c983e1d466 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] [instance: 4e972e2b-7b5e-4a5f-87a1-3642aad3ac24] Fetching instance by UUID {{(pid=123458) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:55:03.961091 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-ac02c8ca-c9c3-4a1b-891e-d1c983e1d466 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:55:03.962154 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-ac02c8ca-c9c3-4a1b-891e-d1c983e1d466 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:55:03.962940 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-ac02c8ca-c9c3-4a1b-891e-d1c983e1d466 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:55:03.963371 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-ac02c8ca-c9c3-4a1b-891e-d1c983e1d466 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:55:04.016080 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-c3b7c778-0b31-4d40-9cad-4f0716608351 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:55:04.026935 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-c3b7c778-0b31-4d40-9cad-4f0716608351 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:55:04.028494 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-c3b7c778-0b31-4d40-9cad-4f0716608351 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:55:04.029724 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-c3b7c778-0b31-4d40-9cad-4f0716608351 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] 10.222.0.31 "GET /compute/v2.1/servers/406b5ad6-698e-457f-93f4-cdfd45fb3e8e" status: 200 len: 1726 microversion: 2.20 time: 0.160587 Apr 29 08:55:04.032432 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 183/375] 10.222.0.31 () {60 vars in 1276 bytes} [Fri Apr 29 08:55:03 2022] GET /compute/v2.1/servers/406b5ad6-698e-457f-93f4-cdfd45fb3e8e => generated 1726 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 29 08:55:04.338258 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-2ac6165a-95f3-41cc-87c9-a44263a995a7 tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] Calling method '>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:55:04.339009 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-2ac6165a-95f3-41cc-87c9-a44263a995a7 tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] [instance: d83c29d2-6435-4edc-827b-2c37a66fb199] Fetching instance by UUID {{(pid=123459) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:55:04.345628 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-2ac6165a-95f3-41cc-87c9-a44263a995a7 tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:55:04.346075 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-2ac6165a-95f3-41cc-87c9-a44263a995a7 tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:55:04.346859 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-2ac6165a-95f3-41cc-87c9-a44263a995a7 tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:55:04.347292 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-2ac6165a-95f3-41cc-87c9-a44263a995a7 tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:55:04.354224 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-ac02c8ca-c9c3-4a1b-891e-d1c983e1d466 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c18e88436f14dc7a2001220b87ce9ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60998f08c40446e787ead285e40665b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:55:04.361845 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-ac02c8ca-c9c3-4a1b-891e-d1c983e1d466 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] 10.222.0.31 "GET /compute/v2.1/servers/4e972e2b-7b5e-4a5f-87a1-3642aad3ac24" status: 200 len: 1522 microversion: 2.1 time: 0.412047 Apr 29 08:55:04.362424 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 193/376] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 08:55:03 2022] GET /compute/v2.1/servers/4e972e2b-7b5e-4a5f-87a1-3642aad3ac24 => generated 1522 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 29 08:55:04.486985 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-2ac6165a-95f3-41cc-87c9-a44263a995a7 tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcf1c67873b7443084ea183c77698062', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0436edb5348a4ad5a0b6b5979a7c54fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:55:04.495393 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-2ac6165a-95f3-41cc-87c9-a44263a995a7 tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] 10.222.0.31 "GET /compute/v2.1/servers/d83c29d2-6435-4edc-827b-2c37a66fb199" status: 200 len: 1261 microversion: 2.1 time: 0.160898 Apr 29 08:55:04.495968 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 184/377] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 08:55:04 2022] GET /compute/v2.1/servers/d83c29d2-6435-4edc-827b-2c37a66fb199 => generated 1261 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 08:55:04.712624 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-1376ad87-d390-418c-9950-dc7331b0349a tempest-VolumesNegativeTest-45234477 tempest-VolumesNegativeTest-45234477-project] Calling method '>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:55:04.713712 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-1376ad87-d390-418c-9950-dc7331b0349a tempest-VolumesNegativeTest-45234477 tempest-VolumesNegativeTest-45234477-project] [instance: 1bcda922-2a2b-4382-9d9e-f083519473d8] Fetching instance by UUID {{(pid=123458) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:55:04.747863 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-1376ad87-d390-418c-9950-dc7331b0349a tempest-VolumesNegativeTest-45234477 tempest-VolumesNegativeTest-45234477-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:55:04.748596 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-1376ad87-d390-418c-9950-dc7331b0349a tempest-VolumesNegativeTest-45234477 tempest-VolumesNegativeTest-45234477-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:55:04.749565 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-1376ad87-d390-418c-9950-dc7331b0349a tempest-VolumesNegativeTest-45234477 tempest-VolumesNegativeTest-45234477-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:55:04.750427 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-1376ad87-d390-418c-9950-dc7331b0349a tempest-VolumesNegativeTest-45234477 tempest-VolumesNegativeTest-45234477-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:55:04.839152 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-1376ad87-d390-418c-9950-dc7331b0349a tempest-VolumesNegativeTest-45234477 tempest-VolumesNegativeTest-45234477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '340cefa576c947d08978a99d288304c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c9877c06a2445a3a34c5d35bafeb7a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:55:04.847080 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-1376ad87-d390-418c-9950-dc7331b0349a tempest-VolumesNegativeTest-45234477 tempest-VolumesNegativeTest-45234477-project] 10.222.0.31 "GET /compute/v2.1/servers/1bcda922-2a2b-4382-9d9e-f083519473d8" status: 200 len: 1273 microversion: 2.1 time: 0.139996 Apr 29 08:55:04.847913 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 194/378] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 08:55:04 2022] GET /compute/v2.1/servers/1bcda922-2a2b-4382-9d9e-f083519473d8 => generated 1273 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 08:55:04.932038 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [req-93604231-4525-41fa-ab30-bc8bc955ceab req-59e55f07-ebb9-4752-bb61-136e9bbf91e5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d83c29d2-6435-4edc-827b-2c37a66fb199", "name": "network-vif-plugged", "status": "completed", "tag": "67bd0bd8-da3b-4ea7-9bf9-bfddba4f2c80"}]} {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 29 08:55:04.942528 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [req-93604231-4525-41fa-ab30-bc8bc955ceab req-59e55f07-ebb9-4752-bb61-136e9bbf91e5 service nova] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:55:04.943169 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [req-93604231-4525-41fa-ab30-bc8bc955ceab req-59e55f07-ebb9-4752-bb61-136e9bbf91e5 service nova] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:55:04.954466 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.compute.server_external_events [req-93604231-4525-41fa-ab30-bc8bc955ceab req-59e55f07-ebb9-4752-bb61-136e9bbf91e5 service nova] Creating event network-vif-plugged:67bd0bd8-da3b-4ea7-9bf9-bfddba4f2c80 for instance d83c29d2-6435-4edc-827b-2c37a66fb199 on hv-cinder-83987 Apr 29 08:55:04.960528 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [req-93604231-4525-41fa-ab30-bc8bc955ceab req-59e55f07-ebb9-4752-bb61-136e9bbf91e5 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032057 Apr 29 08:55:04.961128 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 185/379] 10.222.0.31 () {64 vars in 1317 bytes} [Fri Apr 29 08:55:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 29 08:55:05.047976 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-7fde1d5a-5121-4018-a5ee-8d632712ca06 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Calling method '>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:55:05.048626 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-7fde1d5a-5121-4018-a5ee-8d632712ca06 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] [instance: 406b5ad6-698e-457f-93f4-cdfd45fb3e8e] Fetching instance by UUID {{(pid=123458) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:55:05.054890 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-7fde1d5a-5121-4018-a5ee-8d632712ca06 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:55:05.055341 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-7fde1d5a-5121-4018-a5ee-8d632712ca06 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:55:05.056119 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-7fde1d5a-5121-4018-a5ee-8d632712ca06 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:55:05.056837 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-7fde1d5a-5121-4018-a5ee-8d632712ca06 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:55:05.166519 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-159f2bcf-64df-47e5-aa79-f298056d671e tempest-VolumesSnapshotTestJSON-1697003112 tempest-VolumesSnapshotTestJSON-1697003112-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-2078981370", "imageRef": "e0678f88-0b68-4453-b569-29fd065e544e", "flavorRef": "452", "networks": [{"uuid": "f4f44d9f-d67a-42a4-ae05-6cfe31d44fd1"}]}} {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 29 08:55:05.220449 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.network.neutron [None req-159f2bcf-64df-47e5-aa79-f298056d671e tempest-VolumesSnapshotTestJSON-1697003112 tempest-VolumesSnapshotTestJSON-1697003112-project] validate_networks() for [('f4f44d9f-d67a-42a4-ae05-6cfe31d44fd1', None, None, None, None, None)] {{(pid=123459) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 29 08:55:05.269555 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-7fde1d5a-5121-4018-a5ee-8d632712ca06 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:55:05.280283 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-7fde1d5a-5121-4018-a5ee-8d632712ca06 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:55:05.282259 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-7fde1d5a-5121-4018-a5ee-8d632712ca06 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:55:05.284338 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-7fde1d5a-5121-4018-a5ee-8d632712ca06 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] 10.222.0.31 "GET /compute/v2.1/servers/406b5ad6-698e-457f-93f4-cdfd45fb3e8e" status: 200 len: 1726 microversion: 2.20 time: 0.240020 Apr 29 08:55:05.286858 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 195/380] 10.222.0.31 () {60 vars in 1276 bytes} [Fri Apr 29 08:55:05 2022] GET /compute/v2.1/servers/406b5ad6-698e-457f-93f4-cdfd45fb3e8e => generated 1726 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 29 08:55:05.381026 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-7e3a2c14-9d92-4be0-9f3d-4fc2386d220d tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Calling method '>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:55:05.381964 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-7e3a2c14-9d92-4be0-9f3d-4fc2386d220d tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] [instance: 4e972e2b-7b5e-4a5f-87a1-3642aad3ac24] Fetching instance by UUID {{(pid=123458) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:55:05.389708 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-7e3a2c14-9d92-4be0-9f3d-4fc2386d220d tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:55:05.390165 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-7e3a2c14-9d92-4be0-9f3d-4fc2386d220d tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:55:05.391117 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-7e3a2c14-9d92-4be0-9f3d-4fc2386d220d tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:55:05.391739 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-7e3a2c14-9d92-4be0-9f3d-4fc2386d220d tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:55:05.604514 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.virt.hardware [None req-159f2bcf-64df-47e5-aa79-f298056d671e tempest-VolumesSnapshotTestJSON-1697003112 tempest-VolumesSnapshotTestJSON-1697003112-project] Flavor limits 0:0:0 {{(pid=123459) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 29 08:55:05.605145 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.virt.hardware [None req-159f2bcf-64df-47e5-aa79-f298056d671e tempest-VolumesSnapshotTestJSON-1697003112 tempest-VolumesSnapshotTestJSON-1697003112-project] Image limits 0:0:0 {{(pid=123459) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 29 08:55:05.605777 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.virt.hardware [None req-159f2bcf-64df-47e5-aa79-f298056d671e tempest-VolumesSnapshotTestJSON-1697003112 tempest-VolumesSnapshotTestJSON-1697003112-project] Flavor pref 0:0:0 {{(pid=123459) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 29 08:55:05.606762 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.virt.hardware [None req-159f2bcf-64df-47e5-aa79-f298056d671e tempest-VolumesSnapshotTestJSON-1697003112 tempest-VolumesSnapshotTestJSON-1697003112-project] Image pref 0:0:0 {{(pid=123459) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 29 08:55:05.607202 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.virt.hardware [None req-159f2bcf-64df-47e5-aa79-f298056d671e tempest-VolumesSnapshotTestJSON-1697003112 tempest-VolumesSnapshotTestJSON-1697003112-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123459) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 29 08:55:05.621243 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-159f2bcf-64df-47e5-aa79-f298056d671e tempest-VolumesSnapshotTestJSON-1697003112 tempest-VolumesSnapshotTestJSON-1697003112-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:55:05.621691 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-159f2bcf-64df-47e5-aa79-f298056d671e tempest-VolumesSnapshotTestJSON-1697003112 tempest-VolumesSnapshotTestJSON-1697003112-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:55:05.623634 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-159f2bcf-64df-47e5-aa79-f298056d671e tempest-VolumesSnapshotTestJSON-1697003112 tempest-VolumesSnapshotTestJSON-1697003112-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:55:05.624197 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-159f2bcf-64df-47e5-aa79-f298056d671e tempest-VolumesSnapshotTestJSON-1697003112 tempest-VolumesSnapshotTestJSON-1697003112-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:55:05.632510 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-7e3a2c14-9d92-4be0-9f3d-4fc2386d220d tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c18e88436f14dc7a2001220b87ce9ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60998f08c40446e787ead285e40665b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:55:05.640097 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-7e3a2c14-9d92-4be0-9f3d-4fc2386d220d tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] 10.222.0.31 "GET /compute/v2.1/servers/4e972e2b-7b5e-4a5f-87a1-3642aad3ac24" status: 200 len: 1522 microversion: 2.1 time: 0.264723 Apr 29 08:55:05.640995 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 196/381] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 08:55:05 2022] GET /compute/v2.1/servers/4e972e2b-7b5e-4a5f-87a1-3642aad3ac24 => generated 1522 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 08:55:05.646301 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-731ffaa7-f7b9-4e85-922a-3b350215cc09 tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] Calling method '>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:55:05.647127 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-731ffaa7-f7b9-4e85-922a-3b350215cc09 tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] [instance: d83c29d2-6435-4edc-827b-2c37a66fb199] Fetching instance by UUID {{(pid=123458) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:55:05.653163 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-731ffaa7-f7b9-4e85-922a-3b350215cc09 tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:55:05.653622 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-731ffaa7-f7b9-4e85-922a-3b350215cc09 tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:55:05.654408 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-731ffaa7-f7b9-4e85-922a-3b350215cc09 tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:55:05.655050 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-731ffaa7-f7b9-4e85-922a-3b350215cc09 tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:55:05.655256 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.quota [None req-159f2bcf-64df-47e5-aa79-f298056d671e tempest-VolumesSnapshotTestJSON-1697003112 tempest-VolumesSnapshotTestJSON-1697003112-project] Getting quotas for project 2c0d26c7abcc4bc7b175ac175bb5f2ec. Resources: {'instances', 'cores', 'ram'} {{(pid=123459) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 29 08:55:05.659852 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.quota [None req-159f2bcf-64df-47e5-aa79-f298056d671e tempest-VolumesSnapshotTestJSON-1697003112 tempest-VolumesSnapshotTestJSON-1697003112-project] Getting quotas for user a210cf812fb54682ac28a13a5dce0563 and project 2c0d26c7abcc4bc7b175ac175bb5f2ec. Resources: {'instances', 'cores', 'ram'} {{(pid=123459) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 29 08:55:05.673930 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-159f2bcf-64df-47e5-aa79-f298056d671e tempest-VolumesSnapshotTestJSON-1697003112 tempest-VolumesSnapshotTestJSON-1697003112-project] Going to run 1 instances... {{(pid=123459) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 29 08:55:05.676514 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-159f2bcf-64df-47e5-aa79-f298056d671e tempest-VolumesSnapshotTestJSON-1697003112 tempest-VolumesSnapshotTestJSON-1697003112-project] [instance: 4a2c7e29-e0ec-456b-bd06-ff7127f84e54] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e0678f88-0b68-4453-b569-29fd065e544e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123459) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 29 08:55:05.726362 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-159f2bcf-64df-47e5-aa79-f298056d671e tempest-VolumesSnapshotTestJSON-1697003112 tempest-VolumesSnapshotTestJSON-1697003112-project] 10.222.0.31 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.564148 Apr 29 08:55:05.727229 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 186/382] 10.222.0.31 () {60 vars in 1146 bytes} [Fri Apr 29 08:55:05 2022] POST /compute/v2.1/servers => generated 380 bytes in 567 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Apr 29 08:55:05.737843 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-462c8a99-ffd8-4789-b4b3-b4daaa7c7663 tempest-VolumesSnapshotTestJSON-1697003112 tempest-VolumesSnapshotTestJSON-1697003112-project] Calling method '>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:55:05.738664 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-462c8a99-ffd8-4789-b4b3-b4daaa7c7663 tempest-VolumesSnapshotTestJSON-1697003112 tempest-VolumesSnapshotTestJSON-1697003112-project] [instance: 4a2c7e29-e0ec-456b-bd06-ff7127f84e54] Fetching instance by UUID {{(pid=123459) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:55:05.793500 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-462c8a99-ffd8-4789-b4b3-b4daaa7c7663 tempest-VolumesSnapshotTestJSON-1697003112 tempest-VolumesSnapshotTestJSON-1697003112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a210cf812fb54682ac28a13a5dce0563', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c0d26c7abcc4bc7b175ac175bb5f2ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:55:05.801462 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-462c8a99-ffd8-4789-b4b3-b4daaa7c7663 tempest-VolumesSnapshotTestJSON-1697003112 tempest-VolumesSnapshotTestJSON-1697003112-project] 10.222.0.31 "GET /compute/v2.1/servers/4a2c7e29-e0ec-456b-bd06-ff7127f84e54" status: 200 len: 1219 microversion: 2.1 time: 0.067802 Apr 29 08:55:05.808509 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 187/383] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 08:55:05 2022] GET /compute/v2.1/servers/4a2c7e29-e0ec-456b-bd06-ff7127f84e54 => generated 1219 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 29 08:55:05.864537 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-9fbf923a-852b-4bd6-a64a-db108b1a3256 tempest-VolumesNegativeTest-45234477 tempest-VolumesNegativeTest-45234477-project] Calling method '>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:55:05.865152 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-9fbf923a-852b-4bd6-a64a-db108b1a3256 tempest-VolumesNegativeTest-45234477 tempest-VolumesNegativeTest-45234477-project] [instance: 1bcda922-2a2b-4382-9d9e-f083519473d8] Fetching instance by UUID {{(pid=123459) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:55:05.871935 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-9fbf923a-852b-4bd6-a64a-db108b1a3256 tempest-VolumesNegativeTest-45234477 tempest-VolumesNegativeTest-45234477-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:55:05.872692 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-9fbf923a-852b-4bd6-a64a-db108b1a3256 tempest-VolumesNegativeTest-45234477 tempest-VolumesNegativeTest-45234477-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:55:05.873179 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-9fbf923a-852b-4bd6-a64a-db108b1a3256 tempest-VolumesNegativeTest-45234477 tempest-VolumesNegativeTest-45234477-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:55:05.873706 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-9fbf923a-852b-4bd6-a64a-db108b1a3256 tempest-VolumesNegativeTest-45234477 tempest-VolumesNegativeTest-45234477-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:55:05.896394 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-731ffaa7-f7b9-4e85-922a-3b350215cc09 tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcf1c67873b7443084ea183c77698062', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0436edb5348a4ad5a0b6b5979a7c54fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:55:05.905725 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-731ffaa7-f7b9-4e85-922a-3b350215cc09 tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] 10.222.0.31 "GET /compute/v2.1/servers/d83c29d2-6435-4edc-827b-2c37a66fb199" status: 200 len: 1261 microversion: 2.1 time: 0.263447 Apr 29 08:55:05.906529 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 197/384] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 08:55:05 2022] GET /compute/v2.1/servers/d83c29d2-6435-4edc-827b-2c37a66fb199 => generated 1261 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 08:55:05.942130 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-9fbf923a-852b-4bd6-a64a-db108b1a3256 tempest-VolumesNegativeTest-45234477 tempest-VolumesNegativeTest-45234477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '340cefa576c947d08978a99d288304c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c9877c06a2445a3a34c5d35bafeb7a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:55:05.949900 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-9fbf923a-852b-4bd6-a64a-db108b1a3256 tempest-VolumesNegativeTest-45234477 tempest-VolumesNegativeTest-45234477-project] 10.222.0.31 "GET /compute/v2.1/servers/1bcda922-2a2b-4382-9d9e-f083519473d8" status: 200 len: 1273 microversion: 2.1 time: 0.089400 Apr 29 08:55:05.951214 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 188/385] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 08:55:05 2022] GET /compute/v2.1/servers/1bcda922-2a2b-4382-9d9e-f083519473d8 => generated 1273 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 29 08:55:06.310455 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-85ae8ae2-b8d0-4238-bbbd-faae1c0d90b3 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Calling method '>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:55:06.311555 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-85ae8ae2-b8d0-4238-bbbd-faae1c0d90b3 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] [instance: 406b5ad6-698e-457f-93f4-cdfd45fb3e8e] Fetching instance by UUID {{(pid=123458) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:55:06.320818 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-85ae8ae2-b8d0-4238-bbbd-faae1c0d90b3 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:55:06.321989 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-85ae8ae2-b8d0-4238-bbbd-faae1c0d90b3 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:55:06.322915 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-85ae8ae2-b8d0-4238-bbbd-faae1c0d90b3 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:55:06.323470 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-85ae8ae2-b8d0-4238-bbbd-faae1c0d90b3 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:55:06.591316 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-85ae8ae2-b8d0-4238-bbbd-faae1c0d90b3 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:55:06.601759 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-85ae8ae2-b8d0-4238-bbbd-faae1c0d90b3 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:55:06.603301 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-85ae8ae2-b8d0-4238-bbbd-faae1c0d90b3 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:55:06.604506 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-85ae8ae2-b8d0-4238-bbbd-faae1c0d90b3 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] 10.222.0.31 "GET /compute/v2.1/servers/406b5ad6-698e-457f-93f4-cdfd45fb3e8e" status: 200 len: 1726 microversion: 2.20 time: 0.301246 Apr 29 08:55:06.605081 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 198/386] 10.222.0.31 () {60 vars in 1276 bytes} [Fri Apr 29 08:55:06 2022] GET /compute/v2.1/servers/406b5ad6-698e-457f-93f4-cdfd45fb3e8e => generated 1726 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 29 08:55:06.658545 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-79f8d85d-80fc-478d-b9c0-8db108c4c1e2 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Calling method '>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:55:06.659405 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-79f8d85d-80fc-478d-b9c0-8db108c4c1e2 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] [instance: 4e972e2b-7b5e-4a5f-87a1-3642aad3ac24] Fetching instance by UUID {{(pid=123459) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:55:06.666715 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-79f8d85d-80fc-478d-b9c0-8db108c4c1e2 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:55:06.667161 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-79f8d85d-80fc-478d-b9c0-8db108c4c1e2 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:55:06.667948 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-79f8d85d-80fc-478d-b9c0-8db108c4c1e2 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:55:06.668417 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-79f8d85d-80fc-478d-b9c0-8db108c4c1e2 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:55:06.810586 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-79f8d85d-80fc-478d-b9c0-8db108c4c1e2 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c18e88436f14dc7a2001220b87ce9ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60998f08c40446e787ead285e40665b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:55:06.822007 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-79f8d85d-80fc-478d-b9c0-8db108c4c1e2 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] 10.222.0.31 "GET /compute/v2.1/servers/4e972e2b-7b5e-4a5f-87a1-3642aad3ac24" status: 200 len: 1522 microversion: 2.1 time: 0.167816 Apr 29 08:55:06.823816 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-61973658-51f3-4f81-878a-9ff07f8c80c8 tempest-VolumesSnapshotTestJSON-1697003112 tempest-VolumesSnapshotTestJSON-1697003112-project] Calling method '>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:55:06.824000 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 189/387] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 08:55:06 2022] GET /compute/v2.1/servers/4e972e2b-7b5e-4a5f-87a1-3642aad3ac24 => generated 1522 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 08:55:06.825043 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-61973658-51f3-4f81-878a-9ff07f8c80c8 tempest-VolumesSnapshotTestJSON-1697003112 tempest-VolumesSnapshotTestJSON-1697003112-project] [instance: 4a2c7e29-e0ec-456b-bd06-ff7127f84e54] Fetching instance by UUID {{(pid=123458) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:55:06.834265 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-61973658-51f3-4f81-878a-9ff07f8c80c8 tempest-VolumesSnapshotTestJSON-1697003112 tempest-VolumesSnapshotTestJSON-1697003112-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:55:06.834711 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-61973658-51f3-4f81-878a-9ff07f8c80c8 tempest-VolumesSnapshotTestJSON-1697003112 tempest-VolumesSnapshotTestJSON-1697003112-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:55:06.835497 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-61973658-51f3-4f81-878a-9ff07f8c80c8 tempest-VolumesSnapshotTestJSON-1697003112 tempest-VolumesSnapshotTestJSON-1697003112-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:55:06.835934 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-61973658-51f3-4f81-878a-9ff07f8c80c8 tempest-VolumesSnapshotTestJSON-1697003112 tempest-VolumesSnapshotTestJSON-1697003112-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:55:06.913028 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-61973658-51f3-4f81-878a-9ff07f8c80c8 tempest-VolumesSnapshotTestJSON-1697003112 tempest-VolumesSnapshotTestJSON-1697003112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a210cf812fb54682ac28a13a5dce0563', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c0d26c7abcc4bc7b175ac175bb5f2ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:55:06.922778 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-336d456d-e481-4658-aad8-bcbc21fa7ace tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] Calling method '>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:55:06.923214 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-61973658-51f3-4f81-878a-9ff07f8c80c8 tempest-VolumesSnapshotTestJSON-1697003112 tempest-VolumesSnapshotTestJSON-1697003112-project] 10.222.0.31 "GET /compute/v2.1/servers/4a2c7e29-e0ec-456b-bd06-ff7127f84e54" status: 200 len: 1215 microversion: 2.1 time: 0.108346 Apr 29 08:55:06.924123 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 199/388] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 08:55:06 2022] GET /compute/v2.1/servers/4a2c7e29-e0ec-456b-bd06-ff7127f84e54 => generated 1215 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 29 08:55:06.934062 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-336d456d-e481-4658-aad8-bcbc21fa7ace tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] [instance: d83c29d2-6435-4edc-827b-2c37a66fb199] Fetching instance by UUID {{(pid=123459) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:55:06.940882 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-336d456d-e481-4658-aad8-bcbc21fa7ace tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:55:06.941915 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-336d456d-e481-4658-aad8-bcbc21fa7ace tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:55:06.942781 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-336d456d-e481-4658-aad8-bcbc21fa7ace tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:55:06.943310 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-336d456d-e481-4658-aad8-bcbc21fa7ace tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:55:06.975088 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-049de74c-6009-48a6-b776-83d8836c5b9e tempest-VolumesNegativeTest-45234477 tempest-VolumesNegativeTest-45234477-project] Calling method '>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:55:06.975752 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-049de74c-6009-48a6-b776-83d8836c5b9e tempest-VolumesNegativeTest-45234477 tempest-VolumesNegativeTest-45234477-project] [instance: 1bcda922-2a2b-4382-9d9e-f083519473d8] Fetching instance by UUID {{(pid=123458) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:55:06.981955 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-049de74c-6009-48a6-b776-83d8836c5b9e tempest-VolumesNegativeTest-45234477 tempest-VolumesNegativeTest-45234477-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:55:06.982582 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-049de74c-6009-48a6-b776-83d8836c5b9e tempest-VolumesNegativeTest-45234477 tempest-VolumesNegativeTest-45234477-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:55:06.983356 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-049de74c-6009-48a6-b776-83d8836c5b9e tempest-VolumesNegativeTest-45234477 tempest-VolumesNegativeTest-45234477-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:55:06.983792 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-049de74c-6009-48a6-b776-83d8836c5b9e tempest-VolumesNegativeTest-45234477 tempest-VolumesNegativeTest-45234477-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:55:07.103708 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-336d456d-e481-4658-aad8-bcbc21fa7ace tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcf1c67873b7443084ea183c77698062', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0436edb5348a4ad5a0b6b5979a7c54fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:55:07.111869 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-336d456d-e481-4658-aad8-bcbc21fa7ace tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] 10.222.0.31 "GET /compute/v2.1/servers/d83c29d2-6435-4edc-827b-2c37a66fb199" status: 200 len: 1261 microversion: 2.1 time: 0.192870 Apr 29 08:55:07.113169 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 190/389] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 08:55:06 2022] GET /compute/v2.1/servers/d83c29d2-6435-4edc-827b-2c37a66fb199 => generated 1261 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 29 08:55:07.133411 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [req-030da378-21aa-4a91-88c0-b00b19e45969 req-4686f46b-de06-4656-a5c1-3e0d811ed083 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1bcda922-2a2b-4382-9d9e-f083519473d8", "tag": "d36cb7cb-6510-45a5-844a-79c10ae9bc6d"}]} {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 29 08:55:07.142077 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [req-030da378-21aa-4a91-88c0-b00b19e45969 req-4686f46b-de06-4656-a5c1-3e0d811ed083 service nova] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:55:07.143089 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [req-030da378-21aa-4a91-88c0-b00b19e45969 req-4686f46b-de06-4656-a5c1-3e0d811ed083 service nova] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:55:07.155707 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.compute.server_external_events [req-030da378-21aa-4a91-88c0-b00b19e45969 req-4686f46b-de06-4656-a5c1-3e0d811ed083 service nova] Creating event network-changed:d36cb7cb-6510-45a5-844a-79c10ae9bc6d for instance 1bcda922-2a2b-4382-9d9e-f083519473d8 on hv-cinder-83987 Apr 29 08:55:07.161844 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [req-030da378-21aa-4a91-88c0-b00b19e45969 req-4686f46b-de06-4656-a5c1-3e0d811ed083 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032730 Apr 29 08:55:07.162995 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 191/390] 10.222.0.31 () {64 vars in 1317 bytes} [Fri Apr 29 08:55:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 29 08:55:07.205177 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-049de74c-6009-48a6-b776-83d8836c5b9e tempest-VolumesNegativeTest-45234477 tempest-VolumesNegativeTest-45234477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '340cefa576c947d08978a99d288304c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c9877c06a2445a3a34c5d35bafeb7a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:55:07.213416 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-049de74c-6009-48a6-b776-83d8836c5b9e tempest-VolumesNegativeTest-45234477 tempest-VolumesNegativeTest-45234477-project] 10.222.0.31 "GET /compute/v2.1/servers/1bcda922-2a2b-4382-9d9e-f083519473d8" status: 200 len: 1315 microversion: 2.1 time: 0.243285 Apr 29 08:55:07.214006 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 200/391] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 08:55:06 2022] GET /compute/v2.1/servers/1bcda922-2a2b-4382-9d9e-f083519473d8 => generated 1315 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 08:55:07.623382 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-f13d1448-2a45-418c-8bb6-4a76a60ee4b9 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Calling method '>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:55:07.624007 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-f13d1448-2a45-418c-8bb6-4a76a60ee4b9 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] [instance: 406b5ad6-698e-457f-93f4-cdfd45fb3e8e] Fetching instance by UUID {{(pid=123459) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:55:07.630828 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-f13d1448-2a45-418c-8bb6-4a76a60ee4b9 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:55:07.631279 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-f13d1448-2a45-418c-8bb6-4a76a60ee4b9 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:55:07.632055 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-f13d1448-2a45-418c-8bb6-4a76a60ee4b9 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:55:07.632521 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-f13d1448-2a45-418c-8bb6-4a76a60ee4b9 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:55:07.766507 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-f13d1448-2a45-418c-8bb6-4a76a60ee4b9 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:55:07.775020 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-f13d1448-2a45-418c-8bb6-4a76a60ee4b9 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:55:07.776561 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-f13d1448-2a45-418c-8bb6-4a76a60ee4b9 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:55:07.777726 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-f13d1448-2a45-418c-8bb6-4a76a60ee4b9 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] 10.222.0.31 "GET /compute/v2.1/servers/406b5ad6-698e-457f-93f4-cdfd45fb3e8e" status: 200 len: 1726 microversion: 2.20 time: 0.158763 Apr 29 08:55:07.778277 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 192/392] 10.222.0.31 () {60 vars in 1276 bytes} [Fri Apr 29 08:55:07 2022] GET /compute/v2.1/servers/406b5ad6-698e-457f-93f4-cdfd45fb3e8e => generated 1726 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 29 08:55:07.839649 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-cb0cf01f-710a-4d71-aa35-c0040a67fe9e tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Calling method '>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:55:07.840281 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-cb0cf01f-710a-4d71-aa35-c0040a67fe9e tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] [instance: 4e972e2b-7b5e-4a5f-87a1-3642aad3ac24] Fetching instance by UUID {{(pid=123458) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:55:07.846242 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-cb0cf01f-710a-4d71-aa35-c0040a67fe9e tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:55:07.846697 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-cb0cf01f-710a-4d71-aa35-c0040a67fe9e tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:55:07.847465 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-cb0cf01f-710a-4d71-aa35-c0040a67fe9e tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:55:07.848781 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-cb0cf01f-710a-4d71-aa35-c0040a67fe9e tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:55:07.941327 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-4afbf655-75ee-4935-aac3-1023458f7dfa tempest-VolumesSnapshotTestJSON-1697003112 tempest-VolumesSnapshotTestJSON-1697003112-project] Calling method '>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:55:07.942630 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-4afbf655-75ee-4935-aac3-1023458f7dfa tempest-VolumesSnapshotTestJSON-1697003112 tempest-VolumesSnapshotTestJSON-1697003112-project] [instance: 4a2c7e29-e0ec-456b-bd06-ff7127f84e54] Fetching instance by UUID {{(pid=123459) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:55:07.949127 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-4afbf655-75ee-4935-aac3-1023458f7dfa tempest-VolumesSnapshotTestJSON-1697003112 tempest-VolumesSnapshotTestJSON-1697003112-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:55:07.949512 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-4afbf655-75ee-4935-aac3-1023458f7dfa tempest-VolumesSnapshotTestJSON-1697003112 tempest-VolumesSnapshotTestJSON-1697003112-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:55:07.950402 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-4afbf655-75ee-4935-aac3-1023458f7dfa tempest-VolumesSnapshotTestJSON-1697003112 tempest-VolumesSnapshotTestJSON-1697003112-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:55:07.950864 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-4afbf655-75ee-4935-aac3-1023458f7dfa tempest-VolumesSnapshotTestJSON-1697003112 tempest-VolumesSnapshotTestJSON-1697003112-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:55:07.987660 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-cb0cf01f-710a-4d71-aa35-c0040a67fe9e tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c18e88436f14dc7a2001220b87ce9ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60998f08c40446e787ead285e40665b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:55:07.996665 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-cb0cf01f-710a-4d71-aa35-c0040a67fe9e tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] 10.222.0.31 "GET /compute/v2.1/servers/4e972e2b-7b5e-4a5f-87a1-3642aad3ac24" status: 200 len: 1522 microversion: 2.1 time: 0.160476 Apr 29 08:55:07.997257 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 201/393] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 08:55:07 2022] GET /compute/v2.1/servers/4e972e2b-7b5e-4a5f-87a1-3642aad3ac24 => generated 1522 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 08:55:08.030018 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-4afbf655-75ee-4935-aac3-1023458f7dfa tempest-VolumesSnapshotTestJSON-1697003112 tempest-VolumesSnapshotTestJSON-1697003112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a210cf812fb54682ac28a13a5dce0563', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c0d26c7abcc4bc7b175ac175bb5f2ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:55:08.038765 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-4afbf655-75ee-4935-aac3-1023458f7dfa tempest-VolumesSnapshotTestJSON-1697003112 tempest-VolumesSnapshotTestJSON-1697003112-project] 10.222.0.31 "GET /compute/v2.1/servers/4a2c7e29-e0ec-456b-bd06-ff7127f84e54" status: 200 len: 1215 microversion: 2.1 time: 0.101310 Apr 29 08:55:08.039348 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 193/394] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 08:55:07 2022] GET /compute/v2.1/servers/4a2c7e29-e0ec-456b-bd06-ff7127f84e54 => generated 1215 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 08:55:08.131436 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-ba5972ea-0bae-4761-9b64-b5f0063f8a69 tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] Calling method '>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:55:08.132084 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-ba5972ea-0bae-4761-9b64-b5f0063f8a69 tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] [instance: d83c29d2-6435-4edc-827b-2c37a66fb199] Fetching instance by UUID {{(pid=123458) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:55:08.138125 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-ba5972ea-0bae-4761-9b64-b5f0063f8a69 tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:55:08.138565 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-ba5972ea-0bae-4761-9b64-b5f0063f8a69 tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:55:08.139342 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-ba5972ea-0bae-4761-9b64-b5f0063f8a69 tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:55:08.139786 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-ba5972ea-0bae-4761-9b64-b5f0063f8a69 tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:55:08.231730 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-720df518-da47-46d7-bff0-a0d944fa6ab7 tempest-VolumesNegativeTest-45234477 tempest-VolumesNegativeTest-45234477-project] Calling method '>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:55:08.232379 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-720df518-da47-46d7-bff0-a0d944fa6ab7 tempest-VolumesNegativeTest-45234477 tempest-VolumesNegativeTest-45234477-project] [instance: 1bcda922-2a2b-4382-9d9e-f083519473d8] Fetching instance by UUID {{(pid=123459) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:55:08.240084 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-720df518-da47-46d7-bff0-a0d944fa6ab7 tempest-VolumesNegativeTest-45234477 tempest-VolumesNegativeTest-45234477-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:55:08.240568 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-720df518-da47-46d7-bff0-a0d944fa6ab7 tempest-VolumesNegativeTest-45234477 tempest-VolumesNegativeTest-45234477-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:55:08.241358 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-720df518-da47-46d7-bff0-a0d944fa6ab7 tempest-VolumesNegativeTest-45234477 tempest-VolumesNegativeTest-45234477-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:55:08.241787 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-720df518-da47-46d7-bff0-a0d944fa6ab7 tempest-VolumesNegativeTest-45234477 tempest-VolumesNegativeTest-45234477-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:55:08.274073 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-ba5972ea-0bae-4761-9b64-b5f0063f8a69 tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcf1c67873b7443084ea183c77698062', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0436edb5348a4ad5a0b6b5979a7c54fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:55:08.281867 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-ba5972ea-0bae-4761-9b64-b5f0063f8a69 tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] 10.222.0.31 "GET /compute/v2.1/servers/d83c29d2-6435-4edc-827b-2c37a66fb199" status: 200 len: 1261 microversion: 2.1 time: 0.155594 Apr 29 08:55:08.282504 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 202/395] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 08:55:08 2022] GET /compute/v2.1/servers/d83c29d2-6435-4edc-827b-2c37a66fb199 => generated 1261 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 08:55:08.367050 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-720df518-da47-46d7-bff0-a0d944fa6ab7 tempest-VolumesNegativeTest-45234477 tempest-VolumesNegativeTest-45234477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '340cefa576c947d08978a99d288304c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c9877c06a2445a3a34c5d35bafeb7a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:55:08.374317 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-720df518-da47-46d7-bff0-a0d944fa6ab7 tempest-VolumesNegativeTest-45234477 tempest-VolumesNegativeTest-45234477-project] 10.222.0.31 "GET /compute/v2.1/servers/1bcda922-2a2b-4382-9d9e-f083519473d8" status: 200 len: 1315 microversion: 2.1 time: 0.147194 Apr 29 08:55:08.374878 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 194/396] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 08:55:08 2022] GET /compute/v2.1/servers/1bcda922-2a2b-4382-9d9e-f083519473d8 => generated 1315 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 29 08:55:08.796140 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-d2fd12b6-f46e-4245-b950-5d697469dc76 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Calling method '>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:55:08.796786 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-d2fd12b6-f46e-4245-b950-5d697469dc76 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] [instance: 406b5ad6-698e-457f-93f4-cdfd45fb3e8e] Fetching instance by UUID {{(pid=123458) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:55:08.803146 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-d2fd12b6-f46e-4245-b950-5d697469dc76 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:55:08.803597 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-d2fd12b6-f46e-4245-b950-5d697469dc76 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:55:08.804404 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-d2fd12b6-f46e-4245-b950-5d697469dc76 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:55:08.804845 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-d2fd12b6-f46e-4245-b950-5d697469dc76 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:55:08.933269 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-d2fd12b6-f46e-4245-b950-5d697469dc76 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:55:08.941239 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-d2fd12b6-f46e-4245-b950-5d697469dc76 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:55:08.943270 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-d2fd12b6-f46e-4245-b950-5d697469dc76 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:55:08.944435 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-d2fd12b6-f46e-4245-b950-5d697469dc76 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] 10.222.0.31 "GET /compute/v2.1/servers/406b5ad6-698e-457f-93f4-cdfd45fb3e8e" status: 200 len: 1726 microversion: 2.20 time: 0.152294 Apr 29 08:55:08.945000 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 203/397] 10.222.0.31 () {60 vars in 1276 bytes} [Fri Apr 29 08:55:08 2022] GET /compute/v2.1/servers/406b5ad6-698e-457f-93f4-cdfd45fb3e8e => generated 1726 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 29 08:55:09.012997 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-c7b899c3-8875-4915-85f0-7c02618b62fc tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Calling method '>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:55:09.013603 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-c7b899c3-8875-4915-85f0-7c02618b62fc tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] [instance: 4e972e2b-7b5e-4a5f-87a1-3642aad3ac24] Fetching instance by UUID {{(pid=123459) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:55:09.020616 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-c7b899c3-8875-4915-85f0-7c02618b62fc tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:55:09.021171 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-c7b899c3-8875-4915-85f0-7c02618b62fc tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:55:09.021945 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-c7b899c3-8875-4915-85f0-7c02618b62fc tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:55:09.022384 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-c7b899c3-8875-4915-85f0-7c02618b62fc tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:55:09.055806 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-e35cea77-1c0c-4a45-b73c-bf72a1898ed1 tempest-VolumesSnapshotTestJSON-1697003112 tempest-VolumesSnapshotTestJSON-1697003112-project] Calling method '>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:55:09.056420 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-e35cea77-1c0c-4a45-b73c-bf72a1898ed1 tempest-VolumesSnapshotTestJSON-1697003112 tempest-VolumesSnapshotTestJSON-1697003112-project] [instance: 4a2c7e29-e0ec-456b-bd06-ff7127f84e54] Fetching instance by UUID {{(pid=123458) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:55:09.062309 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-e35cea77-1c0c-4a45-b73c-bf72a1898ed1 tempest-VolumesSnapshotTestJSON-1697003112 tempest-VolumesSnapshotTestJSON-1697003112-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:55:09.062750 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-e35cea77-1c0c-4a45-b73c-bf72a1898ed1 tempest-VolumesSnapshotTestJSON-1697003112 tempest-VolumesSnapshotTestJSON-1697003112-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:55:09.063514 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-e35cea77-1c0c-4a45-b73c-bf72a1898ed1 tempest-VolumesSnapshotTestJSON-1697003112 tempest-VolumesSnapshotTestJSON-1697003112-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:55:09.063947 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-e35cea77-1c0c-4a45-b73c-bf72a1898ed1 tempest-VolumesSnapshotTestJSON-1697003112 tempest-VolumesSnapshotTestJSON-1697003112-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:55:09.140586 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-e35cea77-1c0c-4a45-b73c-bf72a1898ed1 tempest-VolumesSnapshotTestJSON-1697003112 tempest-VolumesSnapshotTestJSON-1697003112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a210cf812fb54682ac28a13a5dce0563', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c0d26c7abcc4bc7b175ac175bb5f2ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:55:09.151324 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-e35cea77-1c0c-4a45-b73c-bf72a1898ed1 tempest-VolumesSnapshotTestJSON-1697003112 tempest-VolumesSnapshotTestJSON-1697003112-project] 10.222.0.31 "GET /compute/v2.1/servers/4a2c7e29-e0ec-456b-bd06-ff7127f84e54" status: 200 len: 1271 microversion: 2.1 time: 0.099326 Apr 29 08:55:09.161996 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 204/398] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 08:55:09 2022] GET /compute/v2.1/servers/4a2c7e29-e0ec-456b-bd06-ff7127f84e54 => generated 1271 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 29 08:55:09.173623 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-c7b899c3-8875-4915-85f0-7c02618b62fc tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c18e88436f14dc7a2001220b87ce9ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60998f08c40446e787ead285e40665b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:55:09.182223 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-c7b899c3-8875-4915-85f0-7c02618b62fc tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] 10.222.0.31 "GET /compute/v2.1/servers/4e972e2b-7b5e-4a5f-87a1-3642aad3ac24" status: 200 len: 1522 microversion: 2.1 time: 0.172550 Apr 29 08:55:09.183473 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 195/399] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 08:55:09 2022] GET /compute/v2.1/servers/4e972e2b-7b5e-4a5f-87a1-3642aad3ac24 => generated 1522 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 08:55:09.303213 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-268d0932-9d16-4b5d-ade4-136e6e636306 tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] Calling method '>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:55:09.303835 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-268d0932-9d16-4b5d-ade4-136e6e636306 tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] [instance: d83c29d2-6435-4edc-827b-2c37a66fb199] Fetching instance by UUID {{(pid=123458) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:55:09.310129 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-268d0932-9d16-4b5d-ade4-136e6e636306 tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:55:09.310513 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-268d0932-9d16-4b5d-ade4-136e6e636306 tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:55:09.311293 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-268d0932-9d16-4b5d-ade4-136e6e636306 tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:55:09.311728 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-268d0932-9d16-4b5d-ade4-136e6e636306 tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:55:09.350608 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-26489e92-69ce-4ffc-9b91-e6781967675e tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Action: 'create', calling method: .version_select at 0x7f62384c44c0>, body: {"keypair": {"name": "tempest-keypair-1502805126"}} {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 29 08:55:09.365558 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.quota [None req-26489e92-69ce-4ffc-9b91-e6781967675e tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Getting quotas for project 578e6a35974d4e5c8a0cd4e5fa994259. Resources: {'key_pairs'} {{(pid=123459) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 29 08:55:09.369603 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.quota [None req-26489e92-69ce-4ffc-9b91-e6781967675e tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Getting quotas for user 8e47ecdfb01f447699275b13255c15d4 and project 578e6a35974d4e5c8a0cd4e5fa994259. Resources: {'key_pairs'} {{(pid=123459) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 29 08:55:09.448500 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-268d0932-9d16-4b5d-ade4-136e6e636306 tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcf1c67873b7443084ea183c77698062', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0436edb5348a4ad5a0b6b5979a7c54fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:55:09.455800 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-268d0932-9d16-4b5d-ade4-136e6e636306 tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] 10.222.0.31 "GET /compute/v2.1/servers/d83c29d2-6435-4edc-827b-2c37a66fb199" status: 200 len: 1261 microversion: 2.1 time: 0.157295 Apr 29 08:55:09.456386 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 205/400] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 08:55:09 2022] GET /compute/v2.1/servers/d83c29d2-6435-4edc-827b-2c37a66fb199 => generated 1261 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 08:55:09.460909 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-ed65308d-7a9f-4650-9151-ca438bf37f66 tempest-VolumesNegativeTest-45234477 tempest-VolumesNegativeTest-45234477-project] Calling method '>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:55:09.461505 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-ed65308d-7a9f-4650-9151-ca438bf37f66 tempest-VolumesNegativeTest-45234477 tempest-VolumesNegativeTest-45234477-project] [instance: 1bcda922-2a2b-4382-9d9e-f083519473d8] Fetching instance by UUID {{(pid=123458) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:55:09.467420 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-ed65308d-7a9f-4650-9151-ca438bf37f66 tempest-VolumesNegativeTest-45234477 tempest-VolumesNegativeTest-45234477-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:55:09.467866 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-ed65308d-7a9f-4650-9151-ca438bf37f66 tempest-VolumesNegativeTest-45234477 tempest-VolumesNegativeTest-45234477-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:55:09.468662 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-ed65308d-7a9f-4650-9151-ca438bf37f66 tempest-VolumesNegativeTest-45234477 tempest-VolumesNegativeTest-45234477-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:55:09.469096 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-ed65308d-7a9f-4650-9151-ca438bf37f66 tempest-VolumesNegativeTest-45234477 tempest-VolumesNegativeTest-45234477-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:55:09.601547 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-ed65308d-7a9f-4650-9151-ca438bf37f66 tempest-VolumesNegativeTest-45234477 tempest-VolumesNegativeTest-45234477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '340cefa576c947d08978a99d288304c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c9877c06a2445a3a34c5d35bafeb7a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:55:09.606549 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.quota [None req-26489e92-69ce-4ffc-9b91-e6781967675e tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Getting quotas for project 578e6a35974d4e5c8a0cd4e5fa994259. Resources: {'key_pairs'} {{(pid=123459) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 29 08:55:09.609159 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-ed65308d-7a9f-4650-9151-ca438bf37f66 tempest-VolumesNegativeTest-45234477 tempest-VolumesNegativeTest-45234477-project] 10.222.0.31 "GET /compute/v2.1/servers/1bcda922-2a2b-4382-9d9e-f083519473d8" status: 200 len: 1315 microversion: 2.1 time: 0.151825 Apr 29 08:55:09.609727 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 206/401] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 08:55:09 2022] GET /compute/v2.1/servers/1bcda922-2a2b-4382-9d9e-f083519473d8 => generated 1315 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 08:55:09.612225 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.quota [None req-26489e92-69ce-4ffc-9b91-e6781967675e tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Getting quotas for user 8e47ecdfb01f447699275b13255c15d4 and project 578e6a35974d4e5c8a0cd4e5fa994259. Resources: {'key_pairs'} {{(pid=123459) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 29 08:55:09.630283 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-26489e92-69ce-4ffc-9b91-e6781967675e tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] 10.222.0.31 "POST /compute/v2.1/os-keypairs" status: 200 len: 2301 microversion: 2.1 time: 0.283795 Apr 29 08:55:09.631217 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 196/402] 10.222.0.31 () {60 vars in 1157 bytes} [Fri Apr 29 08:55:09 2022] POST /compute/v2.1/os-keypairs => generated 2301 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 29 08:55:09.962492 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-3711f300-0ee1-44b7-90fe-f02953a1a94d tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Calling method '>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:55:09.963298 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-3711f300-0ee1-44b7-90fe-f02953a1a94d tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] [instance: 406b5ad6-698e-457f-93f4-cdfd45fb3e8e] Fetching instance by UUID {{(pid=123458) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:55:09.969292 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-3711f300-0ee1-44b7-90fe-f02953a1a94d tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:55:09.969733 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-3711f300-0ee1-44b7-90fe-f02953a1a94d tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:55:09.970501 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-3711f300-0ee1-44b7-90fe-f02953a1a94d tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:55:09.970928 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-3711f300-0ee1-44b7-90fe-f02953a1a94d tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:55:10.109404 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-3711f300-0ee1-44b7-90fe-f02953a1a94d tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:55:10.117714 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-3711f300-0ee1-44b7-90fe-f02953a1a94d tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:55:10.119230 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-3711f300-0ee1-44b7-90fe-f02953a1a94d tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:55:10.120416 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-3711f300-0ee1-44b7-90fe-f02953a1a94d tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] 10.222.0.31 "GET /compute/v2.1/servers/406b5ad6-698e-457f-93f4-cdfd45fb3e8e" status: 200 len: 1726 microversion: 2.20 time: 0.162447 Apr 29 08:55:10.121597 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 207/403] 10.222.0.31 () {60 vars in 1276 bytes} [Fri Apr 29 08:55:09 2022] GET /compute/v2.1/servers/406b5ad6-698e-457f-93f4-cdfd45fb3e8e => generated 1726 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 29 08:55:10.168981 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-cdffdf92-0cb2-4567-a455-07a48fb9700f tempest-VolumesSnapshotTestJSON-1697003112 tempest-VolumesSnapshotTestJSON-1697003112-project] Calling method '>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:55:10.169596 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-cdffdf92-0cb2-4567-a455-07a48fb9700f tempest-VolumesSnapshotTestJSON-1697003112 tempest-VolumesSnapshotTestJSON-1697003112-project] [instance: 4a2c7e29-e0ec-456b-bd06-ff7127f84e54] Fetching instance by UUID {{(pid=123459) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:55:10.176902 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-cdffdf92-0cb2-4567-a455-07a48fb9700f tempest-VolumesSnapshotTestJSON-1697003112 tempest-VolumesSnapshotTestJSON-1697003112-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:55:10.177357 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-cdffdf92-0cb2-4567-a455-07a48fb9700f tempest-VolumesSnapshotTestJSON-1697003112 tempest-VolumesSnapshotTestJSON-1697003112-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:55:10.178243 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-cdffdf92-0cb2-4567-a455-07a48fb9700f tempest-VolumesSnapshotTestJSON-1697003112 tempest-VolumesSnapshotTestJSON-1697003112-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:55:10.178722 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-cdffdf92-0cb2-4567-a455-07a48fb9700f tempest-VolumesSnapshotTestJSON-1697003112 tempest-VolumesSnapshotTestJSON-1697003112-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:55:10.200663 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-61cac39d-4ae3-4595-91f1-7cf032df3955 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Calling method '>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:55:10.201480 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-61cac39d-4ae3-4595-91f1-7cf032df3955 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] [instance: 4e972e2b-7b5e-4a5f-87a1-3642aad3ac24] Fetching instance by UUID {{(pid=123458) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:55:10.208820 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-61cac39d-4ae3-4595-91f1-7cf032df3955 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:55:10.209437 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-61cac39d-4ae3-4595-91f1-7cf032df3955 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:55:10.210414 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-61cac39d-4ae3-4595-91f1-7cf032df3955 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:55:10.210962 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-61cac39d-4ae3-4595-91f1-7cf032df3955 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:55:10.358035 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-61cac39d-4ae3-4595-91f1-7cf032df3955 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c18e88436f14dc7a2001220b87ce9ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60998f08c40446e787ead285e40665b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:55:10.370805 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-61cac39d-4ae3-4595-91f1-7cf032df3955 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] 10.222.0.31 "GET /compute/v2.1/servers/4e972e2b-7b5e-4a5f-87a1-3642aad3ac24" status: 200 len: 1522 microversion: 2.1 time: 0.174073 Apr 29 08:55:10.371640 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 208/404] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 08:55:10 2022] GET /compute/v2.1/servers/4e972e2b-7b5e-4a5f-87a1-3642aad3ac24 => generated 1522 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 08:55:10.409634 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-cdffdf92-0cb2-4567-a455-07a48fb9700f tempest-VolumesSnapshotTestJSON-1697003112 tempest-VolumesSnapshotTestJSON-1697003112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a210cf812fb54682ac28a13a5dce0563', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c0d26c7abcc4bc7b175ac175bb5f2ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:55:10.418184 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-cdffdf92-0cb2-4567-a455-07a48fb9700f tempest-VolumesSnapshotTestJSON-1697003112 tempest-VolumesSnapshotTestJSON-1697003112-project] 10.222.0.31 "GET /compute/v2.1/servers/4a2c7e29-e0ec-456b-bd06-ff7127f84e54" status: 200 len: 1271 microversion: 2.1 time: 0.253536 Apr 29 08:55:10.419033 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 197/405] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 08:55:10 2022] GET /compute/v2.1/servers/4a2c7e29-e0ec-456b-bd06-ff7127f84e54 => generated 1271 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 08:55:10.474501 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-22c5ef83-74be-4e24-bb99-5d87e466f6d4 tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] Calling method '>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:55:10.475485 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-22c5ef83-74be-4e24-bb99-5d87e466f6d4 tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] [instance: d83c29d2-6435-4edc-827b-2c37a66fb199] Fetching instance by UUID {{(pid=123458) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:55:10.482444 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-22c5ef83-74be-4e24-bb99-5d87e466f6d4 tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:55:10.482995 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-22c5ef83-74be-4e24-bb99-5d87e466f6d4 tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:55:10.483861 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-22c5ef83-74be-4e24-bb99-5d87e466f6d4 tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:55:10.484595 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-22c5ef83-74be-4e24-bb99-5d87e466f6d4 tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:55:10.623246 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-22c5ef83-74be-4e24-bb99-5d87e466f6d4 tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcf1c67873b7443084ea183c77698062', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0436edb5348a4ad5a0b6b5979a7c54fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:55:10.627352 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-6b98e81d-a2c6-4ce8-8d69-03e48a8cfcea tempest-VolumesNegativeTest-45234477 tempest-VolumesNegativeTest-45234477-project] Calling method '>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:55:10.627957 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-6b98e81d-a2c6-4ce8-8d69-03e48a8cfcea tempest-VolumesNegativeTest-45234477 tempest-VolumesNegativeTest-45234477-project] [instance: 1bcda922-2a2b-4382-9d9e-f083519473d8] Fetching instance by UUID {{(pid=123459) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:55:10.631990 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-22c5ef83-74be-4e24-bb99-5d87e466f6d4 tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] 10.222.0.31 "GET /compute/v2.1/servers/d83c29d2-6435-4edc-827b-2c37a66fb199" status: 200 len: 1446 microversion: 2.1 time: 0.163058 Apr 29 08:55:10.632624 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 209/406] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 08:55:10 2022] GET /compute/v2.1/servers/d83c29d2-6435-4edc-827b-2c37a66fb199 => generated 1446 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 08:55:10.643784 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-6b98e81d-a2c6-4ce8-8d69-03e48a8cfcea tempest-VolumesNegativeTest-45234477 tempest-VolumesNegativeTest-45234477-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:55:10.643784 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-6b98e81d-a2c6-4ce8-8d69-03e48a8cfcea tempest-VolumesNegativeTest-45234477 tempest-VolumesNegativeTest-45234477-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:55:10.643784 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-6b98e81d-a2c6-4ce8-8d69-03e48a8cfcea tempest-VolumesNegativeTest-45234477 tempest-VolumesNegativeTest-45234477-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:55:10.643784 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-6b98e81d-a2c6-4ce8-8d69-03e48a8cfcea tempest-VolumesNegativeTest-45234477 tempest-VolumesNegativeTest-45234477-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:55:10.649451 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-393b7055-1cd2-4a5c-900c-2bc98e58a4f6 tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] Calling method '>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:55:10.650070 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-393b7055-1cd2-4a5c-900c-2bc98e58a4f6 tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] [instance: d83c29d2-6435-4edc-827b-2c37a66fb199] Fetching instance by UUID {{(pid=123458) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:55:10.657607 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-393b7055-1cd2-4a5c-900c-2bc98e58a4f6 tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:55:10.658056 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-393b7055-1cd2-4a5c-900c-2bc98e58a4f6 tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:55:10.658897 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-393b7055-1cd2-4a5c-900c-2bc98e58a4f6 tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:55:10.659339 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-393b7055-1cd2-4a5c-900c-2bc98e58a4f6 tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:55:10.799012 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-393b7055-1cd2-4a5c-900c-2bc98e58a4f6 tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcf1c67873b7443084ea183c77698062', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0436edb5348a4ad5a0b6b5979a7c54fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:55:10.807935 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-393b7055-1cd2-4a5c-900c-2bc98e58a4f6 tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] 10.222.0.31 "GET /compute/v2.1/servers/d83c29d2-6435-4edc-827b-2c37a66fb199" status: 200 len: 1446 microversion: 2.1 time: 0.162735 Apr 29 08:55:10.808646 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 210/407] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 08:55:10 2022] GET /compute/v2.1/servers/d83c29d2-6435-4edc-827b-2c37a66fb199 => generated 1446 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 29 08:55:10.821304 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-6b98e81d-a2c6-4ce8-8d69-03e48a8cfcea tempest-VolumesNegativeTest-45234477 tempest-VolumesNegativeTest-45234477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '340cefa576c947d08978a99d288304c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c9877c06a2445a3a34c5d35bafeb7a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:55:10.833395 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-6b98e81d-a2c6-4ce8-8d69-03e48a8cfcea tempest-VolumesNegativeTest-45234477 tempest-VolumesNegativeTest-45234477-project] 10.222.0.31 "GET /compute/v2.1/servers/1bcda922-2a2b-4382-9d9e-f083519473d8" status: 200 len: 1315 microversion: 2.1 time: 0.209677 Apr 29 08:55:10.834481 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 198/408] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 08:55:10 2022] GET /compute/v2.1/servers/1bcda922-2a2b-4382-9d9e-f083519473d8 => generated 1315 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 29 08:55:11.141593 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-17ef098f-409e-4f43-9379-d8c428095eeb tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Calling method '>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:55:11.143139 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-17ef098f-409e-4f43-9379-d8c428095eeb tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] [instance: 406b5ad6-698e-457f-93f4-cdfd45fb3e8e] Fetching instance by UUID {{(pid=123458) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:55:11.151107 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-17ef098f-409e-4f43-9379-d8c428095eeb tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:55:11.151757 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-17ef098f-409e-4f43-9379-d8c428095eeb tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:55:11.152742 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-17ef098f-409e-4f43-9379-d8c428095eeb tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:55:11.153357 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-17ef098f-409e-4f43-9379-d8c428095eeb tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:55:11.369033 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-17ef098f-409e-4f43-9379-d8c428095eeb tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:55:11.381363 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-17ef098f-409e-4f43-9379-d8c428095eeb tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:55:11.382920 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-17ef098f-409e-4f43-9379-d8c428095eeb tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:55:11.384667 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-17ef098f-409e-4f43-9379-d8c428095eeb tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] 10.222.0.31 "GET /compute/v2.1/servers/406b5ad6-698e-457f-93f4-cdfd45fb3e8e" status: 200 len: 1726 microversion: 2.20 time: 0.248652 Apr 29 08:55:11.385486 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 211/409] 10.222.0.31 () {60 vars in 1276 bytes} [Fri Apr 29 08:55:11 2022] GET /compute/v2.1/servers/406b5ad6-698e-457f-93f4-cdfd45fb3e8e => generated 1726 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 29 08:55:11.393427 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-3e2b29c5-e4bf-4039-9d2b-3688eda86108 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Calling method '>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:55:11.395291 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-3e2b29c5-e4bf-4039-9d2b-3688eda86108 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] [instance: 4e972e2b-7b5e-4a5f-87a1-3642aad3ac24] Fetching instance by UUID {{(pid=123459) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:55:11.402967 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-3e2b29c5-e4bf-4039-9d2b-3688eda86108 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:55:11.404094 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-3e2b29c5-e4bf-4039-9d2b-3688eda86108 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:55:11.404908 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-3e2b29c5-e4bf-4039-9d2b-3688eda86108 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:55:11.405522 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-3e2b29c5-e4bf-4039-9d2b-3688eda86108 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:55:11.428533 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-927e5e2a-a129-4fb7-955d-2a26af1c6c35 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1374287405", "imageRef": "e0678f88-0b68-4453-b569-29fd065e544e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "b24838f8-74fc-43df-860b-f0934d3ce2df"}], "security_groups": [{"name": "tempest-securitygroup--395900721"}], "key_name": "tempest-keypair-1502805126", "user_data": "}} {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 29 08:55:11.552080 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-3e2b29c5-e4bf-4039-9d2b-3688eda86108 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c18e88436f14dc7a2001220b87ce9ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60998f08c40446e787ead285e40665b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:55:11.555819 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.network.neutron [None req-927e5e2a-a129-4fb7-955d-2a26af1c6c35 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] validate_networks() for [('b24838f8-74fc-43df-860b-f0934d3ce2df', None, None, None, None, None)] {{(pid=123458) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 29 08:55:11.561099 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-3e2b29c5-e4bf-4039-9d2b-3688eda86108 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] 10.222.0.31 "GET /compute/v2.1/servers/4e972e2b-7b5e-4a5f-87a1-3642aad3ac24" status: 200 len: 1522 microversion: 2.1 time: 0.174672 Apr 29 08:55:11.571465 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 199/410] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 08:55:11 2022] GET /compute/v2.1/servers/4e972e2b-7b5e-4a5f-87a1-3642aad3ac24 => generated 1522 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 29 08:55:11.571465 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-a3ca4bce-c56f-419c-8bd1-213e1b0abc86 tempest-VolumesSnapshotTestJSON-1697003112 tempest-VolumesSnapshotTestJSON-1697003112-project] Calling method '>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:55:11.571465 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-a3ca4bce-c56f-419c-8bd1-213e1b0abc86 tempest-VolumesSnapshotTestJSON-1697003112 tempest-VolumesSnapshotTestJSON-1697003112-project] [instance: 4a2c7e29-e0ec-456b-bd06-ff7127f84e54] Fetching instance by UUID {{(pid=123459) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:55:11.574054 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-a3ca4bce-c56f-419c-8bd1-213e1b0abc86 tempest-VolumesSnapshotTestJSON-1697003112 tempest-VolumesSnapshotTestJSON-1697003112-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:55:11.574729 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-a3ca4bce-c56f-419c-8bd1-213e1b0abc86 tempest-VolumesSnapshotTestJSON-1697003112 tempest-VolumesSnapshotTestJSON-1697003112-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:55:11.575503 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-a3ca4bce-c56f-419c-8bd1-213e1b0abc86 tempest-VolumesSnapshotTestJSON-1697003112 tempest-VolumesSnapshotTestJSON-1697003112-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:55:11.575936 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-a3ca4bce-c56f-419c-8bd1-213e1b0abc86 tempest-VolumesSnapshotTestJSON-1697003112 tempest-VolumesSnapshotTestJSON-1697003112-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:55:11.650035 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-a3ca4bce-c56f-419c-8bd1-213e1b0abc86 tempest-VolumesSnapshotTestJSON-1697003112 tempest-VolumesSnapshotTestJSON-1697003112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a210cf812fb54682ac28a13a5dce0563', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c0d26c7abcc4bc7b175ac175bb5f2ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:55:11.662857 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-a3ca4bce-c56f-419c-8bd1-213e1b0abc86 tempest-VolumesSnapshotTestJSON-1697003112 tempest-VolumesSnapshotTestJSON-1697003112-project] 10.222.0.31 "GET /compute/v2.1/servers/4a2c7e29-e0ec-456b-bd06-ff7127f84e54" status: 200 len: 1279 microversion: 2.1 time: 0.099460 Apr 29 08:55:11.663454 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 200/411] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 08:55:11 2022] GET /compute/v2.1/servers/4a2c7e29-e0ec-456b-bd06-ff7127f84e54 => generated 1279 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 08:55:11.851847 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-935fde08-0fcc-4447-8e30-00989bbef9f6 tempest-VolumesNegativeTest-45234477 tempest-VolumesNegativeTest-45234477-project] Calling method '>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:55:11.852826 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-935fde08-0fcc-4447-8e30-00989bbef9f6 tempest-VolumesNegativeTest-45234477 tempest-VolumesNegativeTest-45234477-project] [instance: 1bcda922-2a2b-4382-9d9e-f083519473d8] Fetching instance by UUID {{(pid=123459) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:55:11.859333 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-935fde08-0fcc-4447-8e30-00989bbef9f6 tempest-VolumesNegativeTest-45234477 tempest-VolumesNegativeTest-45234477-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:55:11.860386 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-935fde08-0fcc-4447-8e30-00989bbef9f6 tempest-VolumesNegativeTest-45234477 tempest-VolumesNegativeTest-45234477-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:55:11.860742 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-935fde08-0fcc-4447-8e30-00989bbef9f6 tempest-VolumesNegativeTest-45234477 tempest-VolumesNegativeTest-45234477-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:55:11.861195 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-935fde08-0fcc-4447-8e30-00989bbef9f6 tempest-VolumesNegativeTest-45234477 tempest-VolumesNegativeTest-45234477-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:55:12.013138 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-935fde08-0fcc-4447-8e30-00989bbef9f6 tempest-VolumesNegativeTest-45234477 tempest-VolumesNegativeTest-45234477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '340cefa576c947d08978a99d288304c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c9877c06a2445a3a34c5d35bafeb7a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:55:12.021543 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-935fde08-0fcc-4447-8e30-00989bbef9f6 tempest-VolumesNegativeTest-45234477 tempest-VolumesNegativeTest-45234477-project] 10.222.0.31 "GET /compute/v2.1/servers/1bcda922-2a2b-4382-9d9e-f083519473d8" status: 200 len: 1315 microversion: 2.1 time: 0.174547 Apr 29 08:55:12.022118 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 201/412] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 08:55:11 2022] GET /compute/v2.1/servers/1bcda922-2a2b-4382-9d9e-f083519473d8 => generated 1315 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 29 08:55:12.405008 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-ccaeab86-d35f-4f27-b563-2ca4e4574645 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Calling method '>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:55:12.405720 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-ccaeab86-d35f-4f27-b563-2ca4e4574645 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] [instance: 406b5ad6-698e-457f-93f4-cdfd45fb3e8e] Fetching instance by UUID {{(pid=123459) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:55:12.413596 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-ccaeab86-d35f-4f27-b563-2ca4e4574645 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:55:12.414314 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-ccaeab86-d35f-4f27-b563-2ca4e4574645 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:55:12.415315 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-ccaeab86-d35f-4f27-b563-2ca4e4574645 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:55:12.415919 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-ccaeab86-d35f-4f27-b563-2ca4e4574645 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:55:12.630616 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-ccaeab86-d35f-4f27-b563-2ca4e4574645 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:55:12.640586 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-ccaeab86-d35f-4f27-b563-2ca4e4574645 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:55:12.642378 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-ccaeab86-d35f-4f27-b563-2ca4e4574645 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:55:12.644025 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-ccaeab86-d35f-4f27-b563-2ca4e4574645 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] 10.222.0.31 "GET /compute/v2.1/servers/406b5ad6-698e-457f-93f4-cdfd45fb3e8e" status: 200 len: 1726 microversion: 2.20 time: 0.243072 Apr 29 08:55:12.644783 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 202/413] 10.222.0.31 () {60 vars in 1276 bytes} [Fri Apr 29 08:55:12 2022] GET /compute/v2.1/servers/406b5ad6-698e-457f-93f4-cdfd45fb3e8e => generated 1726 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 29 08:55:12.652307 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-547fb7f3-0e76-4701-93d0-a9b98b163fb5 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Calling method '>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:55:12.653184 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-547fb7f3-0e76-4701-93d0-a9b98b163fb5 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] [instance: 4e972e2b-7b5e-4a5f-87a1-3642aad3ac24] Fetching instance by UUID {{(pid=123459) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:55:12.660689 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-547fb7f3-0e76-4701-93d0-a9b98b163fb5 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:55:12.661422 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-547fb7f3-0e76-4701-93d0-a9b98b163fb5 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:55:12.662206 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-547fb7f3-0e76-4701-93d0-a9b98b163fb5 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:55:12.662640 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-547fb7f3-0e76-4701-93d0-a9b98b163fb5 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:55:12.744152 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.virt.hardware [None req-927e5e2a-a129-4fb7-955d-2a26af1c6c35 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Flavor limits 0:0:0 {{(pid=123458) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 29 08:55:12.744972 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.virt.hardware [None req-927e5e2a-a129-4fb7-955d-2a26af1c6c35 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Image limits 0:0:0 {{(pid=123458) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 29 08:55:12.745546 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.virt.hardware [None req-927e5e2a-a129-4fb7-955d-2a26af1c6c35 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Flavor pref 0:0:0 {{(pid=123458) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 29 08:55:12.746171 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.virt.hardware [None req-927e5e2a-a129-4fb7-955d-2a26af1c6c35 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Image pref 0:0:0 {{(pid=123458) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 29 08:55:12.746689 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.virt.hardware [None req-927e5e2a-a129-4fb7-955d-2a26af1c6c35 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123458) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 29 08:55:12.756263 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-927e5e2a-a129-4fb7-955d-2a26af1c6c35 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:55:12.756825 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-927e5e2a-a129-4fb7-955d-2a26af1c6c35 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:55:12.757775 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-927e5e2a-a129-4fb7-955d-2a26af1c6c35 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:55:12.758269 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-927e5e2a-a129-4fb7-955d-2a26af1c6c35 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:55:12.782128 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.quota [None req-927e5e2a-a129-4fb7-955d-2a26af1c6c35 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Getting quotas for project 578e6a35974d4e5c8a0cd4e5fa994259. Resources: {'instances', 'cores', 'ram'} {{(pid=123458) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 29 08:55:12.789074 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.quota [None req-927e5e2a-a129-4fb7-955d-2a26af1c6c35 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Getting quotas for user 8e47ecdfb01f447699275b13255c15d4 and project 578e6a35974d4e5c8a0cd4e5fa994259. Resources: {'instances', 'cores', 'ram'} {{(pid=123458) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 29 08:55:12.811694 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-927e5e2a-a129-4fb7-955d-2a26af1c6c35 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Going to run 1 instances... {{(pid=123458) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 29 08:55:12.813925 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-927e5e2a-a129-4fb7-955d-2a26af1c6c35 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] [instance: 21ab666e-c39f-4202-9e7a-aa431a96a130] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e0678f88-0b68-4453-b569-29fd065e544e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123458) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 29 08:55:12.881183 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-547fb7f3-0e76-4701-93d0-a9b98b163fb5 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c18e88436f14dc7a2001220b87ce9ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60998f08c40446e787ead285e40665b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:55:12.891385 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-927e5e2a-a129-4fb7-955d-2a26af1c6c35 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] 10.222.0.31 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.467766 Apr 29 08:55:12.891647 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-547fb7f3-0e76-4701-93d0-a9b98b163fb5 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] 10.222.0.31 "GET /compute/v2.1/servers/4e972e2b-7b5e-4a5f-87a1-3642aad3ac24" status: 200 len: 1522 microversion: 2.1 time: 0.242773 Apr 29 08:55:12.904110 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 203/414] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 08:55:12 2022] GET /compute/v2.1/servers/4e972e2b-7b5e-4a5f-87a1-3642aad3ac24 => generated 1522 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 08:55:12.904335 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 212/415] 10.222.0.31 () {60 vars in 1146 bytes} [Fri Apr 29 08:55:11 2022] POST /compute/v2.1/servers => generated 401 bytes in 1471 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 29 08:55:12.904441 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-89bb2208-2fd5-4c4f-81e1-95e716e370c0 tempest-VolumesSnapshotTestJSON-1697003112 tempest-VolumesSnapshotTestJSON-1697003112-project] Calling method '>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:55:12.904441 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-89bb2208-2fd5-4c4f-81e1-95e716e370c0 tempest-VolumesSnapshotTestJSON-1697003112 tempest-VolumesSnapshotTestJSON-1697003112-project] [instance: 4a2c7e29-e0ec-456b-bd06-ff7127f84e54] Fetching instance by UUID {{(pid=123459) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:55:12.920251 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-2e7c3f23-001e-4dc3-8e1f-ee78090a79b4 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Calling method '>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:55:12.925336 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-89bb2208-2fd5-4c4f-81e1-95e716e370c0 tempest-VolumesSnapshotTestJSON-1697003112 tempest-VolumesSnapshotTestJSON-1697003112-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:55:12.925558 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-2e7c3f23-001e-4dc3-8e1f-ee78090a79b4 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] [instance: 21ab666e-c39f-4202-9e7a-aa431a96a130] Fetching instance by UUID {{(pid=123458) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:55:12.925672 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-89bb2208-2fd5-4c4f-81e1-95e716e370c0 tempest-VolumesSnapshotTestJSON-1697003112 tempest-VolumesSnapshotTestJSON-1697003112-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:55:12.925672 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-89bb2208-2fd5-4c4f-81e1-95e716e370c0 tempest-VolumesSnapshotTestJSON-1697003112 tempest-VolumesSnapshotTestJSON-1697003112-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:55:12.925672 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-89bb2208-2fd5-4c4f-81e1-95e716e370c0 tempest-VolumesSnapshotTestJSON-1697003112 tempest-VolumesSnapshotTestJSON-1697003112-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:55:13.076067 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-2e7c3f23-001e-4dc3-8e1f-ee78090a79b4 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e47ecdfb01f447699275b13255c15d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578e6a35974d4e5c8a0cd4e5fa994259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:55:13.094386 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-2e7c3f23-001e-4dc3-8e1f-ee78090a79b4 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] 10.222.0.31 "GET /compute/v2.1/servers/21ab666e-c39f-4202-9e7a-aa431a96a130" status: 200 len: 1242 microversion: 2.1 time: 0.194159 Apr 29 08:55:13.095323 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 213/416] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 08:55:12 2022] GET /compute/v2.1/servers/21ab666e-c39f-4202-9e7a-aa431a96a130 => generated 1242 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 08:55:13.103567 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-ce6e9ae6-2b21-4a2c-a466-636aea27d0a4 tempest-VolumesNegativeTest-45234477 tempest-VolumesNegativeTest-45234477-project] Calling method '>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:55:13.104673 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-ce6e9ae6-2b21-4a2c-a466-636aea27d0a4 tempest-VolumesNegativeTest-45234477 tempest-VolumesNegativeTest-45234477-project] [instance: 1bcda922-2a2b-4382-9d9e-f083519473d8] Fetching instance by UUID {{(pid=123458) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:55:13.114809 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-ce6e9ae6-2b21-4a2c-a466-636aea27d0a4 tempest-VolumesNegativeTest-45234477 tempest-VolumesNegativeTest-45234477-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:55:13.115323 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-ce6e9ae6-2b21-4a2c-a466-636aea27d0a4 tempest-VolumesNegativeTest-45234477 tempest-VolumesNegativeTest-45234477-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:55:13.116330 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-ce6e9ae6-2b21-4a2c-a466-636aea27d0a4 tempest-VolumesNegativeTest-45234477 tempest-VolumesNegativeTest-45234477-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:55:13.116739 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-ce6e9ae6-2b21-4a2c-a466-636aea27d0a4 tempest-VolumesNegativeTest-45234477 tempest-VolumesNegativeTest-45234477-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:55:13.229312 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-89bb2208-2fd5-4c4f-81e1-95e716e370c0 tempest-VolumesSnapshotTestJSON-1697003112 tempest-VolumesSnapshotTestJSON-1697003112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a210cf812fb54682ac28a13a5dce0563', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c0d26c7abcc4bc7b175ac175bb5f2ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:55:13.239558 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-89bb2208-2fd5-4c4f-81e1-95e716e370c0 tempest-VolumesSnapshotTestJSON-1697003112 tempest-VolumesSnapshotTestJSON-1697003112-project] 10.222.0.31 "GET /compute/v2.1/servers/4a2c7e29-e0ec-456b-bd06-ff7127f84e54" status: 200 len: 1319 microversion: 2.1 time: 0.344157 Apr 29 08:55:13.240649 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 204/417] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 08:55:12 2022] GET /compute/v2.1/servers/4a2c7e29-e0ec-456b-bd06-ff7127f84e54 => generated 1319 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 08:55:13.339073 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-ce6e9ae6-2b21-4a2c-a466-636aea27d0a4 tempest-VolumesNegativeTest-45234477 tempest-VolumesNegativeTest-45234477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '340cefa576c947d08978a99d288304c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c9877c06a2445a3a34c5d35bafeb7a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:55:13.347638 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-ce6e9ae6-2b21-4a2c-a466-636aea27d0a4 tempest-VolumesNegativeTest-45234477 tempest-VolumesNegativeTest-45234477-project] 10.222.0.31 "GET /compute/v2.1/servers/1bcda922-2a2b-4382-9d9e-f083519473d8" status: 200 len: 1315 microversion: 2.1 time: 0.251137 Apr 29 08:55:13.348883 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 214/418] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 08:55:13 2022] GET /compute/v2.1/servers/1bcda922-2a2b-4382-9d9e-f083519473d8 => generated 1315 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 08:55:13.663644 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-83dfdf5b-58f5-4d01-a670-378767429f86 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Calling method '>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:55:13.664427 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-83dfdf5b-58f5-4d01-a670-378767429f86 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] [instance: 406b5ad6-698e-457f-93f4-cdfd45fb3e8e] Fetching instance by UUID {{(pid=123459) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:55:13.671113 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-83dfdf5b-58f5-4d01-a670-378767429f86 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:55:13.671657 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-83dfdf5b-58f5-4d01-a670-378767429f86 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:55:13.672592 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-83dfdf5b-58f5-4d01-a670-378767429f86 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:55:13.673264 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-83dfdf5b-58f5-4d01-a670-378767429f86 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:55:13.911963 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-83dfdf5b-58f5-4d01-a670-378767429f86 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:55:13.917351 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-28837bb5-760d-4da3-bcbf-e32757153a6a tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Calling method '>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:55:13.919331 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-28837bb5-760d-4da3-bcbf-e32757153a6a tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] [instance: 4e972e2b-7b5e-4a5f-87a1-3642aad3ac24] Fetching instance by UUID {{(pid=123458) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:55:13.934760 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-28837bb5-760d-4da3-bcbf-e32757153a6a tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:55:13.937140 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-28837bb5-760d-4da3-bcbf-e32757153a6a tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:55:13.938532 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-28837bb5-760d-4da3-bcbf-e32757153a6a tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:55:13.939473 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-28837bb5-760d-4da3-bcbf-e32757153a6a tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:55:13.965140 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-83dfdf5b-58f5-4d01-a670-378767429f86 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:55:13.970580 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-83dfdf5b-58f5-4d01-a670-378767429f86 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:55:13.974085 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-83dfdf5b-58f5-4d01-a670-378767429f86 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] 10.222.0.31 "GET /compute/v2.1/servers/406b5ad6-698e-457f-93f4-cdfd45fb3e8e" status: 200 len: 1726 microversion: 2.20 time: 0.313462 Apr 29 08:55:13.975755 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 205/419] 10.222.0.31 () {60 vars in 1276 bytes} [Fri Apr 29 08:55:13 2022] GET /compute/v2.1/servers/406b5ad6-698e-457f-93f4-cdfd45fb3e8e => generated 1726 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 29 08:55:14.115932 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-71682619-b36e-4b06-8992-992474f3980f tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Calling method '>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:55:14.118417 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-71682619-b36e-4b06-8992-992474f3980f tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] [instance: 21ab666e-c39f-4202-9e7a-aa431a96a130] Fetching instance by UUID {{(pid=123459) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:55:14.125504 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-71682619-b36e-4b06-8992-992474f3980f tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:55:14.126160 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-71682619-b36e-4b06-8992-992474f3980f tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:55:14.128049 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-71682619-b36e-4b06-8992-992474f3980f tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:55:14.128648 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-71682619-b36e-4b06-8992-992474f3980f tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:55:14.198383 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-71682619-b36e-4b06-8992-992474f3980f tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e47ecdfb01f447699275b13255c15d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578e6a35974d4e5c8a0cd4e5fa994259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:55:14.205972 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-71682619-b36e-4b06-8992-992474f3980f tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] 10.222.0.31 "GET /compute/v2.1/servers/21ab666e-c39f-4202-9e7a-aa431a96a130" status: 200 len: 1302 microversion: 2.1 time: 0.096827 Apr 29 08:55:14.207842 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 206/420] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 08:55:14 2022] GET /compute/v2.1/servers/21ab666e-c39f-4202-9e7a-aa431a96a130 => generated 1302 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 29 08:55:14.261710 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-7299567d-6267-4dcf-a7d3-b32fd4d9c5f9 tempest-VolumesSnapshotTestJSON-1697003112 tempest-VolumesSnapshotTestJSON-1697003112-project] Calling method '>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:55:14.262766 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-7299567d-6267-4dcf-a7d3-b32fd4d9c5f9 tempest-VolumesSnapshotTestJSON-1697003112 tempest-VolumesSnapshotTestJSON-1697003112-project] [instance: 4a2c7e29-e0ec-456b-bd06-ff7127f84e54] Fetching instance by UUID {{(pid=123459) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:55:14.271458 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-7299567d-6267-4dcf-a7d3-b32fd4d9c5f9 tempest-VolumesSnapshotTestJSON-1697003112 tempest-VolumesSnapshotTestJSON-1697003112-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:55:14.272310 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-7299567d-6267-4dcf-a7d3-b32fd4d9c5f9 tempest-VolumesSnapshotTestJSON-1697003112 tempest-VolumesSnapshotTestJSON-1697003112-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:55:14.274069 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-7299567d-6267-4dcf-a7d3-b32fd4d9c5f9 tempest-VolumesSnapshotTestJSON-1697003112 tempest-VolumesSnapshotTestJSON-1697003112-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:55:14.274770 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-7299567d-6267-4dcf-a7d3-b32fd4d9c5f9 tempest-VolumesSnapshotTestJSON-1697003112 tempest-VolumesSnapshotTestJSON-1697003112-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:55:14.283323 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-28837bb5-760d-4da3-bcbf-e32757153a6a tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c18e88436f14dc7a2001220b87ce9ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60998f08c40446e787ead285e40665b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:55:14.290876 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-28837bb5-760d-4da3-bcbf-e32757153a6a tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] 10.222.0.31 "GET /compute/v2.1/servers/4e972e2b-7b5e-4a5f-87a1-3642aad3ac24" status: 200 len: 1502 microversion: 2.1 time: 0.382865 Apr 29 08:55:14.291470 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 215/421] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 08:55:13 2022] GET /compute/v2.1/servers/4e972e2b-7b5e-4a5f-87a1-3642aad3ac24 => generated 1502 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 08:55:14.310094 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-28cc5f42-2ef4-4108-a06c-72b70be7d549 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4d28986e-76df-4ca3-a7e5-6674971c2ce9"}} {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 29 08:55:14.311592 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-28cc5f42-2ef4-4108-a06c-72b70be7d549 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] [instance: 4e972e2b-7b5e-4a5f-87a1-3642aad3ac24] Fetching instance by UUID {{(pid=123458) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:55:14.320374 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-28cc5f42-2ef4-4108-a06c-72b70be7d549 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:55:14.321111 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-28cc5f42-2ef4-4108-a06c-72b70be7d549 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:55:14.322064 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-28cc5f42-2ef4-4108-a06c-72b70be7d549 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:55:14.322665 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-28cc5f42-2ef4-4108-a06c-72b70be7d549 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:55:14.355702 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.wsgi [None req-28cc5f42-2ef4-4108-a06c-72b70be7d549 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] HTTP exception thrown: Cannot 'attach_volume' instance 4e972e2b-7b5e-4a5f-87a1-3642aad3ac24 while it is in vm_state rescued Apr 29 08:55:14.356500 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-28cc5f42-2ef4-4108-a06c-72b70be7d549 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Returning 409 to user: Cannot 'attach_volume' instance 4e972e2b-7b5e-4a5f-87a1-3642aad3ac24 while it is in vm_state rescued {{(pid=123458) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 29 08:55:14.358410 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-28cc5f42-2ef4-4108-a06c-72b70be7d549 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] 10.222.0.31 "POST /compute/v2.1/servers/4e972e2b-7b5e-4a5f-87a1-3642aad3ac24/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.053382 Apr 29 08:55:14.359363 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 216/422] 10.222.0.31 () {60 vars in 1322 bytes} [Fri Apr 29 08:55:14 2022] POST /compute/v2.1/servers/4e972e2b-7b5e-4a5f-87a1-3642aad3ac24/os-volume_attachments => generated 152 bytes in 55 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Apr 29 08:55:14.365547 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [req-fd03da73-8216-4518-aa50-d52975bbdabe req-7c3ac3a6-eab2-4000-a747-51bd2d1b7077 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d83c29d2-6435-4edc-827b-2c37a66fb199", "tag": "67bd0bd8-da3b-4ea7-9bf9-bfddba4f2c80"}]} {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 29 08:55:14.374725 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [req-fd03da73-8216-4518-aa50-d52975bbdabe req-7c3ac3a6-eab2-4000-a747-51bd2d1b7077 service nova] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:55:14.375410 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [req-fd03da73-8216-4518-aa50-d52975bbdabe req-7c3ac3a6-eab2-4000-a747-51bd2d1b7077 service nova] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:55:14.389209 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.compute.server_external_events [req-fd03da73-8216-4518-aa50-d52975bbdabe req-7c3ac3a6-eab2-4000-a747-51bd2d1b7077 service nova] Creating event network-changed:67bd0bd8-da3b-4ea7-9bf9-bfddba4f2c80 for instance d83c29d2-6435-4edc-827b-2c37a66fb199 on hv-cinder-83987 Apr 29 08:55:14.395204 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [req-fd03da73-8216-4518-aa50-d52975bbdabe req-7c3ac3a6-eab2-4000-a747-51bd2d1b7077 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033265 Apr 29 08:55:14.396370 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 217/423] 10.222.0.31 () {64 vars in 1317 bytes} [Fri Apr 29 08:55:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 29 08:55:14.402658 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-392eddf7-60f3-4957-b820-93b3417c0ffd tempest-VolumesNegativeTest-45234477 tempest-VolumesNegativeTest-45234477-project] Calling method '>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:55:14.403484 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-392eddf7-60f3-4957-b820-93b3417c0ffd tempest-VolumesNegativeTest-45234477 tempest-VolumesNegativeTest-45234477-project] [instance: 1bcda922-2a2b-4382-9d9e-f083519473d8] Fetching instance by UUID {{(pid=123458) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:55:14.410145 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-392eddf7-60f3-4957-b820-93b3417c0ffd tempest-VolumesNegativeTest-45234477 tempest-VolumesNegativeTest-45234477-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:55:14.410702 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-392eddf7-60f3-4957-b820-93b3417c0ffd tempest-VolumesNegativeTest-45234477 tempest-VolumesNegativeTest-45234477-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:55:14.411585 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-392eddf7-60f3-4957-b820-93b3417c0ffd tempest-VolumesNegativeTest-45234477 tempest-VolumesNegativeTest-45234477-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:55:14.412117 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-392eddf7-60f3-4957-b820-93b3417c0ffd tempest-VolumesNegativeTest-45234477 tempest-VolumesNegativeTest-45234477-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:55:14.463745 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-7299567d-6267-4dcf-a7d3-b32fd4d9c5f9 tempest-VolumesSnapshotTestJSON-1697003112 tempest-VolumesSnapshotTestJSON-1697003112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a210cf812fb54682ac28a13a5dce0563', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c0d26c7abcc4bc7b175ac175bb5f2ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:55:14.471230 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-7299567d-6267-4dcf-a7d3-b32fd4d9c5f9 tempest-VolumesSnapshotTestJSON-1697003112 tempest-VolumesSnapshotTestJSON-1697003112-project] 10.222.0.31 "GET /compute/v2.1/servers/4a2c7e29-e0ec-456b-bd06-ff7127f84e54" status: 200 len: 1319 microversion: 2.1 time: 0.218302 Apr 29 08:55:14.471798 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 207/424] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 08:55:14 2022] GET /compute/v2.1/servers/4a2c7e29-e0ec-456b-bd06-ff7127f84e54 => generated 1319 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 29 08:55:14.476867 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-107c26c1-7f3b-410e-9cd6-819f697381d0 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 29 08:55:14.477602 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-107c26c1-7f3b-410e-9cd6-819f697381d0 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] [instance: 4e972e2b-7b5e-4a5f-87a1-3642aad3ac24] Fetching instance by UUID {{(pid=123459) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:55:14.483637 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-107c26c1-7f3b-410e-9cd6-819f697381d0 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:55:14.484390 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-107c26c1-7f3b-410e-9cd6-819f697381d0 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:55:14.485169 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-107c26c1-7f3b-410e-9cd6-819f697381d0 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:55:14.485600 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-107c26c1-7f3b-410e-9cd6-819f697381d0 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:55:14.561835 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-107c26c1-7f3b-410e-9cd6-819f697381d0 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] 10.222.0.31 "POST /compute/v2.1/servers/4e972e2b-7b5e-4a5f-87a1-3642aad3ac24/action" status: 202 len: 0 microversion: 2.1 time: 0.088561 Apr 29 08:55:14.562487 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 208/425] 10.222.0.31 () {60 vars in 1277 bytes} [Fri Apr 29 08:55:14 2022] POST /compute/v2.1/servers/4e972e2b-7b5e-4a5f-87a1-3642aad3ac24/action => generated 0 bytes in 90 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 29 08:55:14.563366 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-392eddf7-60f3-4957-b820-93b3417c0ffd tempest-VolumesNegativeTest-45234477 tempest-VolumesNegativeTest-45234477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '340cefa576c947d08978a99d288304c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c9877c06a2445a3a34c5d35bafeb7a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:55:14.569111 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [req-22a87187-ef31-4b83-a35b-441ff0540dc2 req-96389fde-9c64-464c-b1a8-d7d298df5ebc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4a2c7e29-e0ec-456b-bd06-ff7127f84e54", "tag": "bb464fd8-11f7-4acb-9ffa-b51b7c033221"}]} {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 29 08:55:14.572599 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-392eddf7-60f3-4957-b820-93b3417c0ffd tempest-VolumesNegativeTest-45234477 tempest-VolumesNegativeTest-45234477-project] 10.222.0.31 "GET /compute/v2.1/servers/1bcda922-2a2b-4382-9d9e-f083519473d8" status: 200 len: 1315 microversion: 2.1 time: 0.174511 Apr 29 08:55:14.573727 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 218/426] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 08:55:14 2022] GET /compute/v2.1/servers/1bcda922-2a2b-4382-9d9e-f083519473d8 => generated 1315 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 08:55:14.578332 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-9994adf4-d88f-4bae-8e68-01237830a0a9 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Calling method '>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:55:14.579188 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-9994adf4-d88f-4bae-8e68-01237830a0a9 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] [instance: 4e972e2b-7b5e-4a5f-87a1-3642aad3ac24] Fetching instance by UUID {{(pid=123458) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:55:14.585270 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-9994adf4-d88f-4bae-8e68-01237830a0a9 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:55:14.585713 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-9994adf4-d88f-4bae-8e68-01237830a0a9 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:55:14.586514 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [req-22a87187-ef31-4b83-a35b-441ff0540dc2 req-96389fde-9c64-464c-b1a8-d7d298df5ebc service nova] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:55:14.586669 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-9994adf4-d88f-4bae-8e68-01237830a0a9 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:55:14.587090 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-9994adf4-d88f-4bae-8e68-01237830a0a9 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:55:14.587311 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [req-22a87187-ef31-4b83-a35b-441ff0540dc2 req-96389fde-9c64-464c-b1a8-d7d298df5ebc service nova] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:55:14.601536 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.compute.server_external_events [req-22a87187-ef31-4b83-a35b-441ff0540dc2 req-96389fde-9c64-464c-b1a8-d7d298df5ebc service nova] Creating event network-changed:bb464fd8-11f7-4acb-9ffa-b51b7c033221 for instance 4a2c7e29-e0ec-456b-bd06-ff7127f84e54 on hv-cinder-83987 Apr 29 08:55:14.606278 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [req-22a87187-ef31-4b83-a35b-441ff0540dc2 req-96389fde-9c64-464c-b1a8-d7d298df5ebc service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042006 Apr 29 08:55:14.606803 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 209/427] 10.222.0.31 () {64 vars in 1317 bytes} [Fri Apr 29 08:55:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 29 08:55:14.734209 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-9994adf4-d88f-4bae-8e68-01237830a0a9 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c18e88436f14dc7a2001220b87ce9ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60998f08c40446e787ead285e40665b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:55:14.742277 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-9994adf4-d88f-4bae-8e68-01237830a0a9 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] 10.222.0.31 "GET /compute/v2.1/servers/4e972e2b-7b5e-4a5f-87a1-3642aad3ac24" status: 200 len: 1510 microversion: 2.1 time: 0.167410 Apr 29 08:55:14.742843 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 219/428] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 08:55:14 2022] GET /compute/v2.1/servers/4e972e2b-7b5e-4a5f-87a1-3642aad3ac24 => generated 1510 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 08:55:14.995084 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-446c9e91-110b-48f6-9326-b9d1b5157c76 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Calling method '>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:55:14.995597 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-446c9e91-110b-48f6-9326-b9d1b5157c76 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] [instance: 406b5ad6-698e-457f-93f4-cdfd45fb3e8e] Fetching instance by UUID {{(pid=123459) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:55:15.003625 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-446c9e91-110b-48f6-9326-b9d1b5157c76 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:55:15.004585 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-446c9e91-110b-48f6-9326-b9d1b5157c76 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:55:15.005432 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-446c9e91-110b-48f6-9326-b9d1b5157c76 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:55:15.005876 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-446c9e91-110b-48f6-9326-b9d1b5157c76 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:55:15.142232 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-446c9e91-110b-48f6-9326-b9d1b5157c76 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:55:15.151195 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-446c9e91-110b-48f6-9326-b9d1b5157c76 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:55:15.152739 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-446c9e91-110b-48f6-9326-b9d1b5157c76 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:55:15.153919 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-446c9e91-110b-48f6-9326-b9d1b5157c76 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] 10.222.0.31 "GET /compute/v2.1/servers/406b5ad6-698e-457f-93f4-cdfd45fb3e8e" status: 200 len: 1726 microversion: 2.20 time: 0.163721 Apr 29 08:55:15.154480 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 210/429] 10.222.0.31 () {60 vars in 1276 bytes} [Fri Apr 29 08:55:14 2022] GET /compute/v2.1/servers/406b5ad6-698e-457f-93f4-cdfd45fb3e8e => generated 1726 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 29 08:55:15.225754 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-481abb4a-9d76-4cc0-80f3-8e2183ff2bd6 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Calling method '>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:55:15.226358 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-481abb4a-9d76-4cc0-80f3-8e2183ff2bd6 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] [instance: 21ab666e-c39f-4202-9e7a-aa431a96a130] Fetching instance by UUID {{(pid=123458) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:55:15.232956 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-481abb4a-9d76-4cc0-80f3-8e2183ff2bd6 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:55:15.233399 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-481abb4a-9d76-4cc0-80f3-8e2183ff2bd6 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:55:15.234302 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-481abb4a-9d76-4cc0-80f3-8e2183ff2bd6 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:55:15.234652 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-481abb4a-9d76-4cc0-80f3-8e2183ff2bd6 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:55:15.298668 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-481abb4a-9d76-4cc0-80f3-8e2183ff2bd6 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e47ecdfb01f447699275b13255c15d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578e6a35974d4e5c8a0cd4e5fa994259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:55:15.306232 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-481abb4a-9d76-4cc0-80f3-8e2183ff2bd6 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] 10.222.0.31 "GET /compute/v2.1/servers/21ab666e-c39f-4202-9e7a-aa431a96a130" status: 200 len: 1302 microversion: 2.1 time: 0.085194 Apr 29 08:55:15.306814 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 220/430] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 08:55:15 2022] GET /compute/v2.1/servers/21ab666e-c39f-4202-9e7a-aa431a96a130 => generated 1302 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 08:55:15.488876 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-786c5043-bbb0-416e-b0c4-f8fbd8568ac1 tempest-VolumesSnapshotTestJSON-1697003112 tempest-VolumesSnapshotTestJSON-1697003112-project] Calling method '>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:55:15.489467 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-786c5043-bbb0-416e-b0c4-f8fbd8568ac1 tempest-VolumesSnapshotTestJSON-1697003112 tempest-VolumesSnapshotTestJSON-1697003112-project] [instance: 4a2c7e29-e0ec-456b-bd06-ff7127f84e54] Fetching instance by UUID {{(pid=123459) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:55:15.495492 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-786c5043-bbb0-416e-b0c4-f8fbd8568ac1 tempest-VolumesSnapshotTestJSON-1697003112 tempest-VolumesSnapshotTestJSON-1697003112-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:55:15.495939 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-786c5043-bbb0-416e-b0c4-f8fbd8568ac1 tempest-VolumesSnapshotTestJSON-1697003112 tempest-VolumesSnapshotTestJSON-1697003112-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:55:15.496727 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-786c5043-bbb0-416e-b0c4-f8fbd8568ac1 tempest-VolumesSnapshotTestJSON-1697003112 tempest-VolumesSnapshotTestJSON-1697003112-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:55:15.497162 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-786c5043-bbb0-416e-b0c4-f8fbd8568ac1 tempest-VolumesSnapshotTestJSON-1697003112 tempest-VolumesSnapshotTestJSON-1697003112-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:55:15.589396 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-8f31d1c2-f300-49c4-b6c9-f0be2f830ab3 tempest-VolumesNegativeTest-45234477 tempest-VolumesNegativeTest-45234477-project] Calling method '>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:55:15.590012 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-8f31d1c2-f300-49c4-b6c9-f0be2f830ab3 tempest-VolumesNegativeTest-45234477 tempest-VolumesNegativeTest-45234477-project] [instance: 1bcda922-2a2b-4382-9d9e-f083519473d8] Fetching instance by UUID {{(pid=123458) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:55:15.595851 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-8f31d1c2-f300-49c4-b6c9-f0be2f830ab3 tempest-VolumesNegativeTest-45234477 tempest-VolumesNegativeTest-45234477-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:55:15.596341 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-8f31d1c2-f300-49c4-b6c9-f0be2f830ab3 tempest-VolumesNegativeTest-45234477 tempest-VolumesNegativeTest-45234477-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:55:15.597124 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-8f31d1c2-f300-49c4-b6c9-f0be2f830ab3 tempest-VolumesNegativeTest-45234477 tempest-VolumesNegativeTest-45234477-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:55:15.597562 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-8f31d1c2-f300-49c4-b6c9-f0be2f830ab3 tempest-VolumesNegativeTest-45234477 tempest-VolumesNegativeTest-45234477-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:55:15.626668 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-786c5043-bbb0-416e-b0c4-f8fbd8568ac1 tempest-VolumesSnapshotTestJSON-1697003112 tempest-VolumesSnapshotTestJSON-1697003112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a210cf812fb54682ac28a13a5dce0563', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c0d26c7abcc4bc7b175ac175bb5f2ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:55:15.634810 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-786c5043-bbb0-416e-b0c4-f8fbd8568ac1 tempest-VolumesSnapshotTestJSON-1697003112 tempest-VolumesSnapshotTestJSON-1697003112-project] 10.222.0.31 "GET /compute/v2.1/servers/4a2c7e29-e0ec-456b-bd06-ff7127f84e54" status: 200 len: 1319 microversion: 2.1 time: 0.150034 Apr 29 08:55:15.635394 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 211/431] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 08:55:15 2022] GET /compute/v2.1/servers/4a2c7e29-e0ec-456b-bd06-ff7127f84e54 => generated 1319 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 08:55:15.728942 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-8f31d1c2-f300-49c4-b6c9-f0be2f830ab3 tempest-VolumesNegativeTest-45234477 tempest-VolumesNegativeTest-45234477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '340cefa576c947d08978a99d288304c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c9877c06a2445a3a34c5d35bafeb7a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:55:15.736321 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-8f31d1c2-f300-49c4-b6c9-f0be2f830ab3 tempest-VolumesNegativeTest-45234477 tempest-VolumesNegativeTest-45234477-project] 10.222.0.31 "GET /compute/v2.1/servers/1bcda922-2a2b-4382-9d9e-f083519473d8" status: 200 len: 1315 microversion: 2.1 time: 0.150638 Apr 29 08:55:15.736909 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 221/432] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 08:55:15 2022] GET /compute/v2.1/servers/1bcda922-2a2b-4382-9d9e-f083519473d8 => generated 1315 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 29 08:55:15.759024 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-0b1f5ad8-a1a0-418a-a5ff-e831040b7788 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Calling method '>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:55:15.759634 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-0b1f5ad8-a1a0-418a-a5ff-e831040b7788 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] [instance: 4e972e2b-7b5e-4a5f-87a1-3642aad3ac24] Fetching instance by UUID {{(pid=123459) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:55:15.765642 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-0b1f5ad8-a1a0-418a-a5ff-e831040b7788 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:55:15.766083 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-0b1f5ad8-a1a0-418a-a5ff-e831040b7788 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:55:15.766856 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-0b1f5ad8-a1a0-418a-a5ff-e831040b7788 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:55:15.767278 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-0b1f5ad8-a1a0-418a-a5ff-e831040b7788 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:55:15.894288 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-0b1f5ad8-a1a0-418a-a5ff-e831040b7788 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c18e88436f14dc7a2001220b87ce9ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60998f08c40446e787ead285e40665b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:55:15.901828 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-0b1f5ad8-a1a0-418a-a5ff-e831040b7788 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] 10.222.0.31 "GET /compute/v2.1/servers/4e972e2b-7b5e-4a5f-87a1-3642aad3ac24" status: 200 len: 1510 microversion: 2.1 time: 0.146596 Apr 29 08:55:15.902395 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 212/433] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 08:55:15 2022] GET /compute/v2.1/servers/4e972e2b-7b5e-4a5f-87a1-3642aad3ac24 => generated 1510 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 08:55:16.173457 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-58b5a5b0-d0ad-443f-8940-15b75ba2b210 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Calling method '>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:55:16.174057 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-58b5a5b0-d0ad-443f-8940-15b75ba2b210 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] [instance: 406b5ad6-698e-457f-93f4-cdfd45fb3e8e] Fetching instance by UUID {{(pid=123458) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:55:16.180119 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-58b5a5b0-d0ad-443f-8940-15b75ba2b210 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:55:16.180586 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-58b5a5b0-d0ad-443f-8940-15b75ba2b210 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:55:16.181347 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-58b5a5b0-d0ad-443f-8940-15b75ba2b210 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:55:16.181780 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-58b5a5b0-d0ad-443f-8940-15b75ba2b210 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:55:16.314954 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-58b5a5b0-d0ad-443f-8940-15b75ba2b210 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:55:16.323012 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-84052ca0-5789-4484-80fe-505cf23d9fd9 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Calling method '>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:55:16.323644 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-84052ca0-5789-4484-80fe-505cf23d9fd9 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] [instance: 21ab666e-c39f-4202-9e7a-aa431a96a130] Fetching instance by UUID {{(pid=123459) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:55:16.324001 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-58b5a5b0-d0ad-443f-8940-15b75ba2b210 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:55:16.325562 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-58b5a5b0-d0ad-443f-8940-15b75ba2b210 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:55:16.326743 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-58b5a5b0-d0ad-443f-8940-15b75ba2b210 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] 10.222.0.31 "GET /compute/v2.1/servers/406b5ad6-698e-457f-93f4-cdfd45fb3e8e" status: 200 len: 1726 microversion: 2.20 time: 0.157136 Apr 29 08:55:16.327399 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 222/434] 10.222.0.31 () {60 vars in 1276 bytes} [Fri Apr 29 08:55:16 2022] GET /compute/v2.1/servers/406b5ad6-698e-457f-93f4-cdfd45fb3e8e => generated 1726 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 29 08:55:16.330182 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-84052ca0-5789-4484-80fe-505cf23d9fd9 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:55:16.330624 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-84052ca0-5789-4484-80fe-505cf23d9fd9 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:55:16.331401 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-84052ca0-5789-4484-80fe-505cf23d9fd9 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:55:16.331900 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-84052ca0-5789-4484-80fe-505cf23d9fd9 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:55:16.400521 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-84052ca0-5789-4484-80fe-505cf23d9fd9 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e47ecdfb01f447699275b13255c15d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578e6a35974d4e5c8a0cd4e5fa994259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:55:16.409070 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-84052ca0-5789-4484-80fe-505cf23d9fd9 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] 10.222.0.31 "GET /compute/v2.1/servers/21ab666e-c39f-4202-9e7a-aa431a96a130" status: 200 len: 1302 microversion: 2.1 time: 0.089872 Apr 29 08:55:16.409790 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 213/435] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 08:55:16 2022] GET /compute/v2.1/servers/21ab666e-c39f-4202-9e7a-aa431a96a130 => generated 1302 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 08:55:16.651232 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-b3bbf872-0e1e-4c71-b200-4c507a35a0ed tempest-VolumesSnapshotTestJSON-1697003112 tempest-VolumesSnapshotTestJSON-1697003112-project] Calling method '>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:55:16.651750 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-b3bbf872-0e1e-4c71-b200-4c507a35a0ed tempest-VolumesSnapshotTestJSON-1697003112 tempest-VolumesSnapshotTestJSON-1697003112-project] [instance: 4a2c7e29-e0ec-456b-bd06-ff7127f84e54] Fetching instance by UUID {{(pid=123458) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:55:16.657782 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-b3bbf872-0e1e-4c71-b200-4c507a35a0ed tempest-VolumesSnapshotTestJSON-1697003112 tempest-VolumesSnapshotTestJSON-1697003112-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:55:16.658227 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-b3bbf872-0e1e-4c71-b200-4c507a35a0ed tempest-VolumesSnapshotTestJSON-1697003112 tempest-VolumesSnapshotTestJSON-1697003112-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:55:16.658987 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-b3bbf872-0e1e-4c71-b200-4c507a35a0ed tempest-VolumesSnapshotTestJSON-1697003112 tempest-VolumesSnapshotTestJSON-1697003112-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:55:16.659416 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-b3bbf872-0e1e-4c71-b200-4c507a35a0ed tempest-VolumesSnapshotTestJSON-1697003112 tempest-VolumesSnapshotTestJSON-1697003112-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:55:16.753453 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-245b3724-439c-454a-bad8-40d4089fc752 tempest-VolumesNegativeTest-45234477 tempest-VolumesNegativeTest-45234477-project] Calling method '>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:55:16.754285 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-245b3724-439c-454a-bad8-40d4089fc752 tempest-VolumesNegativeTest-45234477 tempest-VolumesNegativeTest-45234477-project] [instance: 1bcda922-2a2b-4382-9d9e-f083519473d8] Fetching instance by UUID {{(pid=123459) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:55:16.760396 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-245b3724-439c-454a-bad8-40d4089fc752 tempest-VolumesNegativeTest-45234477 tempest-VolumesNegativeTest-45234477-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:55:16.760850 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-245b3724-439c-454a-bad8-40d4089fc752 tempest-VolumesNegativeTest-45234477 tempest-VolumesNegativeTest-45234477-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:55:16.761632 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-245b3724-439c-454a-bad8-40d4089fc752 tempest-VolumesNegativeTest-45234477 tempest-VolumesNegativeTest-45234477-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:55:16.762092 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-245b3724-439c-454a-bad8-40d4089fc752 tempest-VolumesNegativeTest-45234477 tempest-VolumesNegativeTest-45234477-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:55:16.794657 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-b3bbf872-0e1e-4c71-b200-4c507a35a0ed tempest-VolumesSnapshotTestJSON-1697003112 tempest-VolumesSnapshotTestJSON-1697003112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a210cf812fb54682ac28a13a5dce0563', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c0d26c7abcc4bc7b175ac175bb5f2ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:55:16.803030 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-b3bbf872-0e1e-4c71-b200-4c507a35a0ed tempest-VolumesSnapshotTestJSON-1697003112 tempest-VolumesSnapshotTestJSON-1697003112-project] 10.222.0.31 "GET /compute/v2.1/servers/4a2c7e29-e0ec-456b-bd06-ff7127f84e54" status: 200 len: 1319 microversion: 2.1 time: 0.155513 Apr 29 08:55:16.803713 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 223/436] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 08:55:16 2022] GET /compute/v2.1/servers/4a2c7e29-e0ec-456b-bd06-ff7127f84e54 => generated 1319 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 08:55:16.902245 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-245b3724-439c-454a-bad8-40d4089fc752 tempest-VolumesNegativeTest-45234477 tempest-VolumesNegativeTest-45234477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '340cefa576c947d08978a99d288304c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c9877c06a2445a3a34c5d35bafeb7a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:55:16.909748 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-245b3724-439c-454a-bad8-40d4089fc752 tempest-VolumesNegativeTest-45234477 tempest-VolumesNegativeTest-45234477-project] 10.222.0.31 "GET /compute/v2.1/servers/1bcda922-2a2b-4382-9d9e-f083519473d8" status: 200 len: 1315 microversion: 2.1 time: 0.160022 Apr 29 08:55:16.911248 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 214/437] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 08:55:16 2022] GET /compute/v2.1/servers/1bcda922-2a2b-4382-9d9e-f083519473d8 => generated 1315 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 29 08:55:16.919870 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-fed784af-d581-4b42-8dd8-d677260ed250 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Calling method '>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:55:16.920508 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-fed784af-d581-4b42-8dd8-d677260ed250 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] [instance: 4e972e2b-7b5e-4a5f-87a1-3642aad3ac24] Fetching instance by UUID {{(pid=123458) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:55:16.926930 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-fed784af-d581-4b42-8dd8-d677260ed250 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:55:16.927489 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-fed784af-d581-4b42-8dd8-d677260ed250 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:55:16.928300 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-fed784af-d581-4b42-8dd8-d677260ed250 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:55:16.932642 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-fed784af-d581-4b42-8dd8-d677260ed250 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:55:17.083925 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-fed784af-d581-4b42-8dd8-d677260ed250 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c18e88436f14dc7a2001220b87ce9ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60998f08c40446e787ead285e40665b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:55:17.091334 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-fed784af-d581-4b42-8dd8-d677260ed250 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] 10.222.0.31 "GET /compute/v2.1/servers/4e972e2b-7b5e-4a5f-87a1-3642aad3ac24" status: 200 len: 1510 microversion: 2.1 time: 0.175294 Apr 29 08:55:17.091913 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 224/438] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 08:55:16 2022] GET /compute/v2.1/servers/4e972e2b-7b5e-4a5f-87a1-3642aad3ac24 => generated 1510 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 08:55:17.347229 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-29e261f9-139f-4fad-98a8-d10d3c4baa15 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Calling method '>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:55:17.349399 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-29e261f9-139f-4fad-98a8-d10d3c4baa15 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] [instance: 406b5ad6-698e-457f-93f4-cdfd45fb3e8e] Fetching instance by UUID {{(pid=123459) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:55:17.356173 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-29e261f9-139f-4fad-98a8-d10d3c4baa15 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:55:17.356971 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-29e261f9-139f-4fad-98a8-d10d3c4baa15 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:55:17.357996 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-29e261f9-139f-4fad-98a8-d10d3c4baa15 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:55:17.358634 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-29e261f9-139f-4fad-98a8-d10d3c4baa15 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:55:17.426692 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-8b5b6af7-3c84-45be-8ca7-858b0e2363ac tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Calling method '>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:55:17.427225 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-8b5b6af7-3c84-45be-8ca7-858b0e2363ac tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] [instance: 21ab666e-c39f-4202-9e7a-aa431a96a130] Fetching instance by UUID {{(pid=123458) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:55:17.433830 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-8b5b6af7-3c84-45be-8ca7-858b0e2363ac tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:55:17.434275 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-8b5b6af7-3c84-45be-8ca7-858b0e2363ac tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:55:17.435045 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-8b5b6af7-3c84-45be-8ca7-858b0e2363ac tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:55:17.435668 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-8b5b6af7-3c84-45be-8ca7-858b0e2363ac tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:55:17.521726 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-8b5b6af7-3c84-45be-8ca7-858b0e2363ac tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e47ecdfb01f447699275b13255c15d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578e6a35974d4e5c8a0cd4e5fa994259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:55:17.529905 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-8b5b6af7-3c84-45be-8ca7-858b0e2363ac tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] 10.222.0.31 "GET /compute/v2.1/servers/21ab666e-c39f-4202-9e7a-aa431a96a130" status: 200 len: 1300 microversion: 2.1 time: 0.107149 Apr 29 08:55:17.538184 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 225/439] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 08:55:17 2022] GET /compute/v2.1/servers/21ab666e-c39f-4202-9e7a-aa431a96a130 => generated 1300 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 29 08:55:17.645055 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-29e261f9-139f-4fad-98a8-d10d3c4baa15 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:55:17.654754 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-29e261f9-139f-4fad-98a8-d10d3c4baa15 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:55:17.656316 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-29e261f9-139f-4fad-98a8-d10d3c4baa15 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:55:17.657498 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-29e261f9-139f-4fad-98a8-d10d3c4baa15 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] 10.222.0.31 "GET /compute/v2.1/servers/406b5ad6-698e-457f-93f4-cdfd45fb3e8e" status: 200 len: 1726 microversion: 2.20 time: 0.315242 Apr 29 08:55:17.658062 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 215/440] 10.222.0.31 () {60 vars in 1276 bytes} [Fri Apr 29 08:55:17 2022] GET /compute/v2.1/servers/406b5ad6-698e-457f-93f4-cdfd45fb3e8e => generated 1726 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 29 08:55:17.821560 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-45cbe37a-22ff-4c93-8596-7cb543384f59 tempest-VolumesSnapshotTestJSON-1697003112 tempest-VolumesSnapshotTestJSON-1697003112-project] Calling method '>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:55:17.822168 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-45cbe37a-22ff-4c93-8596-7cb543384f59 tempest-VolumesSnapshotTestJSON-1697003112 tempest-VolumesSnapshotTestJSON-1697003112-project] [instance: 4a2c7e29-e0ec-456b-bd06-ff7127f84e54] Fetching instance by UUID {{(pid=123458) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:55:17.828325 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-45cbe37a-22ff-4c93-8596-7cb543384f59 tempest-VolumesSnapshotTestJSON-1697003112 tempest-VolumesSnapshotTestJSON-1697003112-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:55:17.828908 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-45cbe37a-22ff-4c93-8596-7cb543384f59 tempest-VolumesSnapshotTestJSON-1697003112 tempest-VolumesSnapshotTestJSON-1697003112-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:55:17.829693 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-45cbe37a-22ff-4c93-8596-7cb543384f59 tempest-VolumesSnapshotTestJSON-1697003112 tempest-VolumesSnapshotTestJSON-1697003112-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:55:17.830115 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-45cbe37a-22ff-4c93-8596-7cb543384f59 tempest-VolumesSnapshotTestJSON-1697003112 tempest-VolumesSnapshotTestJSON-1697003112-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:55:17.937855 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-aad37d2c-31d3-41b0-b950-8aa4062831d1 tempest-VolumesNegativeTest-45234477 tempest-VolumesNegativeTest-45234477-project] Calling method '>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:55:17.939221 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-aad37d2c-31d3-41b0-b950-8aa4062831d1 tempest-VolumesNegativeTest-45234477 tempest-VolumesNegativeTest-45234477-project] [instance: 1bcda922-2a2b-4382-9d9e-f083519473d8] Fetching instance by UUID {{(pid=123459) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:55:17.944433 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-aad37d2c-31d3-41b0-b950-8aa4062831d1 tempest-VolumesNegativeTest-45234477 tempest-VolumesNegativeTest-45234477-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:55:17.944881 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-aad37d2c-31d3-41b0-b950-8aa4062831d1 tempest-VolumesNegativeTest-45234477 tempest-VolumesNegativeTest-45234477-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:55:17.946016 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-aad37d2c-31d3-41b0-b950-8aa4062831d1 tempest-VolumesNegativeTest-45234477 tempest-VolumesNegativeTest-45234477-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:55:17.946598 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-aad37d2c-31d3-41b0-b950-8aa4062831d1 tempest-VolumesNegativeTest-45234477 tempest-VolumesNegativeTest-45234477-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:55:18.141954 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-45cbe37a-22ff-4c93-8596-7cb543384f59 tempest-VolumesSnapshotTestJSON-1697003112 tempest-VolumesSnapshotTestJSON-1697003112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a210cf812fb54682ac28a13a5dce0563', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c0d26c7abcc4bc7b175ac175bb5f2ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:55:18.151436 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-45cbe37a-22ff-4c93-8596-7cb543384f59 tempest-VolumesSnapshotTestJSON-1697003112 tempest-VolumesSnapshotTestJSON-1697003112-project] 10.222.0.31 "GET /compute/v2.1/servers/4a2c7e29-e0ec-456b-bd06-ff7127f84e54" status: 200 len: 1319 microversion: 2.1 time: 0.334666 Apr 29 08:55:18.161289 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 226/441] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 08:55:17 2022] GET /compute/v2.1/servers/4a2c7e29-e0ec-456b-bd06-ff7127f84e54 => generated 1319 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 08:55:18.167838 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-fd1c7ed5-440a-4339-a968-3bdcc07d0ae6 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Calling method '>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:55:18.168735 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-fd1c7ed5-440a-4339-a968-3bdcc07d0ae6 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] [instance: 4e972e2b-7b5e-4a5f-87a1-3642aad3ac24] Fetching instance by UUID {{(pid=123458) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:55:18.177078 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-fd1c7ed5-440a-4339-a968-3bdcc07d0ae6 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:55:18.177872 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-fd1c7ed5-440a-4339-a968-3bdcc07d0ae6 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:55:18.178318 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-fd1c7ed5-440a-4339-a968-3bdcc07d0ae6 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:55:18.178744 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-fd1c7ed5-440a-4339-a968-3bdcc07d0ae6 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:55:18.215499 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-aad37d2c-31d3-41b0-b950-8aa4062831d1 tempest-VolumesNegativeTest-45234477 tempest-VolumesNegativeTest-45234477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '340cefa576c947d08978a99d288304c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c9877c06a2445a3a34c5d35bafeb7a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:55:18.224171 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-aad37d2c-31d3-41b0-b950-8aa4062831d1 tempest-VolumesNegativeTest-45234477 tempest-VolumesNegativeTest-45234477-project] 10.222.0.31 "GET /compute/v2.1/servers/1bcda922-2a2b-4382-9d9e-f083519473d8" status: 200 len: 1315 microversion: 2.1 time: 0.296525 Apr 29 08:55:18.233661 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 216/442] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 08:55:17 2022] GET /compute/v2.1/servers/1bcda922-2a2b-4382-9d9e-f083519473d8 => generated 1315 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 08:55:18.418931 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-fd1c7ed5-440a-4339-a968-3bdcc07d0ae6 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c18e88436f14dc7a2001220b87ce9ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60998f08c40446e787ead285e40665b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:55:18.426728 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-fd1c7ed5-440a-4339-a968-3bdcc07d0ae6 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] 10.222.0.31 "GET /compute/v2.1/servers/4e972e2b-7b5e-4a5f-87a1-3642aad3ac24" status: 200 len: 1510 microversion: 2.1 time: 0.263328 Apr 29 08:55:18.427363 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 227/443] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 08:55:18 2022] GET /compute/v2.1/servers/4e972e2b-7b5e-4a5f-87a1-3642aad3ac24 => generated 1510 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 08:55:18.549335 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-d3335116-3660-45b1-9d74-2de52887e5e1 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Calling method '>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:55:18.549953 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-d3335116-3660-45b1-9d74-2de52887e5e1 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] [instance: 21ab666e-c39f-4202-9e7a-aa431a96a130] Fetching instance by UUID {{(pid=123459) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:55:18.556866 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-d3335116-3660-45b1-9d74-2de52887e5e1 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:55:18.557321 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-d3335116-3660-45b1-9d74-2de52887e5e1 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:55:18.558101 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-d3335116-3660-45b1-9d74-2de52887e5e1 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:55:18.558544 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-d3335116-3660-45b1-9d74-2de52887e5e1 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:55:18.677104 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-784b94d7-b91b-4841-930c-2f5ddb6b27be tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Calling method '>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:55:18.678136 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-784b94d7-b91b-4841-930c-2f5ddb6b27be tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] [instance: 406b5ad6-698e-457f-93f4-cdfd45fb3e8e] Fetching instance by UUID {{(pid=123458) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:55:18.686095 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-784b94d7-b91b-4841-930c-2f5ddb6b27be tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:55:18.686901 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-784b94d7-b91b-4841-930c-2f5ddb6b27be tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:55:18.687943 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-784b94d7-b91b-4841-930c-2f5ddb6b27be tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:55:18.688616 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-784b94d7-b91b-4841-930c-2f5ddb6b27be tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:55:18.798994 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-d3335116-3660-45b1-9d74-2de52887e5e1 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e47ecdfb01f447699275b13255c15d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578e6a35974d4e5c8a0cd4e5fa994259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:55:18.811289 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-d3335116-3660-45b1-9d74-2de52887e5e1 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] 10.222.0.31 "GET /compute/v2.1/servers/21ab666e-c39f-4202-9e7a-aa431a96a130" status: 200 len: 1367 microversion: 2.1 time: 0.265774 Apr 29 08:55:18.812659 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 217/444] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 08:55:18 2022] GET /compute/v2.1/servers/21ab666e-c39f-4202-9e7a-aa431a96a130 => generated 1367 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 08:55:18.944495 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-784b94d7-b91b-4841-930c-2f5ddb6b27be tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:55:18.955309 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-784b94d7-b91b-4841-930c-2f5ddb6b27be tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:55:18.957999 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-784b94d7-b91b-4841-930c-2f5ddb6b27be tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:55:18.958852 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-784b94d7-b91b-4841-930c-2f5ddb6b27be tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] 10.222.0.31 "GET /compute/v2.1/servers/406b5ad6-698e-457f-93f4-cdfd45fb3e8e" status: 200 len: 1726 microversion: 2.20 time: 0.286816 Apr 29 08:55:18.959624 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 228/445] 10.222.0.31 () {60 vars in 1276 bytes} [Fri Apr 29 08:55:18 2022] GET /compute/v2.1/servers/406b5ad6-698e-457f-93f4-cdfd45fb3e8e => generated 1726 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 29 08:55:19.169299 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-0199a629-c082-4780-90a9-e645450773ef tempest-VolumesSnapshotTestJSON-1697003112 tempest-VolumesSnapshotTestJSON-1697003112-project] Calling method '>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:55:19.170303 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-0199a629-c082-4780-90a9-e645450773ef tempest-VolumesSnapshotTestJSON-1697003112 tempest-VolumesSnapshotTestJSON-1697003112-project] [instance: 4a2c7e29-e0ec-456b-bd06-ff7127f84e54] Fetching instance by UUID {{(pid=123459) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:55:19.177159 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-0199a629-c082-4780-90a9-e645450773ef tempest-VolumesSnapshotTestJSON-1697003112 tempest-VolumesSnapshotTestJSON-1697003112-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:55:19.177600 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-0199a629-c082-4780-90a9-e645450773ef tempest-VolumesSnapshotTestJSON-1697003112 tempest-VolumesSnapshotTestJSON-1697003112-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:55:19.178524 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-0199a629-c082-4780-90a9-e645450773ef tempest-VolumesSnapshotTestJSON-1697003112 tempest-VolumesSnapshotTestJSON-1697003112-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:55:19.179193 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-0199a629-c082-4780-90a9-e645450773ef tempest-VolumesSnapshotTestJSON-1697003112 tempest-VolumesSnapshotTestJSON-1697003112-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:55:19.242110 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-4f5b7a70-5f0a-41b1-a88c-a3d842ae0f0b tempest-VolumesNegativeTest-45234477 tempest-VolumesNegativeTest-45234477-project] Calling method '>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:55:19.243214 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-4f5b7a70-5f0a-41b1-a88c-a3d842ae0f0b tempest-VolumesNegativeTest-45234477 tempest-VolumesNegativeTest-45234477-project] [instance: 1bcda922-2a2b-4382-9d9e-f083519473d8] Fetching instance by UUID {{(pid=123458) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:55:19.249406 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-4f5b7a70-5f0a-41b1-a88c-a3d842ae0f0b tempest-VolumesNegativeTest-45234477 tempest-VolumesNegativeTest-45234477-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:55:19.250241 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-4f5b7a70-5f0a-41b1-a88c-a3d842ae0f0b tempest-VolumesNegativeTest-45234477 tempest-VolumesNegativeTest-45234477-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:55:19.251015 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-4f5b7a70-5f0a-41b1-a88c-a3d842ae0f0b tempest-VolumesNegativeTest-45234477 tempest-VolumesNegativeTest-45234477-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:55:19.251609 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-4f5b7a70-5f0a-41b1-a88c-a3d842ae0f0b tempest-VolumesNegativeTest-45234477 tempest-VolumesNegativeTest-45234477-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:55:19.322475 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-0199a629-c082-4780-90a9-e645450773ef tempest-VolumesSnapshotTestJSON-1697003112 tempest-VolumesSnapshotTestJSON-1697003112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a210cf812fb54682ac28a13a5dce0563', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c0d26c7abcc4bc7b175ac175bb5f2ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:55:19.330576 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-0199a629-c082-4780-90a9-e645450773ef tempest-VolumesSnapshotTestJSON-1697003112 tempest-VolumesSnapshotTestJSON-1697003112-project] 10.222.0.31 "GET /compute/v2.1/servers/4a2c7e29-e0ec-456b-bd06-ff7127f84e54" status: 200 len: 1319 microversion: 2.1 time: 0.165455 Apr 29 08:55:19.331167 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 218/446] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 08:55:19 2022] GET /compute/v2.1/servers/4a2c7e29-e0ec-456b-bd06-ff7127f84e54 => generated 1319 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 08:55:19.443780 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-9158521a-5dc6-455b-9ced-64a517c5e90b tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Calling method '>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:55:19.444521 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-9158521a-5dc6-455b-9ced-64a517c5e90b tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] [instance: 4e972e2b-7b5e-4a5f-87a1-3642aad3ac24] Fetching instance by UUID {{(pid=123459) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:55:19.450788 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-9158521a-5dc6-455b-9ced-64a517c5e90b tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:55:19.451559 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-9158521a-5dc6-455b-9ced-64a517c5e90b tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:55:19.452720 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-9158521a-5dc6-455b-9ced-64a517c5e90b tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:55:19.453517 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-9158521a-5dc6-455b-9ced-64a517c5e90b tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:55:19.488261 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-4f5b7a70-5f0a-41b1-a88c-a3d842ae0f0b tempest-VolumesNegativeTest-45234477 tempest-VolumesNegativeTest-45234477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '340cefa576c947d08978a99d288304c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c9877c06a2445a3a34c5d35bafeb7a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:55:19.499649 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-4f5b7a70-5f0a-41b1-a88c-a3d842ae0f0b tempest-VolumesNegativeTest-45234477 tempest-VolumesNegativeTest-45234477-project] 10.222.0.31 "GET /compute/v2.1/servers/1bcda922-2a2b-4382-9d9e-f083519473d8" status: 200 len: 1315 microversion: 2.1 time: 0.262290 Apr 29 08:55:19.501437 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 229/447] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 08:55:19 2022] GET /compute/v2.1/servers/1bcda922-2a2b-4382-9d9e-f083519473d8 => generated 1315 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 29 08:55:19.607483 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-9158521a-5dc6-455b-9ced-64a517c5e90b tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c18e88436f14dc7a2001220b87ce9ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60998f08c40446e787ead285e40665b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:55:19.615637 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-9158521a-5dc6-455b-9ced-64a517c5e90b tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] 10.222.0.31 "GET /compute/v2.1/servers/4e972e2b-7b5e-4a5f-87a1-3642aad3ac24" status: 200 len: 1510 microversion: 2.1 time: 0.176295 Apr 29 08:55:19.616280 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 219/448] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 08:55:19 2022] GET /compute/v2.1/servers/4e972e2b-7b5e-4a5f-87a1-3642aad3ac24 => generated 1510 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 08:55:19.649996 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [req-127027a2-9e6c-48b9-b8da-2520b1881f7b req-68317e6a-9317-4f40-9b5b-bc1840249c29 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "21ab666e-c39f-4202-9e7a-aa431a96a130", "tag": "9e72371e-8d60-4d5c-8356-4c1a4228bf38"}]} {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 29 08:55:19.658188 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [req-127027a2-9e6c-48b9-b8da-2520b1881f7b req-68317e6a-9317-4f40-9b5b-bc1840249c29 service nova] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:55:19.658630 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [req-127027a2-9e6c-48b9-b8da-2520b1881f7b req-68317e6a-9317-4f40-9b5b-bc1840249c29 service nova] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:55:19.674683 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.compute.server_external_events [req-127027a2-9e6c-48b9-b8da-2520b1881f7b req-68317e6a-9317-4f40-9b5b-bc1840249c29 service nova] Creating event network-changed:9e72371e-8d60-4d5c-8356-4c1a4228bf38 for instance 21ab666e-c39f-4202-9e7a-aa431a96a130 on hv-cinder-83987 Apr 29 08:55:19.680382 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [req-127027a2-9e6c-48b9-b8da-2520b1881f7b req-68317e6a-9317-4f40-9b5b-bc1840249c29 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035153 Apr 29 08:55:19.680985 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 230/449] 10.222.0.31 () {64 vars in 1317 bytes} [Fri Apr 29 08:55:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 29 08:55:19.828444 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-8c564a1d-d30f-4533-bc5b-6583537af294 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Calling method '>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:55:19.829351 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-8c564a1d-d30f-4533-bc5b-6583537af294 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] [instance: 21ab666e-c39f-4202-9e7a-aa431a96a130] Fetching instance by UUID {{(pid=123459) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:55:19.836807 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-8c564a1d-d30f-4533-bc5b-6583537af294 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:55:19.837190 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-8c564a1d-d30f-4533-bc5b-6583537af294 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:55:19.837979 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-8c564a1d-d30f-4533-bc5b-6583537af294 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:55:19.838565 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-8c564a1d-d30f-4533-bc5b-6583537af294 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:55:19.980367 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-1f1b9417-f16e-4cd8-99e4-e322f7731772 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Calling method '>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:55:19.981187 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-1f1b9417-f16e-4cd8-99e4-e322f7731772 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] [instance: 406b5ad6-698e-457f-93f4-cdfd45fb3e8e] Fetching instance by UUID {{(pid=123458) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:55:19.987023 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-8c564a1d-d30f-4533-bc5b-6583537af294 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e47ecdfb01f447699275b13255c15d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578e6a35974d4e5c8a0cd4e5fa994259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:55:19.988407 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-1f1b9417-f16e-4cd8-99e4-e322f7731772 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:55:19.988866 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-1f1b9417-f16e-4cd8-99e4-e322f7731772 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:55:19.989915 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-1f1b9417-f16e-4cd8-99e4-e322f7731772 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:55:19.990352 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-1f1b9417-f16e-4cd8-99e4-e322f7731772 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:55:19.995859 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-8c564a1d-d30f-4533-bc5b-6583537af294 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] 10.222.0.31 "GET /compute/v2.1/servers/21ab666e-c39f-4202-9e7a-aa431a96a130" status: 200 len: 1367 microversion: 2.1 time: 0.171160 Apr 29 08:55:19.996603 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 220/450] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 08:55:19 2022] GET /compute/v2.1/servers/21ab666e-c39f-4202-9e7a-aa431a96a130 => generated 1367 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 08:55:20.122947 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-1f1b9417-f16e-4cd8-99e4-e322f7731772 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:55:20.131342 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-1f1b9417-f16e-4cd8-99e4-e322f7731772 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:55:20.132878 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-1f1b9417-f16e-4cd8-99e4-e322f7731772 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:55:20.134019 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-1f1b9417-f16e-4cd8-99e4-e322f7731772 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] 10.222.0.31 "GET /compute/v2.1/servers/406b5ad6-698e-457f-93f4-cdfd45fb3e8e" status: 200 len: 1747 microversion: 2.20 time: 0.160004 Apr 29 08:55:20.134568 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 231/451] 10.222.0.31 () {60 vars in 1276 bytes} [Fri Apr 29 08:55:19 2022] GET /compute/v2.1/servers/406b5ad6-698e-457f-93f4-cdfd45fb3e8e => generated 1747 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 29 08:55:20.348715 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-835d658a-1905-4041-b112-2da3d6c7a7e2 tempest-VolumesSnapshotTestJSON-1697003112 tempest-VolumesSnapshotTestJSON-1697003112-project] Calling method '>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:55:20.349331 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-835d658a-1905-4041-b112-2da3d6c7a7e2 tempest-VolumesSnapshotTestJSON-1697003112 tempest-VolumesSnapshotTestJSON-1697003112-project] [instance: 4a2c7e29-e0ec-456b-bd06-ff7127f84e54] Fetching instance by UUID {{(pid=123459) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:55:20.355280 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-835d658a-1905-4041-b112-2da3d6c7a7e2 tempest-VolumesSnapshotTestJSON-1697003112 tempest-VolumesSnapshotTestJSON-1697003112-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:55:20.355721 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-835d658a-1905-4041-b112-2da3d6c7a7e2 tempest-VolumesSnapshotTestJSON-1697003112 tempest-VolumesSnapshotTestJSON-1697003112-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:55:20.356523 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-835d658a-1905-4041-b112-2da3d6c7a7e2 tempest-VolumesSnapshotTestJSON-1697003112 tempest-VolumesSnapshotTestJSON-1697003112-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:55:20.356956 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-835d658a-1905-4041-b112-2da3d6c7a7e2 tempest-VolumesSnapshotTestJSON-1697003112 tempest-VolumesSnapshotTestJSON-1697003112-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:55:20.494801 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-835d658a-1905-4041-b112-2da3d6c7a7e2 tempest-VolumesSnapshotTestJSON-1697003112 tempest-VolumesSnapshotTestJSON-1697003112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a210cf812fb54682ac28a13a5dce0563', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c0d26c7abcc4bc7b175ac175bb5f2ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:55:20.503052 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-835d658a-1905-4041-b112-2da3d6c7a7e2 tempest-VolumesSnapshotTestJSON-1697003112 tempest-VolumesSnapshotTestJSON-1697003112-project] 10.222.0.31 "GET /compute/v2.1/servers/4a2c7e29-e0ec-456b-bd06-ff7127f84e54" status: 200 len: 1319 microversion: 2.1 time: 0.158868 Apr 29 08:55:20.503632 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 221/452] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 08:55:20 2022] GET /compute/v2.1/servers/4a2c7e29-e0ec-456b-bd06-ff7127f84e54 => generated 1319 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 08:55:20.518094 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-29f0a4d2-a5be-4e8e-9386-4f0ac0dfbce8 tempest-VolumesNegativeTest-45234477 tempest-VolumesNegativeTest-45234477-project] Calling method '>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:55:20.518701 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-29f0a4d2-a5be-4e8e-9386-4f0ac0dfbce8 tempest-VolumesNegativeTest-45234477 tempest-VolumesNegativeTest-45234477-project] [instance: 1bcda922-2a2b-4382-9d9e-f083519473d8] Fetching instance by UUID {{(pid=123458) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:55:20.525415 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-29f0a4d2-a5be-4e8e-9386-4f0ac0dfbce8 tempest-VolumesNegativeTest-45234477 tempest-VolumesNegativeTest-45234477-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:55:20.525855 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-29f0a4d2-a5be-4e8e-9386-4f0ac0dfbce8 tempest-VolumesNegativeTest-45234477 tempest-VolumesNegativeTest-45234477-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:55:20.526611 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-29f0a4d2-a5be-4e8e-9386-4f0ac0dfbce8 tempest-VolumesNegativeTest-45234477 tempest-VolumesNegativeTest-45234477-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:55:20.527040 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-29f0a4d2-a5be-4e8e-9386-4f0ac0dfbce8 tempest-VolumesNegativeTest-45234477 tempest-VolumesNegativeTest-45234477-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:55:20.632448 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-13c18b52-7fc7-4ac0-b176-06c2df56d3f4 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Calling method '>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:55:20.633053 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-13c18b52-7fc7-4ac0-b176-06c2df56d3f4 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] [instance: 4e972e2b-7b5e-4a5f-87a1-3642aad3ac24] Fetching instance by UUID {{(pid=123459) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:55:20.639716 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-13c18b52-7fc7-4ac0-b176-06c2df56d3f4 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:55:20.640189 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-13c18b52-7fc7-4ac0-b176-06c2df56d3f4 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:55:20.640970 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-13c18b52-7fc7-4ac0-b176-06c2df56d3f4 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:55:20.641426 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-13c18b52-7fc7-4ac0-b176-06c2df56d3f4 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:55:20.667287 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-29f0a4d2-a5be-4e8e-9386-4f0ac0dfbce8 tempest-VolumesNegativeTest-45234477 tempest-VolumesNegativeTest-45234477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '340cefa576c947d08978a99d288304c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c9877c06a2445a3a34c5d35bafeb7a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:55:20.674957 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-29f0a4d2-a5be-4e8e-9386-4f0ac0dfbce8 tempest-VolumesNegativeTest-45234477 tempest-VolumesNegativeTest-45234477-project] 10.222.0.31 "GET /compute/v2.1/servers/1bcda922-2a2b-4382-9d9e-f083519473d8" status: 200 len: 1315 microversion: 2.1 time: 0.160618 Apr 29 08:55:20.675560 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 232/453] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 08:55:20 2022] GET /compute/v2.1/servers/1bcda922-2a2b-4382-9d9e-f083519473d8 => generated 1315 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 08:55:20.777314 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-13c18b52-7fc7-4ac0-b176-06c2df56d3f4 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c18e88436f14dc7a2001220b87ce9ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60998f08c40446e787ead285e40665b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:55:20.784743 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-13c18b52-7fc7-4ac0-b176-06c2df56d3f4 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] 10.222.0.31 "GET /compute/v2.1/servers/4e972e2b-7b5e-4a5f-87a1-3642aad3ac24" status: 200 len: 1510 microversion: 2.1 time: 0.156856 Apr 29 08:55:20.786055 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 222/454] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 08:55:20 2022] GET /compute/v2.1/servers/4e972e2b-7b5e-4a5f-87a1-3642aad3ac24 => generated 1510 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 29 08:55:21.013238 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-2a2a11e1-b5e1-4488-bf4f-4c35326c36ad tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Calling method '>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:55:21.013791 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-2a2a11e1-b5e1-4488-bf4f-4c35326c36ad tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] [instance: 21ab666e-c39f-4202-9e7a-aa431a96a130] Fetching instance by UUID {{(pid=123458) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:55:21.020934 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-2a2a11e1-b5e1-4488-bf4f-4c35326c36ad tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:55:21.021410 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-2a2a11e1-b5e1-4488-bf4f-4c35326c36ad tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:55:21.022177 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-2a2a11e1-b5e1-4488-bf4f-4c35326c36ad tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:55:21.022621 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-2a2a11e1-b5e1-4488-bf4f-4c35326c36ad tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:55:21.153478 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-8d7a92f6-2cd5-4474-97b6-aad1a8b61422 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Calling method '>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:55:21.154128 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-8d7a92f6-2cd5-4474-97b6-aad1a8b61422 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] [instance: 406b5ad6-698e-457f-93f4-cdfd45fb3e8e] Fetching instance by UUID {{(pid=123459) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:55:21.162792 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-8d7a92f6-2cd5-4474-97b6-aad1a8b61422 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:55:21.164627 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-8d7a92f6-2cd5-4474-97b6-aad1a8b61422 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:55:21.165494 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-8d7a92f6-2cd5-4474-97b6-aad1a8b61422 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:55:21.165943 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-8d7a92f6-2cd5-4474-97b6-aad1a8b61422 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:55:21.174980 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-2a2a11e1-b5e1-4488-bf4f-4c35326c36ad tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e47ecdfb01f447699275b13255c15d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578e6a35974d4e5c8a0cd4e5fa994259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:55:21.183845 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-2a2a11e1-b5e1-4488-bf4f-4c35326c36ad tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] 10.222.0.31 "GET /compute/v2.1/servers/21ab666e-c39f-4202-9e7a-aa431a96a130" status: 200 len: 1367 microversion: 2.1 time: 0.174546 Apr 29 08:55:21.184672 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 233/455] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 08:55:21 2022] GET /compute/v2.1/servers/21ab666e-c39f-4202-9e7a-aa431a96a130 => generated 1367 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 29 08:55:21.448072 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [req-ff1c9fe4-a68d-41d4-8e22-6f3debbed977 req-696aa15e-aec9-4e11-a300-b2b2433b8a43 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1bcda922-2a2b-4382-9d9e-f083519473d8", "name": "network-vif-plugged", "status": "completed", "tag": "d36cb7cb-6510-45a5-844a-79c10ae9bc6d"}]} {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 29 08:55:21.459566 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [req-ff1c9fe4-a68d-41d4-8e22-6f3debbed977 req-696aa15e-aec9-4e11-a300-b2b2433b8a43 service nova] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:55:21.460390 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [req-ff1c9fe4-a68d-41d4-8e22-6f3debbed977 req-696aa15e-aec9-4e11-a300-b2b2433b8a43 service nova] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:55:21.480387 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.compute.server_external_events [req-ff1c9fe4-a68d-41d4-8e22-6f3debbed977 req-696aa15e-aec9-4e11-a300-b2b2433b8a43 service nova] Creating event network-vif-plugged:d36cb7cb-6510-45a5-844a-79c10ae9bc6d for instance 1bcda922-2a2b-4382-9d9e-f083519473d8 on hv-cinder-83987 Apr 29 08:55:21.487132 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [req-ff1c9fe4-a68d-41d4-8e22-6f3debbed977 req-696aa15e-aec9-4e11-a300-b2b2433b8a43 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044135 Apr 29 08:55:21.488115 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 234/456] 10.222.0.31 () {64 vars in 1317 bytes} [Fri Apr 29 08:55:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 29 08:55:21.521857 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-5168f4e6-51c2-4c04-ad2e-a9623f74f5d6 tempest-VolumesSnapshotTestJSON-1697003112 tempest-VolumesSnapshotTestJSON-1697003112-project] Calling method '>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:55:21.522527 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-5168f4e6-51c2-4c04-ad2e-a9623f74f5d6 tempest-VolumesSnapshotTestJSON-1697003112 tempest-VolumesSnapshotTestJSON-1697003112-project] [instance: 4a2c7e29-e0ec-456b-bd06-ff7127f84e54] Fetching instance by UUID {{(pid=123458) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:55:21.532974 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-8d7a92f6-2cd5-4474-97b6-aad1a8b61422 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:55:21.538977 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-5168f4e6-51c2-4c04-ad2e-a9623f74f5d6 tempest-VolumesSnapshotTestJSON-1697003112 tempest-VolumesSnapshotTestJSON-1697003112-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:55:21.539695 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-5168f4e6-51c2-4c04-ad2e-a9623f74f5d6 tempest-VolumesSnapshotTestJSON-1697003112 tempest-VolumesSnapshotTestJSON-1697003112-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:55:21.541319 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-5168f4e6-51c2-4c04-ad2e-a9623f74f5d6 tempest-VolumesSnapshotTestJSON-1697003112 tempest-VolumesSnapshotTestJSON-1697003112-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:55:21.542000 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-5168f4e6-51c2-4c04-ad2e-a9623f74f5d6 tempest-VolumesSnapshotTestJSON-1697003112 tempest-VolumesSnapshotTestJSON-1697003112-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:55:21.547474 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-8d7a92f6-2cd5-4474-97b6-aad1a8b61422 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:55:21.549168 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-8d7a92f6-2cd5-4474-97b6-aad1a8b61422 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:55:21.550631 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-8d7a92f6-2cd5-4474-97b6-aad1a8b61422 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] 10.222.0.31 "GET /compute/v2.1/servers/406b5ad6-698e-457f-93f4-cdfd45fb3e8e" status: 200 len: 1747 microversion: 2.20 time: 0.401090 Apr 29 08:55:21.552264 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 223/457] 10.222.0.31 () {60 vars in 1276 bytes} [Fri Apr 29 08:55:21 2022] GET /compute/v2.1/servers/406b5ad6-698e-457f-93f4-cdfd45fb3e8e => generated 1747 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 29 08:55:21.687184 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-5168f4e6-51c2-4c04-ad2e-a9623f74f5d6 tempest-VolumesSnapshotTestJSON-1697003112 tempest-VolumesSnapshotTestJSON-1697003112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a210cf812fb54682ac28a13a5dce0563', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c0d26c7abcc4bc7b175ac175bb5f2ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:55:21.693707 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-a19a6310-8f11-40cb-88cd-e59533fb5681 tempest-VolumesNegativeTest-45234477 tempest-VolumesNegativeTest-45234477-project] Calling method '>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:55:21.694504 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-a19a6310-8f11-40cb-88cd-e59533fb5681 tempest-VolumesNegativeTest-45234477 tempest-VolumesNegativeTest-45234477-project] [instance: 1bcda922-2a2b-4382-9d9e-f083519473d8] Fetching instance by UUID {{(pid=123459) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:55:21.695423 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-5168f4e6-51c2-4c04-ad2e-a9623f74f5d6 tempest-VolumesSnapshotTestJSON-1697003112 tempest-VolumesSnapshotTestJSON-1697003112-project] 10.222.0.31 "GET /compute/v2.1/servers/4a2c7e29-e0ec-456b-bd06-ff7127f84e54" status: 200 len: 1319 microversion: 2.1 time: 0.179263 Apr 29 08:55:21.702958 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-a19a6310-8f11-40cb-88cd-e59533fb5681 tempest-VolumesNegativeTest-45234477 tempest-VolumesNegativeTest-45234477-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:55:21.703786 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-a19a6310-8f11-40cb-88cd-e59533fb5681 tempest-VolumesNegativeTest-45234477 tempest-VolumesNegativeTest-45234477-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:55:21.704699 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-a19a6310-8f11-40cb-88cd-e59533fb5681 tempest-VolumesNegativeTest-45234477 tempest-VolumesNegativeTest-45234477-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:55:21.705352 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-a19a6310-8f11-40cb-88cd-e59533fb5681 tempest-VolumesNegativeTest-45234477 tempest-VolumesNegativeTest-45234477-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:55:21.705752 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 235/458] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 08:55:21 2022] GET /compute/v2.1/servers/4a2c7e29-e0ec-456b-bd06-ff7127f84e54 => generated 1319 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 08:55:21.803830 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-b364bd55-0201-4c1c-9c92-e1b57753bf0e tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Calling method '>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:55:21.805317 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-b364bd55-0201-4c1c-9c92-e1b57753bf0e tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] [instance: 4e972e2b-7b5e-4a5f-87a1-3642aad3ac24] Fetching instance by UUID {{(pid=123458) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:55:21.816921 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-b364bd55-0201-4c1c-9c92-e1b57753bf0e tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:55:21.817802 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-b364bd55-0201-4c1c-9c92-e1b57753bf0e tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:55:21.819333 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-b364bd55-0201-4c1c-9c92-e1b57753bf0e tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:55:21.820448 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-b364bd55-0201-4c1c-9c92-e1b57753bf0e tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:55:21.838655 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-a19a6310-8f11-40cb-88cd-e59533fb5681 tempest-VolumesNegativeTest-45234477 tempest-VolumesNegativeTest-45234477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '340cefa576c947d08978a99d288304c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c9877c06a2445a3a34c5d35bafeb7a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:55:21.845952 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-a19a6310-8f11-40cb-88cd-e59533fb5681 tempest-VolumesNegativeTest-45234477 tempest-VolumesNegativeTest-45234477-project] 10.222.0.31 "GET /compute/v2.1/servers/1bcda922-2a2b-4382-9d9e-f083519473d8" status: 200 len: 1315 microversion: 2.1 time: 0.157721 Apr 29 08:55:21.846514 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 224/459] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 08:55:21 2022] GET /compute/v2.1/servers/1bcda922-2a2b-4382-9d9e-f083519473d8 => generated 1315 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 29 08:55:21.977376 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-b364bd55-0201-4c1c-9c92-e1b57753bf0e tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c18e88436f14dc7a2001220b87ce9ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60998f08c40446e787ead285e40665b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:55:21.985075 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-b364bd55-0201-4c1c-9c92-e1b57753bf0e tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] 10.222.0.31 "GET /compute/v2.1/servers/4e972e2b-7b5e-4a5f-87a1-3642aad3ac24" status: 200 len: 1510 microversion: 2.1 time: 0.186173 Apr 29 08:55:21.985648 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 236/460] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 08:55:21 2022] GET /compute/v2.1/servers/4e972e2b-7b5e-4a5f-87a1-3642aad3ac24 => generated 1510 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 29 08:55:22.204007 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-4e4ee316-f330-4451-90d5-85f8d661f58a tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Calling method '>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:55:22.204571 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-4e4ee316-f330-4451-90d5-85f8d661f58a tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] [instance: 21ab666e-c39f-4202-9e7a-aa431a96a130] Fetching instance by UUID {{(pid=123459) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:55:22.210836 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-4e4ee316-f330-4451-90d5-85f8d661f58a tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:55:22.211282 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-4e4ee316-f330-4451-90d5-85f8d661f58a tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:55:22.212077 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-4e4ee316-f330-4451-90d5-85f8d661f58a tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:55:22.212543 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-4e4ee316-f330-4451-90d5-85f8d661f58a tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:55:22.348391 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-4e4ee316-f330-4451-90d5-85f8d661f58a tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e47ecdfb01f447699275b13255c15d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578e6a35974d4e5c8a0cd4e5fa994259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:55:22.355792 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-4e4ee316-f330-4451-90d5-85f8d661f58a tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] 10.222.0.31 "GET /compute/v2.1/servers/21ab666e-c39f-4202-9e7a-aa431a96a130" status: 200 len: 1367 microversion: 2.1 time: 0.155645 Apr 29 08:55:22.356398 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 225/461] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 08:55:22 2022] GET /compute/v2.1/servers/21ab666e-c39f-4202-9e7a-aa431a96a130 => generated 1367 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 08:55:22.569402 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-2aa665bc-f8c7-4c4c-9e0b-dc3de4bf4b51 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Calling method '>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:55:22.570251 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-2aa665bc-f8c7-4c4c-9e0b-dc3de4bf4b51 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] [instance: 406b5ad6-698e-457f-93f4-cdfd45fb3e8e] Fetching instance by UUID {{(pid=123458) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:55:22.576253 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-2aa665bc-f8c7-4c4c-9e0b-dc3de4bf4b51 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:55:22.576699 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-2aa665bc-f8c7-4c4c-9e0b-dc3de4bf4b51 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:55:22.577462 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-2aa665bc-f8c7-4c4c-9e0b-dc3de4bf4b51 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:55:22.577893 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-2aa665bc-f8c7-4c4c-9e0b-dc3de4bf4b51 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:55:22.704583 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-2aa665bc-f8c7-4c4c-9e0b-dc3de4bf4b51 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:55:22.713645 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-ed296087-3fef-439e-8fe5-0fbe2fff8eba tempest-VolumesSnapshotTestJSON-1697003112 tempest-VolumesSnapshotTestJSON-1697003112-project] Calling method '>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:55:22.714847 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-ed296087-3fef-439e-8fe5-0fbe2fff8eba tempest-VolumesSnapshotTestJSON-1697003112 tempest-VolumesSnapshotTestJSON-1697003112-project] [instance: 4a2c7e29-e0ec-456b-bd06-ff7127f84e54] Fetching instance by UUID {{(pid=123459) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:55:22.714943 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-2aa665bc-f8c7-4c4c-9e0b-dc3de4bf4b51 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:55:22.716090 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-2aa665bc-f8c7-4c4c-9e0b-dc3de4bf4b51 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:55:22.717280 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-2aa665bc-f8c7-4c4c-9e0b-dc3de4bf4b51 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] 10.222.0.31 "GET /compute/v2.1/servers/406b5ad6-698e-457f-93f4-cdfd45fb3e8e" status: 200 len: 1747 microversion: 2.20 time: 0.151835 Apr 29 08:55:22.717927 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 237/462] 10.222.0.31 () {60 vars in 1276 bytes} [Fri Apr 29 08:55:22 2022] GET /compute/v2.1/servers/406b5ad6-698e-457f-93f4-cdfd45fb3e8e => generated 1747 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 29 08:55:22.720805 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-ed296087-3fef-439e-8fe5-0fbe2fff8eba tempest-VolumesSnapshotTestJSON-1697003112 tempest-VolumesSnapshotTestJSON-1697003112-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:55:22.721259 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-ed296087-3fef-439e-8fe5-0fbe2fff8eba tempest-VolumesSnapshotTestJSON-1697003112 tempest-VolumesSnapshotTestJSON-1697003112-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:55:22.722036 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-ed296087-3fef-439e-8fe5-0fbe2fff8eba tempest-VolumesSnapshotTestJSON-1697003112 tempest-VolumesSnapshotTestJSON-1697003112-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:55:22.722478 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-ed296087-3fef-439e-8fe5-0fbe2fff8eba tempest-VolumesSnapshotTestJSON-1697003112 tempest-VolumesSnapshotTestJSON-1697003112-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:55:22.848223 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-ed296087-3fef-439e-8fe5-0fbe2fff8eba tempest-VolumesSnapshotTestJSON-1697003112 tempest-VolumesSnapshotTestJSON-1697003112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a210cf812fb54682ac28a13a5dce0563', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c0d26c7abcc4bc7b175ac175bb5f2ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:55:22.855667 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-ed296087-3fef-439e-8fe5-0fbe2fff8eba tempest-VolumesSnapshotTestJSON-1697003112 tempest-VolumesSnapshotTestJSON-1697003112-project] 10.222.0.31 "GET /compute/v2.1/servers/4a2c7e29-e0ec-456b-bd06-ff7127f84e54" status: 200 len: 1319 microversion: 2.1 time: 0.146525 Apr 29 08:55:22.856267 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 226/463] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 08:55:22 2022] GET /compute/v2.1/servers/4a2c7e29-e0ec-456b-bd06-ff7127f84e54 => generated 1319 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 29 08:55:22.862537 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-8379c01f-f62b-479d-ab7b-708299324020 tempest-VolumesNegativeTest-45234477 tempest-VolumesNegativeTest-45234477-project] Calling method '>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:55:22.863828 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-8379c01f-f62b-479d-ab7b-708299324020 tempest-VolumesNegativeTest-45234477 tempest-VolumesNegativeTest-45234477-project] [instance: 1bcda922-2a2b-4382-9d9e-f083519473d8] Fetching instance by UUID {{(pid=123458) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:55:22.870290 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-8379c01f-f62b-479d-ab7b-708299324020 tempest-VolumesNegativeTest-45234477 tempest-VolumesNegativeTest-45234477-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:55:22.870854 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-8379c01f-f62b-479d-ab7b-708299324020 tempest-VolumesNegativeTest-45234477 tempest-VolumesNegativeTest-45234477-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:55:22.871492 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-8379c01f-f62b-479d-ab7b-708299324020 tempest-VolumesNegativeTest-45234477 tempest-VolumesNegativeTest-45234477-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:55:22.871916 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-8379c01f-f62b-479d-ab7b-708299324020 tempest-VolumesNegativeTest-45234477 tempest-VolumesNegativeTest-45234477-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:55:23.002676 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-97211c76-fd67-4cae-b783-1f4c4395b8b5 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Calling method '>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:55:23.003291 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-97211c76-fd67-4cae-b783-1f4c4395b8b5 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] [instance: 4e972e2b-7b5e-4a5f-87a1-3642aad3ac24] Fetching instance by UUID {{(pid=123459) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:55:23.005646 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-8379c01f-f62b-479d-ab7b-708299324020 tempest-VolumesNegativeTest-45234477 tempest-VolumesNegativeTest-45234477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '340cefa576c947d08978a99d288304c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c9877c06a2445a3a34c5d35bafeb7a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:55:23.009890 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-97211c76-fd67-4cae-b783-1f4c4395b8b5 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:55:23.010337 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-97211c76-fd67-4cae-b783-1f4c4395b8b5 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:55:23.011116 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-97211c76-fd67-4cae-b783-1f4c4395b8b5 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:55:23.011548 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-97211c76-fd67-4cae-b783-1f4c4395b8b5 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:55:23.013182 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-8379c01f-f62b-479d-ab7b-708299324020 tempest-VolumesNegativeTest-45234477 tempest-VolumesNegativeTest-45234477-project] 10.222.0.31 "GET /compute/v2.1/servers/1bcda922-2a2b-4382-9d9e-f083519473d8" status: 200 len: 1315 microversion: 2.1 time: 0.154402 Apr 29 08:55:23.013760 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 238/464] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 08:55:22 2022] GET /compute/v2.1/servers/1bcda922-2a2b-4382-9d9e-f083519473d8 => generated 1315 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 08:55:23.139815 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-97211c76-fd67-4cae-b783-1f4c4395b8b5 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c18e88436f14dc7a2001220b87ce9ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60998f08c40446e787ead285e40665b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:55:23.148114 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-97211c76-fd67-4cae-b783-1f4c4395b8b5 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] 10.222.0.31 "GET /compute/v2.1/servers/4e972e2b-7b5e-4a5f-87a1-3642aad3ac24" status: 200 len: 1510 microversion: 2.1 time: 0.149175 Apr 29 08:55:23.148931 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 227/465] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 08:55:22 2022] GET /compute/v2.1/servers/4e972e2b-7b5e-4a5f-87a1-3642aad3ac24 => generated 1510 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 29 08:55:23.374500 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-1c02f284-44be-4fd3-b757-51ff32003e32 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Calling method '>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:55:23.375122 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-1c02f284-44be-4fd3-b757-51ff32003e32 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] [instance: 21ab666e-c39f-4202-9e7a-aa431a96a130] Fetching instance by UUID {{(pid=123458) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:55:23.382017 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-1c02f284-44be-4fd3-b757-51ff32003e32 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:55:23.382470 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-1c02f284-44be-4fd3-b757-51ff32003e32 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:55:23.383260 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-1c02f284-44be-4fd3-b757-51ff32003e32 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:55:23.383699 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-1c02f284-44be-4fd3-b757-51ff32003e32 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:55:23.504395 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [req-ee9d3424-359e-4324-9565-8d1ff851f7d0 req-8720b8aa-ec10-45e5-893c-21c2dd29dcfa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "406b5ad6-698e-457f-93f4-cdfd45fb3e8e", "name": "network-vif-plugged", "status": "completed", "tag": "afdeb60c-c7b1-441b-90f4-293273965fad"}]} {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 29 08:55:23.514250 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [req-ee9d3424-359e-4324-9565-8d1ff851f7d0 req-8720b8aa-ec10-45e5-893c-21c2dd29dcfa service nova] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:55:23.514812 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [req-ee9d3424-359e-4324-9565-8d1ff851f7d0 req-8720b8aa-ec10-45e5-893c-21c2dd29dcfa service nova] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:55:23.526793 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.compute.server_external_events [req-ee9d3424-359e-4324-9565-8d1ff851f7d0 req-8720b8aa-ec10-45e5-893c-21c2dd29dcfa service nova] Creating event network-vif-plugged:afdeb60c-c7b1-441b-90f4-293273965fad for instance 406b5ad6-698e-457f-93f4-cdfd45fb3e8e on hv-cinder-83987 Apr 29 08:55:23.529941 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-1c02f284-44be-4fd3-b757-51ff32003e32 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e47ecdfb01f447699275b13255c15d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578e6a35974d4e5c8a0cd4e5fa994259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:55:23.531896 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [req-ee9d3424-359e-4324-9565-8d1ff851f7d0 req-8720b8aa-ec10-45e5-893c-21c2dd29dcfa service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031260 Apr 29 08:55:23.532534 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 228/466] 10.222.0.31 () {64 vars in 1317 bytes} [Fri Apr 29 08:55:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 29 08:55:23.537781 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-1c02f284-44be-4fd3-b757-51ff32003e32 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] 10.222.0.31 "GET /compute/v2.1/servers/21ab666e-c39f-4202-9e7a-aa431a96a130" status: 200 len: 1367 microversion: 2.1 time: 0.167354 Apr 29 08:55:23.538356 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 239/467] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 08:55:23 2022] GET /compute/v2.1/servers/21ab666e-c39f-4202-9e7a-aa431a96a130 => generated 1367 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 08:55:23.735856 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-ee97d8a2-274e-4416-afff-4207a1acb6c0 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Calling method '>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:55:23.736581 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-ee97d8a2-274e-4416-afff-4207a1acb6c0 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] [instance: 406b5ad6-698e-457f-93f4-cdfd45fb3e8e] Fetching instance by UUID {{(pid=123459) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:55:23.743606 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-ee97d8a2-274e-4416-afff-4207a1acb6c0 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:55:23.744055 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-ee97d8a2-274e-4416-afff-4207a1acb6c0 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:55:23.744847 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-ee97d8a2-274e-4416-afff-4207a1acb6c0 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:55:23.745287 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-ee97d8a2-274e-4416-afff-4207a1acb6c0 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:55:23.873175 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-8fcf895a-4ea3-41da-a972-61d16c3eb6b8 tempest-VolumesSnapshotTestJSON-1697003112 tempest-VolumesSnapshotTestJSON-1697003112-project] Calling method '>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:55:23.873906 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-8fcf895a-4ea3-41da-a972-61d16c3eb6b8 tempest-VolumesSnapshotTestJSON-1697003112 tempest-VolumesSnapshotTestJSON-1697003112-project] [instance: 4a2c7e29-e0ec-456b-bd06-ff7127f84e54] Fetching instance by UUID {{(pid=123458) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:55:23.877736 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-ee97d8a2-274e-4416-afff-4207a1acb6c0 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:55:23.880712 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-8fcf895a-4ea3-41da-a972-61d16c3eb6b8 tempest-VolumesSnapshotTestJSON-1697003112 tempest-VolumesSnapshotTestJSON-1697003112-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:55:23.881162 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-8fcf895a-4ea3-41da-a972-61d16c3eb6b8 tempest-VolumesSnapshotTestJSON-1697003112 tempest-VolumesSnapshotTestJSON-1697003112-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:55:23.881943 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-8fcf895a-4ea3-41da-a972-61d16c3eb6b8 tempest-VolumesSnapshotTestJSON-1697003112 tempest-VolumesSnapshotTestJSON-1697003112-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:55:23.882382 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-8fcf895a-4ea3-41da-a972-61d16c3eb6b8 tempest-VolumesSnapshotTestJSON-1697003112 tempest-VolumesSnapshotTestJSON-1697003112-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:55:23.886985 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-ee97d8a2-274e-4416-afff-4207a1acb6c0 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:55:23.888503 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-ee97d8a2-274e-4416-afff-4207a1acb6c0 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:55:23.889652 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-ee97d8a2-274e-4416-afff-4207a1acb6c0 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] 10.222.0.31 "GET /compute/v2.1/servers/406b5ad6-698e-457f-93f4-cdfd45fb3e8e" status: 200 len: 1747 microversion: 2.20 time: 0.158518 Apr 29 08:55:23.890197 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 229/468] 10.222.0.31 () {60 vars in 1276 bytes} [Fri Apr 29 08:55:23 2022] GET /compute/v2.1/servers/406b5ad6-698e-457f-93f4-cdfd45fb3e8e => generated 1747 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 29 08:55:24.011516 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-8fcf895a-4ea3-41da-a972-61d16c3eb6b8 tempest-VolumesSnapshotTestJSON-1697003112 tempest-VolumesSnapshotTestJSON-1697003112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a210cf812fb54682ac28a13a5dce0563', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c0d26c7abcc4bc7b175ac175bb5f2ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:55:24.018869 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-8fcf895a-4ea3-41da-a972-61d16c3eb6b8 tempest-VolumesSnapshotTestJSON-1697003112 tempest-VolumesSnapshotTestJSON-1697003112-project] 10.222.0.31 "GET /compute/v2.1/servers/4a2c7e29-e0ec-456b-bd06-ff7127f84e54" status: 200 len: 1319 microversion: 2.1 time: 0.149660 Apr 29 08:55:24.019433 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 240/469] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 08:55:23 2022] GET /compute/v2.1/servers/4a2c7e29-e0ec-456b-bd06-ff7127f84e54 => generated 1319 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 29 08:55:24.029581 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-e476b90c-5058-4481-b661-5a055c57d17d tempest-VolumesNegativeTest-45234477 tempest-VolumesNegativeTest-45234477-project] Calling method '>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:55:24.030286 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-e476b90c-5058-4481-b661-5a055c57d17d tempest-VolumesNegativeTest-45234477 tempest-VolumesNegativeTest-45234477-project] [instance: 1bcda922-2a2b-4382-9d9e-f083519473d8] Fetching instance by UUID {{(pid=123459) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:55:24.036858 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-e476b90c-5058-4481-b661-5a055c57d17d tempest-VolumesNegativeTest-45234477 tempest-VolumesNegativeTest-45234477-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:55:24.037307 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-e476b90c-5058-4481-b661-5a055c57d17d tempest-VolumesNegativeTest-45234477 tempest-VolumesNegativeTest-45234477-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:55:24.038073 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-e476b90c-5058-4481-b661-5a055c57d17d tempest-VolumesNegativeTest-45234477 tempest-VolumesNegativeTest-45234477-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:55:24.038507 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-e476b90c-5058-4481-b661-5a055c57d17d tempest-VolumesNegativeTest-45234477 tempest-VolumesNegativeTest-45234477-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:55:24.165463 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-ba77cf16-0a06-428b-b624-be4cadc247b6 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Calling method '>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:55:24.166173 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-ba77cf16-0a06-428b-b624-be4cadc247b6 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] [instance: 4e972e2b-7b5e-4a5f-87a1-3642aad3ac24] Fetching instance by UUID {{(pid=123458) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:55:24.172439 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-ba77cf16-0a06-428b-b624-be4cadc247b6 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:55:24.172988 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-ba77cf16-0a06-428b-b624-be4cadc247b6 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:55:24.173861 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-ba77cf16-0a06-428b-b624-be4cadc247b6 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:55:24.174366 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-ba77cf16-0a06-428b-b624-be4cadc247b6 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:55:24.179928 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-e476b90c-5058-4481-b661-5a055c57d17d tempest-VolumesNegativeTest-45234477 tempest-VolumesNegativeTest-45234477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '340cefa576c947d08978a99d288304c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c9877c06a2445a3a34c5d35bafeb7a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:55:24.188216 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-e476b90c-5058-4481-b661-5a055c57d17d tempest-VolumesNegativeTest-45234477 tempest-VolumesNegativeTest-45234477-project] 10.222.0.31 "GET /compute/v2.1/servers/1bcda922-2a2b-4382-9d9e-f083519473d8" status: 200 len: 1315 microversion: 2.1 time: 0.162211 Apr 29 08:55:24.189078 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 230/470] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 08:55:24 2022] GET /compute/v2.1/servers/1bcda922-2a2b-4382-9d9e-f083519473d8 => generated 1315 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 08:55:24.333812 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-ba77cf16-0a06-428b-b624-be4cadc247b6 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c18e88436f14dc7a2001220b87ce9ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60998f08c40446e787ead285e40665b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:55:24.341231 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-ba77cf16-0a06-428b-b624-be4cadc247b6 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] 10.222.0.31 "GET /compute/v2.1/servers/4e972e2b-7b5e-4a5f-87a1-3642aad3ac24" status: 200 len: 1516 microversion: 2.1 time: 0.180017 Apr 29 08:55:24.341797 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 241/471] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 08:55:24 2022] GET /compute/v2.1/servers/4e972e2b-7b5e-4a5f-87a1-3642aad3ac24 => generated 1516 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 29 08:55:24.556018 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-3973dd8a-4e42-47bf-8df5-a2bb0ad09db0 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Calling method '>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:55:24.556287 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-3973dd8a-4e42-47bf-8df5-a2bb0ad09db0 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] [instance: 21ab666e-c39f-4202-9e7a-aa431a96a130] Fetching instance by UUID {{(pid=123459) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:55:24.570902 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-3973dd8a-4e42-47bf-8df5-a2bb0ad09db0 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:55:24.570902 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-3973dd8a-4e42-47bf-8df5-a2bb0ad09db0 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:55:24.570902 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-3973dd8a-4e42-47bf-8df5-a2bb0ad09db0 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:55:24.570902 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-3973dd8a-4e42-47bf-8df5-a2bb0ad09db0 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:55:24.709411 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-3973dd8a-4e42-47bf-8df5-a2bb0ad09db0 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e47ecdfb01f447699275b13255c15d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578e6a35974d4e5c8a0cd4e5fa994259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:55:24.716900 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-3973dd8a-4e42-47bf-8df5-a2bb0ad09db0 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] 10.222.0.31 "GET /compute/v2.1/servers/21ab666e-c39f-4202-9e7a-aa431a96a130" status: 200 len: 1367 microversion: 2.1 time: 0.165133 Apr 29 08:55:24.717478 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 231/472] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 08:55:24 2022] GET /compute/v2.1/servers/21ab666e-c39f-4202-9e7a-aa431a96a130 => generated 1367 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 29 08:55:24.907147 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-b4177be3-33e1-42c0-b569-066d8d66adaa tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Calling method '>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:55:24.907756 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-b4177be3-33e1-42c0-b569-066d8d66adaa tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] [instance: 406b5ad6-698e-457f-93f4-cdfd45fb3e8e] Fetching instance by UUID {{(pid=123458) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:55:24.914066 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-b4177be3-33e1-42c0-b569-066d8d66adaa tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:55:24.914508 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-b4177be3-33e1-42c0-b569-066d8d66adaa tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:55:24.915279 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-b4177be3-33e1-42c0-b569-066d8d66adaa tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:55:24.915712 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-b4177be3-33e1-42c0-b569-066d8d66adaa tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:55:25.034799 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-dc67f323-4bba-4b05-a288-f1f5da7bb92b tempest-VolumesSnapshotTestJSON-1697003112 tempest-VolumesSnapshotTestJSON-1697003112-project] Calling method '>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:55:25.035595 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-dc67f323-4bba-4b05-a288-f1f5da7bb92b tempest-VolumesSnapshotTestJSON-1697003112 tempest-VolumesSnapshotTestJSON-1697003112-project] [instance: 4a2c7e29-e0ec-456b-bd06-ff7127f84e54] Fetching instance by UUID {{(pid=123459) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:55:25.041810 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-dc67f323-4bba-4b05-a288-f1f5da7bb92b tempest-VolumesSnapshotTestJSON-1697003112 tempest-VolumesSnapshotTestJSON-1697003112-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:55:25.042264 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-dc67f323-4bba-4b05-a288-f1f5da7bb92b tempest-VolumesSnapshotTestJSON-1697003112 tempest-VolumesSnapshotTestJSON-1697003112-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:55:25.043047 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-dc67f323-4bba-4b05-a288-f1f5da7bb92b tempest-VolumesSnapshotTestJSON-1697003112 tempest-VolumesSnapshotTestJSON-1697003112-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:55:25.043486 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-dc67f323-4bba-4b05-a288-f1f5da7bb92b tempest-VolumesSnapshotTestJSON-1697003112 tempest-VolumesSnapshotTestJSON-1697003112-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:55:25.163390 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-b4177be3-33e1-42c0-b569-066d8d66adaa tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:55:25.172214 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-b4177be3-33e1-42c0-b569-066d8d66adaa tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:55:25.173875 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-b4177be3-33e1-42c0-b569-066d8d66adaa tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:55:25.175040 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-b4177be3-33e1-42c0-b569-066d8d66adaa tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] 10.222.0.31 "GET /compute/v2.1/servers/406b5ad6-698e-457f-93f4-cdfd45fb3e8e" status: 200 len: 1747 microversion: 2.20 time: 0.271769 Apr 29 08:55:25.175567 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-dc67f323-4bba-4b05-a288-f1f5da7bb92b tempest-VolumesSnapshotTestJSON-1697003112 tempest-VolumesSnapshotTestJSON-1697003112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a210cf812fb54682ac28a13a5dce0563', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c0d26c7abcc4bc7b175ac175bb5f2ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:55:25.176887 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 242/473] 10.222.0.31 () {60 vars in 1276 bytes} [Fri Apr 29 08:55:24 2022] GET /compute/v2.1/servers/406b5ad6-698e-457f-93f4-cdfd45fb3e8e => generated 1747 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 29 08:55:25.183834 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-dc67f323-4bba-4b05-a288-f1f5da7bb92b tempest-VolumesSnapshotTestJSON-1697003112 tempest-VolumesSnapshotTestJSON-1697003112-project] 10.222.0.31 "GET /compute/v2.1/servers/4a2c7e29-e0ec-456b-bd06-ff7127f84e54" status: 200 len: 1319 microversion: 2.1 time: 0.152740 Apr 29 08:55:25.184528 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 232/474] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 08:55:25 2022] GET /compute/v2.1/servers/4a2c7e29-e0ec-456b-bd06-ff7127f84e54 => generated 1319 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 29 08:55:25.205545 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-66bc4ae4-b257-47d0-b6d3-900781ba6a54 tempest-VolumesNegativeTest-45234477 tempest-VolumesNegativeTest-45234477-project] Calling method '>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:55:25.206160 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-66bc4ae4-b257-47d0-b6d3-900781ba6a54 tempest-VolumesNegativeTest-45234477 tempest-VolumesNegativeTest-45234477-project] [instance: 1bcda922-2a2b-4382-9d9e-f083519473d8] Fetching instance by UUID {{(pid=123458) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:55:25.212230 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-66bc4ae4-b257-47d0-b6d3-900781ba6a54 tempest-VolumesNegativeTest-45234477 tempest-VolumesNegativeTest-45234477-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:55:25.212683 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-66bc4ae4-b257-47d0-b6d3-900781ba6a54 tempest-VolumesNegativeTest-45234477 tempest-VolumesNegativeTest-45234477-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:55:25.213456 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-66bc4ae4-b257-47d0-b6d3-900781ba6a54 tempest-VolumesNegativeTest-45234477 tempest-VolumesNegativeTest-45234477-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:55:25.213890 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-66bc4ae4-b257-47d0-b6d3-900781ba6a54 tempest-VolumesNegativeTest-45234477 tempest-VolumesNegativeTest-45234477-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:55:25.345985 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-66bc4ae4-b257-47d0-b6d3-900781ba6a54 tempest-VolumesNegativeTest-45234477 tempest-VolumesNegativeTest-45234477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '340cefa576c947d08978a99d288304c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c9877c06a2445a3a34c5d35bafeb7a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:55:25.353853 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-66bc4ae4-b257-47d0-b6d3-900781ba6a54 tempest-VolumesNegativeTest-45234477 tempest-VolumesNegativeTest-45234477-project] 10.222.0.31 "GET /compute/v2.1/servers/1bcda922-2a2b-4382-9d9e-f083519473d8" status: 200 len: 1315 microversion: 2.1 time: 0.152100 Apr 29 08:55:25.354417 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 243/475] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 08:55:25 2022] GET /compute/v2.1/servers/1bcda922-2a2b-4382-9d9e-f083519473d8 => generated 1315 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 08:55:25.734715 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-2c1caad1-9766-495b-a487-3a5f6fc30f7e tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Calling method '>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:55:25.735328 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-2c1caad1-9766-495b-a487-3a5f6fc30f7e tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] [instance: 21ab666e-c39f-4202-9e7a-aa431a96a130] Fetching instance by UUID {{(pid=123459) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:55:25.742476 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-2c1caad1-9766-495b-a487-3a5f6fc30f7e tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:55:25.742924 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-2c1caad1-9766-495b-a487-3a5f6fc30f7e tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:55:25.743691 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-2c1caad1-9766-495b-a487-3a5f6fc30f7e tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:55:25.744125 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-2c1caad1-9766-495b-a487-3a5f6fc30f7e tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:55:25.875980 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [req-6065aaae-4a2c-4a8b-99b9-6647e6efbbca req-474ca2a0-afe1-43d6-a790-00bcb99af12b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4a2c7e29-e0ec-456b-bd06-ff7127f84e54", "name": "network-vif-plugged", "status": "completed", "tag": "bb464fd8-11f7-4acb-9ffa-b51b7c033221"}]} {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 29 08:55:25.885356 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-2c1caad1-9766-495b-a487-3a5f6fc30f7e tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e47ecdfb01f447699275b13255c15d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578e6a35974d4e5c8a0cd4e5fa994259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:55:25.890141 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [req-6065aaae-4a2c-4a8b-99b9-6647e6efbbca req-474ca2a0-afe1-43d6-a790-00bcb99af12b service nova] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:55:25.890616 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [req-6065aaae-4a2c-4a8b-99b9-6647e6efbbca req-474ca2a0-afe1-43d6-a790-00bcb99af12b service nova] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:55:25.894296 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-2c1caad1-9766-495b-a487-3a5f6fc30f7e tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] 10.222.0.31 "GET /compute/v2.1/servers/21ab666e-c39f-4202-9e7a-aa431a96a130" status: 200 len: 1367 microversion: 2.1 time: 0.163342 Apr 29 08:55:25.895641 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 233/476] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 08:55:25 2022] GET /compute/v2.1/servers/21ab666e-c39f-4202-9e7a-aa431a96a130 => generated 1367 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 08:55:25.905180 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.compute.server_external_events [req-6065aaae-4a2c-4a8b-99b9-6647e6efbbca req-474ca2a0-afe1-43d6-a790-00bcb99af12b service nova] Creating event network-vif-plugged:bb464fd8-11f7-4acb-9ffa-b51b7c033221 for instance 4a2c7e29-e0ec-456b-bd06-ff7127f84e54 on hv-cinder-83987 Apr 29 08:55:25.910802 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [req-6065aaae-4a2c-4a8b-99b9-6647e6efbbca req-474ca2a0-afe1-43d6-a790-00bcb99af12b service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038409 Apr 29 08:55:25.912003 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 244/477] 10.222.0.31 () {64 vars in 1317 bytes} [Fri Apr 29 08:55:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 29 08:55:26.198832 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-b57d0161-7146-443b-a14c-66d41b69a63e tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Calling method '>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:55:26.199395 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-b57d0161-7146-443b-a14c-66d41b69a63e tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] [instance: 406b5ad6-698e-457f-93f4-cdfd45fb3e8e] Fetching instance by UUID {{(pid=123459) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:55:26.204041 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-68580eb5-4ece-49b8-95f6-4c8121db1ef2 tempest-VolumesSnapshotTestJSON-1697003112 tempest-VolumesSnapshotTestJSON-1697003112-project] Calling method '>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:55:26.204756 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-68580eb5-4ece-49b8-95f6-4c8121db1ef2 tempest-VolumesSnapshotTestJSON-1697003112 tempest-VolumesSnapshotTestJSON-1697003112-project] [instance: 4a2c7e29-e0ec-456b-bd06-ff7127f84e54] Fetching instance by UUID {{(pid=123458) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:55:26.205971 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-b57d0161-7146-443b-a14c-66d41b69a63e tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:55:26.206421 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-b57d0161-7146-443b-a14c-66d41b69a63e tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:55:26.207829 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-b57d0161-7146-443b-a14c-66d41b69a63e tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:55:26.208690 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-b57d0161-7146-443b-a14c-66d41b69a63e tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:55:26.212665 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-68580eb5-4ece-49b8-95f6-4c8121db1ef2 tempest-VolumesSnapshotTestJSON-1697003112 tempest-VolumesSnapshotTestJSON-1697003112-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:55:26.213114 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-68580eb5-4ece-49b8-95f6-4c8121db1ef2 tempest-VolumesSnapshotTestJSON-1697003112 tempest-VolumesSnapshotTestJSON-1697003112-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:55:26.213881 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-68580eb5-4ece-49b8-95f6-4c8121db1ef2 tempest-VolumesSnapshotTestJSON-1697003112 tempest-VolumesSnapshotTestJSON-1697003112-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:55:26.214488 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-68580eb5-4ece-49b8-95f6-4c8121db1ef2 tempest-VolumesSnapshotTestJSON-1697003112 tempest-VolumesSnapshotTestJSON-1697003112-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:55:26.345666 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-b57d0161-7146-443b-a14c-66d41b69a63e tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:55:26.350527 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-68580eb5-4ece-49b8-95f6-4c8121db1ef2 tempest-VolumesSnapshotTestJSON-1697003112 tempest-VolumesSnapshotTestJSON-1697003112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a210cf812fb54682ac28a13a5dce0563', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c0d26c7abcc4bc7b175ac175bb5f2ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:55:26.354194 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-b57d0161-7146-443b-a14c-66d41b69a63e tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:55:26.355699 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-b57d0161-7146-443b-a14c-66d41b69a63e tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:55:26.356904 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-b57d0161-7146-443b-a14c-66d41b69a63e tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] 10.222.0.31 "GET /compute/v2.1/servers/406b5ad6-698e-457f-93f4-cdfd45fb3e8e" status: 200 len: 1747 microversion: 2.20 time: 0.162449 Apr 29 08:55:26.357467 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 234/478] 10.222.0.31 () {60 vars in 1276 bytes} [Fri Apr 29 08:55:26 2022] GET /compute/v2.1/servers/406b5ad6-698e-457f-93f4-cdfd45fb3e8e => generated 1747 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 29 08:55:26.357856 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-68580eb5-4ece-49b8-95f6-4c8121db1ef2 tempest-VolumesSnapshotTestJSON-1697003112 tempest-VolumesSnapshotTestJSON-1697003112-project] 10.222.0.31 "GET /compute/v2.1/servers/4a2c7e29-e0ec-456b-bd06-ff7127f84e54" status: 200 len: 1319 microversion: 2.1 time: 0.157904 Apr 29 08:55:26.358416 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 245/479] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 08:55:26 2022] GET /compute/v2.1/servers/4a2c7e29-e0ec-456b-bd06-ff7127f84e54 => generated 1319 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 29 08:55:26.372578 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-258198c8-cbf2-40b7-8906-212ddea94576 tempest-VolumesNegativeTest-45234477 tempest-VolumesNegativeTest-45234477-project] Calling method '>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:55:26.373187 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-258198c8-cbf2-40b7-8906-212ddea94576 tempest-VolumesNegativeTest-45234477 tempest-VolumesNegativeTest-45234477-project] [instance: 1bcda922-2a2b-4382-9d9e-f083519473d8] Fetching instance by UUID {{(pid=123459) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:55:26.379897 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-258198c8-cbf2-40b7-8906-212ddea94576 tempest-VolumesNegativeTest-45234477 tempest-VolumesNegativeTest-45234477-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:55:26.380376 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-258198c8-cbf2-40b7-8906-212ddea94576 tempest-VolumesNegativeTest-45234477 tempest-VolumesNegativeTest-45234477-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:55:26.381145 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-258198c8-cbf2-40b7-8906-212ddea94576 tempest-VolumesNegativeTest-45234477 tempest-VolumesNegativeTest-45234477-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:55:26.381580 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-258198c8-cbf2-40b7-8906-212ddea94576 tempest-VolumesNegativeTest-45234477 tempest-VolumesNegativeTest-45234477-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:55:26.513913 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-258198c8-cbf2-40b7-8906-212ddea94576 tempest-VolumesNegativeTest-45234477 tempest-VolumesNegativeTest-45234477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '340cefa576c947d08978a99d288304c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c9877c06a2445a3a34c5d35bafeb7a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:55:26.522308 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-258198c8-cbf2-40b7-8906-212ddea94576 tempest-VolumesNegativeTest-45234477 tempest-VolumesNegativeTest-45234477-project] 10.222.0.31 "GET /compute/v2.1/servers/1bcda922-2a2b-4382-9d9e-f083519473d8" status: 200 len: 1315 microversion: 2.1 time: 0.153477 Apr 29 08:55:26.522943 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 235/480] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 08:55:26 2022] GET /compute/v2.1/servers/1bcda922-2a2b-4382-9d9e-f083519473d8 => generated 1315 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 08:55:26.726179 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-fbcb0a67-91a7-4b59-aab9-84dcc838f850 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Action: 'create', calling method: .version_select at 0x7f6239788c10>, body: {"keypair": {"name": "tempest-keypair-703014161"}} {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 29 08:55:26.740513 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.quota [None req-fbcb0a67-91a7-4b59-aab9-84dcc838f850 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Getting quotas for project 60998f08c40446e787ead285e40665b1. Resources: {'key_pairs'} {{(pid=123458) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 29 08:55:26.744269 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.quota [None req-fbcb0a67-91a7-4b59-aab9-84dcc838f850 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Getting quotas for user 5c18e88436f14dc7a2001220b87ce9ed and project 60998f08c40446e787ead285e40665b1. Resources: {'key_pairs'} {{(pid=123458) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 29 08:55:26.846634 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.quota [None req-fbcb0a67-91a7-4b59-aab9-84dcc838f850 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Getting quotas for project 60998f08c40446e787ead285e40665b1. Resources: {'key_pairs'} {{(pid=123458) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 29 08:55:26.850764 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.quota [None req-fbcb0a67-91a7-4b59-aab9-84dcc838f850 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Getting quotas for user 5c18e88436f14dc7a2001220b87ce9ed and project 60998f08c40446e787ead285e40665b1. Resources: {'key_pairs'} {{(pid=123458) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 29 08:55:26.866096 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-fbcb0a67-91a7-4b59-aab9-84dcc838f850 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] 10.222.0.31 "POST /compute/v2.1/os-keypairs" status: 200 len: 2304 microversion: 2.1 time: 0.143891 Apr 29 08:55:26.866705 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 246/481] 10.222.0.31 () {60 vars in 1157 bytes} [Fri Apr 29 08:55:26 2022] POST /compute/v2.1/os-keypairs => generated 2304 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 08:55:26.912481 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-9add74cd-1169-4f6f-af58-689aee8e7bf5 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Calling method '>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:55:26.913789 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-9add74cd-1169-4f6f-af58-689aee8e7bf5 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] [instance: 21ab666e-c39f-4202-9e7a-aa431a96a130] Fetching instance by UUID {{(pid=123459) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:55:26.921359 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-9add74cd-1169-4f6f-af58-689aee8e7bf5 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:55:26.921752 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-9add74cd-1169-4f6f-af58-689aee8e7bf5 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:55:26.922612 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-9add74cd-1169-4f6f-af58-689aee8e7bf5 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:55:26.923168 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-9add74cd-1169-4f6f-af58-689aee8e7bf5 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:55:27.119153 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-9add74cd-1169-4f6f-af58-689aee8e7bf5 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e47ecdfb01f447699275b13255c15d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578e6a35974d4e5c8a0cd4e5fa994259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:55:27.127127 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-9add74cd-1169-4f6f-af58-689aee8e7bf5 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] 10.222.0.31 "GET /compute/v2.1/servers/21ab666e-c39f-4202-9e7a-aa431a96a130" status: 200 len: 1367 microversion: 2.1 time: 0.219312 Apr 29 08:55:27.127928 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 236/482] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 08:55:26 2022] GET /compute/v2.1/servers/21ab666e-c39f-4202-9e7a-aa431a96a130 => generated 1367 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 29 08:55:27.375580 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-adc33b9a-61e8-4473-8086-e898d1439285 tempest-VolumesSnapshotTestJSON-1697003112 tempest-VolumesSnapshotTestJSON-1697003112-project] Calling method '>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:55:27.376218 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-603d397e-5ca9-4ba2-98f7-0838bd95af91 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Calling method '>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:55:27.376617 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-adc33b9a-61e8-4473-8086-e898d1439285 tempest-VolumesSnapshotTestJSON-1697003112 tempest-VolumesSnapshotTestJSON-1697003112-project] [instance: 4a2c7e29-e0ec-456b-bd06-ff7127f84e54] Fetching instance by UUID {{(pid=123458) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:55:27.376971 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-603d397e-5ca9-4ba2-98f7-0838bd95af91 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] [instance: 406b5ad6-698e-457f-93f4-cdfd45fb3e8e] Fetching instance by UUID {{(pid=123459) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:55:27.382933 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-adc33b9a-61e8-4473-8086-e898d1439285 tempest-VolumesSnapshotTestJSON-1697003112 tempest-VolumesSnapshotTestJSON-1697003112-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:55:27.383529 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-603d397e-5ca9-4ba2-98f7-0838bd95af91 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:55:27.383737 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-adc33b9a-61e8-4473-8086-e898d1439285 tempest-VolumesSnapshotTestJSON-1697003112 tempest-VolumesSnapshotTestJSON-1697003112-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:55:27.383973 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-603d397e-5ca9-4ba2-98f7-0838bd95af91 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:55:27.384758 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-adc33b9a-61e8-4473-8086-e898d1439285 tempest-VolumesSnapshotTestJSON-1697003112 tempest-VolumesSnapshotTestJSON-1697003112-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:55:27.385090 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-603d397e-5ca9-4ba2-98f7-0838bd95af91 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:55:27.385276 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-adc33b9a-61e8-4473-8086-e898d1439285 tempest-VolumesSnapshotTestJSON-1697003112 tempest-VolumesSnapshotTestJSON-1697003112-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:55:27.385882 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-603d397e-5ca9-4ba2-98f7-0838bd95af91 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:55:27.525354 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-603d397e-5ca9-4ba2-98f7-0838bd95af91 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:55:27.534848 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-603d397e-5ca9-4ba2-98f7-0838bd95af91 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:55:27.537394 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-603d397e-5ca9-4ba2-98f7-0838bd95af91 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:55:27.538739 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-603d397e-5ca9-4ba2-98f7-0838bd95af91 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] 10.222.0.31 "GET /compute/v2.1/servers/406b5ad6-698e-457f-93f4-cdfd45fb3e8e" status: 200 len: 1747 microversion: 2.20 time: 0.166545 Apr 29 08:55:27.539309 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 237/483] 10.222.0.31 () {60 vars in 1276 bytes} [Fri Apr 29 08:55:27 2022] GET /compute/v2.1/servers/406b5ad6-698e-457f-93f4-cdfd45fb3e8e => generated 1747 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 29 08:55:27.543827 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-41882c74-c37b-4bd6-ae74-9fe2260a01dc tempest-VolumesNegativeTest-45234477 tempest-VolumesNegativeTest-45234477-project] Calling method '>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:55:27.544453 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-41882c74-c37b-4bd6-ae74-9fe2260a01dc tempest-VolumesNegativeTest-45234477 tempest-VolumesNegativeTest-45234477-project] [instance: 1bcda922-2a2b-4382-9d9e-f083519473d8] Fetching instance by UUID {{(pid=123459) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:55:27.550817 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-41882c74-c37b-4bd6-ae74-9fe2260a01dc tempest-VolumesNegativeTest-45234477 tempest-VolumesNegativeTest-45234477-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:55:27.551846 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-41882c74-c37b-4bd6-ae74-9fe2260a01dc tempest-VolumesNegativeTest-45234477 tempest-VolumesNegativeTest-45234477-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:55:27.552782 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-41882c74-c37b-4bd6-ae74-9fe2260a01dc tempest-VolumesNegativeTest-45234477 tempest-VolumesNegativeTest-45234477-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:55:27.553453 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-41882c74-c37b-4bd6-ae74-9fe2260a01dc tempest-VolumesNegativeTest-45234477 tempest-VolumesNegativeTest-45234477-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:55:27.589380 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-adc33b9a-61e8-4473-8086-e898d1439285 tempest-VolumesSnapshotTestJSON-1697003112 tempest-VolumesSnapshotTestJSON-1697003112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a210cf812fb54682ac28a13a5dce0563', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c0d26c7abcc4bc7b175ac175bb5f2ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:55:27.596689 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-adc33b9a-61e8-4473-8086-e898d1439285 tempest-VolumesSnapshotTestJSON-1697003112 tempest-VolumesSnapshotTestJSON-1697003112-project] 10.222.0.31 "GET /compute/v2.1/servers/4a2c7e29-e0ec-456b-bd06-ff7127f84e54" status: 200 len: 1319 microversion: 2.1 time: 0.225435 Apr 29 08:55:27.597279 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 247/484] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 08:55:27 2022] GET /compute/v2.1/servers/4a2c7e29-e0ec-456b-bd06-ff7127f84e54 => generated 1319 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 29 08:55:27.691817 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-41882c74-c37b-4bd6-ae74-9fe2260a01dc tempest-VolumesNegativeTest-45234477 tempest-VolumesNegativeTest-45234477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '340cefa576c947d08978a99d288304c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c9877c06a2445a3a34c5d35bafeb7a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:55:27.701521 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-41882c74-c37b-4bd6-ae74-9fe2260a01dc tempest-VolumesNegativeTest-45234477 tempest-VolumesNegativeTest-45234477-project] 10.222.0.31 "GET /compute/v2.1/servers/1bcda922-2a2b-4382-9d9e-f083519473d8" status: 200 len: 1315 microversion: 2.1 time: 0.161052 Apr 29 08:55:27.702235 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 238/485] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 08:55:27 2022] GET /compute/v2.1/servers/1bcda922-2a2b-4382-9d9e-f083519473d8 => generated 1315 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 08:55:28.146606 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-05c22e5e-0b7b-4fc1-9b49-ad4a8015460b tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Calling method '>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:55:28.147164 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-05c22e5e-0b7b-4fc1-9b49-ad4a8015460b tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] [instance: 21ab666e-c39f-4202-9e7a-aa431a96a130] Fetching instance by UUID {{(pid=123458) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:55:28.153953 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-05c22e5e-0b7b-4fc1-9b49-ad4a8015460b tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:55:28.154402 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-05c22e5e-0b7b-4fc1-9b49-ad4a8015460b tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:55:28.155183 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-05c22e5e-0b7b-4fc1-9b49-ad4a8015460b tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:55:28.155612 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-05c22e5e-0b7b-4fc1-9b49-ad4a8015460b tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:55:28.391619 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-05c22e5e-0b7b-4fc1-9b49-ad4a8015460b tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e47ecdfb01f447699275b13255c15d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578e6a35974d4e5c8a0cd4e5fa994259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:55:28.400189 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-05c22e5e-0b7b-4fc1-9b49-ad4a8015460b tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] 10.222.0.31 "GET /compute/v2.1/servers/21ab666e-c39f-4202-9e7a-aa431a96a130" status: 200 len: 1367 microversion: 2.1 time: 0.258153 Apr 29 08:55:28.400693 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 248/486] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 08:55:28 2022] GET /compute/v2.1/servers/21ab666e-c39f-4202-9e7a-aa431a96a130 => generated 1367 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 08:55:28.558303 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-7fea4273-22eb-436a-bf06-2a2cb12f8402 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Calling method '>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:55:28.558911 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-7fea4273-22eb-436a-bf06-2a2cb12f8402 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] [instance: 406b5ad6-698e-457f-93f4-cdfd45fb3e8e] Fetching instance by UUID {{(pid=123459) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:55:28.569477 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-7fea4273-22eb-436a-bf06-2a2cb12f8402 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:55:28.570221 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-7fea4273-22eb-436a-bf06-2a2cb12f8402 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:55:28.571045 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-7fea4273-22eb-436a-bf06-2a2cb12f8402 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:55:28.571478 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-7fea4273-22eb-436a-bf06-2a2cb12f8402 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:55:28.575695 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-abeadcca-ee41-4467-b1fc-26de0971f189 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1120652851", "imageRef": "e0678f88-0b68-4453-b569-29fd065e544e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "a85ddbe4-1cfc-4e78-8e29-c2dcd2efb882"}], "security_groups": [{"name": "tempest-securitygroup--950903646"}], "key_name": "tempest-keypair-703014161", "user_data": "}} {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 29 08:55:28.686437 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.network.neutron [None req-abeadcca-ee41-4467-b1fc-26de0971f189 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] validate_networks() for [('a85ddbe4-1cfc-4e78-8e29-c2dcd2efb882', None, None, None, None, None)] {{(pid=123458) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 29 08:55:28.708429 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-7fea4273-22eb-436a-bf06-2a2cb12f8402 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:55:28.717173 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-7fea4273-22eb-436a-bf06-2a2cb12f8402 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:55:28.718698 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-7fea4273-22eb-436a-bf06-2a2cb12f8402 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:55:28.719897 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-7fea4273-22eb-436a-bf06-2a2cb12f8402 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] 10.222.0.31 "GET /compute/v2.1/servers/406b5ad6-698e-457f-93f4-cdfd45fb3e8e" status: 200 len: 1747 microversion: 2.20 time: 0.165918 Apr 29 08:55:28.720492 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 239/487] 10.222.0.31 () {60 vars in 1276 bytes} [Fri Apr 29 08:55:28 2022] GET /compute/v2.1/servers/406b5ad6-698e-457f-93f4-cdfd45fb3e8e => generated 1747 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 29 08:55:28.725411 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-7aa94421-5af5-4f96-b092-12449e35648f tempest-VolumesSnapshotTestJSON-1697003112 tempest-VolumesSnapshotTestJSON-1697003112-project] Calling method '>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:55:28.726019 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-7aa94421-5af5-4f96-b092-12449e35648f tempest-VolumesSnapshotTestJSON-1697003112 tempest-VolumesSnapshotTestJSON-1697003112-project] [instance: 4a2c7e29-e0ec-456b-bd06-ff7127f84e54] Fetching instance by UUID {{(pid=123459) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:55:28.732372 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-7aa94421-5af5-4f96-b092-12449e35648f tempest-VolumesSnapshotTestJSON-1697003112 tempest-VolumesSnapshotTestJSON-1697003112-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:55:28.732884 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-7aa94421-5af5-4f96-b092-12449e35648f tempest-VolumesSnapshotTestJSON-1697003112 tempest-VolumesSnapshotTestJSON-1697003112-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:55:28.733659 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-7aa94421-5af5-4f96-b092-12449e35648f tempest-VolumesSnapshotTestJSON-1697003112 tempest-VolumesSnapshotTestJSON-1697003112-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:55:28.734087 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-7aa94421-5af5-4f96-b092-12449e35648f tempest-VolumesSnapshotTestJSON-1697003112 tempest-VolumesSnapshotTestJSON-1697003112-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:55:28.872550 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-7aa94421-5af5-4f96-b092-12449e35648f tempest-VolumesSnapshotTestJSON-1697003112 tempest-VolumesSnapshotTestJSON-1697003112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a210cf812fb54682ac28a13a5dce0563', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c0d26c7abcc4bc7b175ac175bb5f2ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:55:28.881831 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-7aa94421-5af5-4f96-b092-12449e35648f tempest-VolumesSnapshotTestJSON-1697003112 tempest-VolumesSnapshotTestJSON-1697003112-project] 10.222.0.31 "GET /compute/v2.1/servers/4a2c7e29-e0ec-456b-bd06-ff7127f84e54" status: 200 len: 1319 microversion: 2.1 time: 0.160269 Apr 29 08:55:28.882419 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 240/488] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 08:55:28 2022] GET /compute/v2.1/servers/4a2c7e29-e0ec-456b-bd06-ff7127f84e54 => generated 1319 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 08:55:28.887007 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-19eb534b-6bce-4156-924a-9aed43c90d05 tempest-VolumesNegativeTest-45234477 tempest-VolumesNegativeTest-45234477-project] Calling method '>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:55:28.887618 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-19eb534b-6bce-4156-924a-9aed43c90d05 tempest-VolumesNegativeTest-45234477 tempest-VolumesNegativeTest-45234477-project] [instance: 1bcda922-2a2b-4382-9d9e-f083519473d8] Fetching instance by UUID {{(pid=123459) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:55:28.893748 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-19eb534b-6bce-4156-924a-9aed43c90d05 tempest-VolumesNegativeTest-45234477 tempest-VolumesNegativeTest-45234477-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:55:28.894200 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-19eb534b-6bce-4156-924a-9aed43c90d05 tempest-VolumesNegativeTest-45234477 tempest-VolumesNegativeTest-45234477-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:55:28.895858 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-19eb534b-6bce-4156-924a-9aed43c90d05 tempest-VolumesNegativeTest-45234477 tempest-VolumesNegativeTest-45234477-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:55:28.896334 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-19eb534b-6bce-4156-924a-9aed43c90d05 tempest-VolumesNegativeTest-45234477 tempest-VolumesNegativeTest-45234477-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:55:29.035091 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-19eb534b-6bce-4156-924a-9aed43c90d05 tempest-VolumesNegativeTest-45234477 tempest-VolumesNegativeTest-45234477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '340cefa576c947d08978a99d288304c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c9877c06a2445a3a34c5d35bafeb7a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:55:29.042771 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-19eb534b-6bce-4156-924a-9aed43c90d05 tempest-VolumesNegativeTest-45234477 tempest-VolumesNegativeTest-45234477-project] 10.222.0.31 "GET /compute/v2.1/servers/1bcda922-2a2b-4382-9d9e-f083519473d8" status: 200 len: 1465 microversion: 2.1 time: 0.159388 Apr 29 08:55:29.043345 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 241/489] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 08:55:28 2022] GET /compute/v2.1/servers/1bcda922-2a2b-4382-9d9e-f083519473d8 => generated 1465 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 08:55:29.082903 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-036e7b14-0ede-4448-a729-8c6de2398968 tempest-VolumesNegativeTest-45234477 tempest-VolumesNegativeTest-45234477-project] Calling method '>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:55:29.083265 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.virt.hardware [None req-abeadcca-ee41-4467-b1fc-26de0971f189 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Flavor limits 0:0:0 {{(pid=123458) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 29 08:55:29.083452 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-036e7b14-0ede-4448-a729-8c6de2398968 tempest-VolumesNegativeTest-45234477 tempest-VolumesNegativeTest-45234477-project] [instance: 1bcda922-2a2b-4382-9d9e-f083519473d8] Fetching instance by UUID {{(pid=123459) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:55:29.083691 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.virt.hardware [None req-abeadcca-ee41-4467-b1fc-26de0971f189 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Image limits 0:0:0 {{(pid=123458) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 29 08:55:29.084195 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.virt.hardware [None req-abeadcca-ee41-4467-b1fc-26de0971f189 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Flavor pref 0:0:0 {{(pid=123458) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 29 08:55:29.084614 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.virt.hardware [None req-abeadcca-ee41-4467-b1fc-26de0971f189 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Image pref 0:0:0 {{(pid=123458) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 29 08:55:29.085029 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.virt.hardware [None req-abeadcca-ee41-4467-b1fc-26de0971f189 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123458) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 29 08:55:29.089294 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-036e7b14-0ede-4448-a729-8c6de2398968 tempest-VolumesNegativeTest-45234477 tempest-VolumesNegativeTest-45234477-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:55:29.089737 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-036e7b14-0ede-4448-a729-8c6de2398968 tempest-VolumesNegativeTest-45234477 tempest-VolumesNegativeTest-45234477-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:55:29.090505 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-036e7b14-0ede-4448-a729-8c6de2398968 tempest-VolumesNegativeTest-45234477 tempest-VolumesNegativeTest-45234477-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:55:29.090929 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-036e7b14-0ede-4448-a729-8c6de2398968 tempest-VolumesNegativeTest-45234477 tempest-VolumesNegativeTest-45234477-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:55:29.095485 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-abeadcca-ee41-4467-b1fc-26de0971f189 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:55:29.096049 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-abeadcca-ee41-4467-b1fc-26de0971f189 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:55:29.097037 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-abeadcca-ee41-4467-b1fc-26de0971f189 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:55:29.097502 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-abeadcca-ee41-4467-b1fc-26de0971f189 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:55:29.116410 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.quota [None req-abeadcca-ee41-4467-b1fc-26de0971f189 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Getting quotas for project 60998f08c40446e787ead285e40665b1. Resources: {'instances', 'cores', 'ram'} {{(pid=123458) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 29 08:55:29.116974 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-036e7b14-0ede-4448-a729-8c6de2398968 tempest-VolumesNegativeTest-45234477 tempest-VolumesNegativeTest-45234477-project] [instance: 1bcda922-2a2b-4382-9d9e-f083519473d8] Going to try to terminate instance {{(pid=123459) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 29 08:55:29.120159 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.quota [None req-abeadcca-ee41-4467-b1fc-26de0971f189 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Getting quotas for user 5c18e88436f14dc7a2001220b87ce9ed and project 60998f08c40446e787ead285e40665b1. Resources: {'instances', 'cores', 'ram'} {{(pid=123458) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 29 08:55:29.131584 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-abeadcca-ee41-4467-b1fc-26de0971f189 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Going to run 1 instances... {{(pid=123458) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 29 08:55:29.133912 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-abeadcca-ee41-4467-b1fc-26de0971f189 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] [instance: f4be98bb-be88-421f-a448-f04a4f97702b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e0678f88-0b68-4453-b569-29fd065e544e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123458) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 29 08:55:29.205396 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-abeadcca-ee41-4467-b1fc-26de0971f189 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] 10.222.0.31 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 0.634185 Apr 29 08:55:29.206128 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 249/490] 10.222.0.31 () {60 vars in 1146 bytes} [Fri Apr 29 08:55:28 2022] POST /compute/v2.1/servers => generated 408 bytes in 636 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Apr 29 08:55:29.217116 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-d07bf992-d71f-46ea-863d-81e1bb1223dd tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Calling method '>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:55:29.217873 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-d07bf992-d71f-46ea-863d-81e1bb1223dd tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] [instance: f4be98bb-be88-421f-a448-f04a4f97702b] Fetching instance by UUID {{(pid=123458) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:55:29.222501 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-036e7b14-0ede-4448-a729-8c6de2398968 tempest-VolumesNegativeTest-45234477 tempest-VolumesNegativeTest-45234477-project] 10.222.0.31 "DELETE /compute/v2.1/servers/1bcda922-2a2b-4382-9d9e-f083519473d8" status: 204 len: 0 microversion: 2.1 time: 0.143381 Apr 29 08:55:29.223996 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 242/491] 10.222.0.31 () {58 vars in 1238 bytes} [Fri Apr 29 08:55:29 2022] DELETE /compute/v2.1/servers/1bcda922-2a2b-4382-9d9e-f083519473d8 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Apr 29 08:55:29.232470 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-dfb05857-cc52-4053-801a-08b40bcae3f3 tempest-VolumesNegativeTest-45234477 tempest-VolumesNegativeTest-45234477-project] Calling method '>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:55:29.233235 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-dfb05857-cc52-4053-801a-08b40bcae3f3 tempest-VolumesNegativeTest-45234477 tempest-VolumesNegativeTest-45234477-project] [instance: 1bcda922-2a2b-4382-9d9e-f083519473d8] Fetching instance by UUID {{(pid=123459) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:55:29.241256 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-dfb05857-cc52-4053-801a-08b40bcae3f3 tempest-VolumesNegativeTest-45234477 tempest-VolumesNegativeTest-45234477-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:55:29.241859 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-dfb05857-cc52-4053-801a-08b40bcae3f3 tempest-VolumesNegativeTest-45234477 tempest-VolumesNegativeTest-45234477-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:55:29.242878 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-dfb05857-cc52-4053-801a-08b40bcae3f3 tempest-VolumesNegativeTest-45234477 tempest-VolumesNegativeTest-45234477-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:55:29.243654 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-dfb05857-cc52-4053-801a-08b40bcae3f3 tempest-VolumesNegativeTest-45234477 tempest-VolumesNegativeTest-45234477-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:55:29.399463 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-dfb05857-cc52-4053-801a-08b40bcae3f3 tempest-VolumesNegativeTest-45234477 tempest-VolumesNegativeTest-45234477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '340cefa576c947d08978a99d288304c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c9877c06a2445a3a34c5d35bafeb7a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:55:29.407608 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-dfb05857-cc52-4053-801a-08b40bcae3f3 tempest-VolumesNegativeTest-45234477 tempest-VolumesNegativeTest-45234477-project] 10.222.0.31 "GET /compute/v2.1/servers/1bcda922-2a2b-4382-9d9e-f083519473d8" status: 200 len: 1471 microversion: 2.1 time: 0.179139 Apr 29 08:55:29.418681 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 243/492] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 08:55:29 2022] GET /compute/v2.1/servers/1bcda922-2a2b-4382-9d9e-f083519473d8 => generated 1471 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 08:55:29.424636 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-0f8f63b1-4431-48b6-8e15-8a2f3998788e tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Calling method '>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:55:29.425261 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-0f8f63b1-4431-48b6-8e15-8a2f3998788e tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] [instance: 21ab666e-c39f-4202-9e7a-aa431a96a130] Fetching instance by UUID {{(pid=123459) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:55:29.433141 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-0f8f63b1-4431-48b6-8e15-8a2f3998788e tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:55:29.433647 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-0f8f63b1-4431-48b6-8e15-8a2f3998788e tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:55:29.434538 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-0f8f63b1-4431-48b6-8e15-8a2f3998788e tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:55:29.434982 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-0f8f63b1-4431-48b6-8e15-8a2f3998788e tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:55:29.531502 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-d07bf992-d71f-46ea-863d-81e1bb1223dd tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c18e88436f14dc7a2001220b87ce9ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60998f08c40446e787ead285e40665b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:55:29.544318 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-d07bf992-d71f-46ea-863d-81e1bb1223dd tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] 10.222.0.31 "GET /compute/v2.1/servers/f4be98bb-be88-421f-a448-f04a4f97702b" status: 200 len: 1245 microversion: 2.1 time: 0.331365 Apr 29 08:55:29.544898 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 250/493] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 08:55:29 2022] GET /compute/v2.1/servers/f4be98bb-be88-421f-a448-f04a4f97702b => generated 1245 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 29 08:55:29.609374 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-0f8f63b1-4431-48b6-8e15-8a2f3998788e tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e47ecdfb01f447699275b13255c15d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578e6a35974d4e5c8a0cd4e5fa994259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:55:29.617647 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-0f8f63b1-4431-48b6-8e15-8a2f3998788e tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] 10.222.0.31 "GET /compute/v2.1/servers/21ab666e-c39f-4202-9e7a-aa431a96a130" status: 200 len: 1367 microversion: 2.1 time: 0.197714 Apr 29 08:55:29.618220 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 244/494] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 08:55:29 2022] GET /compute/v2.1/servers/21ab666e-c39f-4202-9e7a-aa431a96a130 => generated 1367 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 08:55:29.740250 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-a5023288-1aa0-4f13-98b7-6ae507432aa3 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Calling method '>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:55:29.740790 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-a5023288-1aa0-4f13-98b7-6ae507432aa3 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] [instance: 406b5ad6-698e-457f-93f4-cdfd45fb3e8e] Fetching instance by UUID {{(pid=123458) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:55:29.746872 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-a5023288-1aa0-4f13-98b7-6ae507432aa3 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:55:29.747320 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-a5023288-1aa0-4f13-98b7-6ae507432aa3 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:55:29.748097 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-a5023288-1aa0-4f13-98b7-6ae507432aa3 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:55:29.748561 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-a5023288-1aa0-4f13-98b7-6ae507432aa3 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:55:29.880311 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-a5023288-1aa0-4f13-98b7-6ae507432aa3 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:55:29.888561 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-a5023288-1aa0-4f13-98b7-6ae507432aa3 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:55:29.890056 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-a5023288-1aa0-4f13-98b7-6ae507432aa3 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:55:29.891194 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-a5023288-1aa0-4f13-98b7-6ae507432aa3 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] 10.222.0.31 "GET /compute/v2.1/servers/406b5ad6-698e-457f-93f4-cdfd45fb3e8e" status: 200 len: 1747 microversion: 2.20 time: 0.156291 Apr 29 08:55:29.891763 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 251/495] 10.222.0.31 () {60 vars in 1276 bytes} [Fri Apr 29 08:55:29 2022] GET /compute/v2.1/servers/406b5ad6-698e-457f-93f4-cdfd45fb3e8e => generated 1747 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 29 08:55:29.900992 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-6e365de8-de57-481a-b8d3-17fa746f762f tempest-VolumesSnapshotTestJSON-1697003112 tempest-VolumesSnapshotTestJSON-1697003112-project] Calling method '>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:55:29.901596 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-6e365de8-de57-481a-b8d3-17fa746f762f tempest-VolumesSnapshotTestJSON-1697003112 tempest-VolumesSnapshotTestJSON-1697003112-project] [instance: 4a2c7e29-e0ec-456b-bd06-ff7127f84e54] Fetching instance by UUID {{(pid=123459) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:55:29.907561 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-6e365de8-de57-481a-b8d3-17fa746f762f tempest-VolumesSnapshotTestJSON-1697003112 tempest-VolumesSnapshotTestJSON-1697003112-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:55:29.908002 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-6e365de8-de57-481a-b8d3-17fa746f762f tempest-VolumesSnapshotTestJSON-1697003112 tempest-VolumesSnapshotTestJSON-1697003112-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:55:29.908787 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-6e365de8-de57-481a-b8d3-17fa746f762f tempest-VolumesSnapshotTestJSON-1697003112 tempest-VolumesSnapshotTestJSON-1697003112-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:55:29.909217 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-6e365de8-de57-481a-b8d3-17fa746f762f tempest-VolumesSnapshotTestJSON-1697003112 tempest-VolumesSnapshotTestJSON-1697003112-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:55:30.043250 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-6e365de8-de57-481a-b8d3-17fa746f762f tempest-VolumesSnapshotTestJSON-1697003112 tempest-VolumesSnapshotTestJSON-1697003112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a210cf812fb54682ac28a13a5dce0563', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c0d26c7abcc4bc7b175ac175bb5f2ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:55:30.051681 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-6e365de8-de57-481a-b8d3-17fa746f762f tempest-VolumesSnapshotTestJSON-1697003112 tempest-VolumesSnapshotTestJSON-1697003112-project] 10.222.0.31 "GET /compute/v2.1/servers/4a2c7e29-e0ec-456b-bd06-ff7127f84e54" status: 200 len: 1319 microversion: 2.1 time: 0.153745 Apr 29 08:55:30.052675 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 245/496] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 08:55:29 2022] GET /compute/v2.1/servers/4a2c7e29-e0ec-456b-bd06-ff7127f84e54 => generated 1319 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 08:55:30.425131 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-a7b34b03-d3d9-4e4b-a118-ef095a32f567 tempest-VolumesNegativeTest-45234477 tempest-VolumesNegativeTest-45234477-project] Calling method '>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:55:30.425665 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-a7b34b03-d3d9-4e4b-a118-ef095a32f567 tempest-VolumesNegativeTest-45234477 tempest-VolumesNegativeTest-45234477-project] [instance: 1bcda922-2a2b-4382-9d9e-f083519473d8] Fetching instance by UUID {{(pid=123458) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:55:30.432179 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-a7b34b03-d3d9-4e4b-a118-ef095a32f567 tempest-VolumesNegativeTest-45234477 tempest-VolumesNegativeTest-45234477-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:55:30.432641 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-a7b34b03-d3d9-4e4b-a118-ef095a32f567 tempest-VolumesNegativeTest-45234477 tempest-VolumesNegativeTest-45234477-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:55:30.433419 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-a7b34b03-d3d9-4e4b-a118-ef095a32f567 tempest-VolumesNegativeTest-45234477 tempest-VolumesNegativeTest-45234477-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:55:30.433866 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-a7b34b03-d3d9-4e4b-a118-ef095a32f567 tempest-VolumesNegativeTest-45234477 tempest-VolumesNegativeTest-45234477-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:55:30.562508 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-7527ba41-c97c-4035-9101-3fa39b6bd337 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Calling method '>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:55:30.563361 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-7527ba41-c97c-4035-9101-3fa39b6bd337 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] [instance: f4be98bb-be88-421f-a448-f04a4f97702b] Fetching instance by UUID {{(pid=123459) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:55:30.570109 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-7527ba41-c97c-4035-9101-3fa39b6bd337 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:55:30.570573 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-7527ba41-c97c-4035-9101-3fa39b6bd337 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:55:30.571362 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-7527ba41-c97c-4035-9101-3fa39b6bd337 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:55:30.572485 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-7527ba41-c97c-4035-9101-3fa39b6bd337 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:55:30.575619 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-a7b34b03-d3d9-4e4b-a118-ef095a32f567 tempest-VolumesNegativeTest-45234477 tempest-VolumesNegativeTest-45234477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '340cefa576c947d08978a99d288304c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c9877c06a2445a3a34c5d35bafeb7a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:55:30.583208 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-a7b34b03-d3d9-4e4b-a118-ef095a32f567 tempest-VolumesNegativeTest-45234477 tempest-VolumesNegativeTest-45234477-project] 10.222.0.31 "GET /compute/v2.1/servers/1bcda922-2a2b-4382-9d9e-f083519473d8" status: 200 len: 1471 microversion: 2.1 time: 0.161927 Apr 29 08:55:30.583794 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 252/497] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 08:55:30 2022] GET /compute/v2.1/servers/1bcda922-2a2b-4382-9d9e-f083519473d8 => generated 1471 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 08:55:30.635699 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-e33a3b2d-c82d-44e0-84de-400f086ea37b tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Calling method '>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:55:30.636500 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-e33a3b2d-c82d-44e0-84de-400f086ea37b tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] [instance: 21ab666e-c39f-4202-9e7a-aa431a96a130] Fetching instance by UUID {{(pid=123458) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:55:30.642649 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-e33a3b2d-c82d-44e0-84de-400f086ea37b tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:55:30.643092 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-e33a3b2d-c82d-44e0-84de-400f086ea37b tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:55:30.643197 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-7527ba41-c97c-4035-9101-3fa39b6bd337 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c18e88436f14dc7a2001220b87ce9ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60998f08c40446e787ead285e40665b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:55:30.643875 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-e33a3b2d-c82d-44e0-84de-400f086ea37b tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:55:30.644401 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-e33a3b2d-c82d-44e0-84de-400f086ea37b tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:55:30.652521 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-7527ba41-c97c-4035-9101-3fa39b6bd337 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] 10.222.0.31 "GET /compute/v2.1/servers/f4be98bb-be88-421f-a448-f04a4f97702b" status: 200 len: 1249 microversion: 2.1 time: 0.094244 Apr 29 08:55:30.660785 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 246/498] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 08:55:30 2022] GET /compute/v2.1/servers/f4be98bb-be88-421f-a448-f04a4f97702b => generated 1249 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 08:55:30.787367 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-e33a3b2d-c82d-44e0-84de-400f086ea37b tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e47ecdfb01f447699275b13255c15d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578e6a35974d4e5c8a0cd4e5fa994259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:55:30.794685 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-e33a3b2d-c82d-44e0-84de-400f086ea37b tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] 10.222.0.31 "GET /compute/v2.1/servers/21ab666e-c39f-4202-9e7a-aa431a96a130" status: 200 len: 1367 microversion: 2.1 time: 0.162822 Apr 29 08:55:30.795250 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 253/499] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 08:55:30 2022] GET /compute/v2.1/servers/21ab666e-c39f-4202-9e7a-aa431a96a130 => generated 1367 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 29 08:55:30.911294 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-80ecd69f-018a-4460-b98d-affbaff90a3b tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Calling method '>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:55:30.911908 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-80ecd69f-018a-4460-b98d-affbaff90a3b tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] [instance: 406b5ad6-698e-457f-93f4-cdfd45fb3e8e] Fetching instance by UUID {{(pid=123459) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:55:30.918072 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-80ecd69f-018a-4460-b98d-affbaff90a3b tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:55:30.918739 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-80ecd69f-018a-4460-b98d-affbaff90a3b tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:55:30.919550 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-80ecd69f-018a-4460-b98d-affbaff90a3b tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:55:30.919990 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-80ecd69f-018a-4460-b98d-affbaff90a3b tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:55:31.051324 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-80ecd69f-018a-4460-b98d-affbaff90a3b tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:55:31.059874 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-80ecd69f-018a-4460-b98d-affbaff90a3b tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:55:31.061429 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-80ecd69f-018a-4460-b98d-affbaff90a3b tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:55:31.062597 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-80ecd69f-018a-4460-b98d-affbaff90a3b tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] 10.222.0.31 "GET /compute/v2.1/servers/406b5ad6-698e-457f-93f4-cdfd45fb3e8e" status: 200 len: 1747 microversion: 2.20 time: 0.155423 Apr 29 08:55:31.063164 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 247/500] 10.222.0.31 () {60 vars in 1276 bytes} [Fri Apr 29 08:55:30 2022] GET /compute/v2.1/servers/406b5ad6-698e-457f-93f4-cdfd45fb3e8e => generated 1747 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 29 08:55:31.070468 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-a4008cbe-9be3-4f91-a606-62c475758cf5 tempest-VolumesSnapshotTestJSON-1697003112 tempest-VolumesSnapshotTestJSON-1697003112-project] Calling method '>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:55:31.071080 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-a4008cbe-9be3-4f91-a606-62c475758cf5 tempest-VolumesSnapshotTestJSON-1697003112 tempest-VolumesSnapshotTestJSON-1697003112-project] [instance: 4a2c7e29-e0ec-456b-bd06-ff7127f84e54] Fetching instance by UUID {{(pid=123458) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:55:31.077003 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-a4008cbe-9be3-4f91-a606-62c475758cf5 tempest-VolumesSnapshotTestJSON-1697003112 tempest-VolumesSnapshotTestJSON-1697003112-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:55:31.077459 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-a4008cbe-9be3-4f91-a606-62c475758cf5 tempest-VolumesSnapshotTestJSON-1697003112 tempest-VolumesSnapshotTestJSON-1697003112-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:55:31.078223 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-a4008cbe-9be3-4f91-a606-62c475758cf5 tempest-VolumesSnapshotTestJSON-1697003112 tempest-VolumesSnapshotTestJSON-1697003112-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:55:31.078661 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-a4008cbe-9be3-4f91-a606-62c475758cf5 tempest-VolumesSnapshotTestJSON-1697003112 tempest-VolumesSnapshotTestJSON-1697003112-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:55:31.207183 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-a4008cbe-9be3-4f91-a606-62c475758cf5 tempest-VolumesSnapshotTestJSON-1697003112 tempest-VolumesSnapshotTestJSON-1697003112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a210cf812fb54682ac28a13a5dce0563', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c0d26c7abcc4bc7b175ac175bb5f2ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:55:31.214754 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-a4008cbe-9be3-4f91-a606-62c475758cf5 tempest-VolumesSnapshotTestJSON-1697003112 tempest-VolumesSnapshotTestJSON-1697003112-project] 10.222.0.31 "GET /compute/v2.1/servers/4a2c7e29-e0ec-456b-bd06-ff7127f84e54" status: 200 len: 1319 microversion: 2.1 time: 0.149018 Apr 29 08:55:31.215330 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 254/501] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 08:55:31 2022] GET /compute/v2.1/servers/4a2c7e29-e0ec-456b-bd06-ff7127f84e54 => generated 1319 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 08:55:31.600747 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-04a735ba-c15f-405f-a125-cacc296b1b07 tempest-VolumesNegativeTest-45234477 tempest-VolumesNegativeTest-45234477-project] Calling method '>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:55:31.601361 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-04a735ba-c15f-405f-a125-cacc296b1b07 tempest-VolumesNegativeTest-45234477 tempest-VolumesNegativeTest-45234477-project] [instance: 1bcda922-2a2b-4382-9d9e-f083519473d8] Fetching instance by UUID {{(pid=123459) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:55:31.608749 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-04a735ba-c15f-405f-a125-cacc296b1b07 tempest-VolumesNegativeTest-45234477 tempest-VolumesNegativeTest-45234477-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:55:31.609199 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-04a735ba-c15f-405f-a125-cacc296b1b07 tempest-VolumesNegativeTest-45234477 tempest-VolumesNegativeTest-45234477-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:55:31.609982 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-04a735ba-c15f-405f-a125-cacc296b1b07 tempest-VolumesNegativeTest-45234477 tempest-VolumesNegativeTest-45234477-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:55:31.610421 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-04a735ba-c15f-405f-a125-cacc296b1b07 tempest-VolumesNegativeTest-45234477 tempest-VolumesNegativeTest-45234477-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:55:31.669403 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-9ff8f58f-84be-4b83-a7c6-0454d04988a0 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Calling method '>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:55:31.670027 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-9ff8f58f-84be-4b83-a7c6-0454d04988a0 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] [instance: f4be98bb-be88-421f-a448-f04a4f97702b] Fetching instance by UUID {{(pid=123458) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:55:31.677883 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-9ff8f58f-84be-4b83-a7c6-0454d04988a0 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:55:31.678327 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-9ff8f58f-84be-4b83-a7c6-0454d04988a0 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:55:31.679124 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-9ff8f58f-84be-4b83-a7c6-0454d04988a0 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:55:31.679565 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-9ff8f58f-84be-4b83-a7c6-0454d04988a0 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:55:31.744008 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-9ff8f58f-84be-4b83-a7c6-0454d04988a0 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c18e88436f14dc7a2001220b87ce9ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60998f08c40446e787ead285e40665b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:55:31.751618 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-9ff8f58f-84be-4b83-a7c6-0454d04988a0 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] 10.222.0.31 "GET /compute/v2.1/servers/f4be98bb-be88-421f-a448-f04a4f97702b" status: 200 len: 1249 microversion: 2.1 time: 0.086010 Apr 29 08:55:31.752234 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 255/502] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 08:55:31 2022] GET /compute/v2.1/servers/f4be98bb-be88-421f-a448-f04a4f97702b => generated 1249 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 29 08:55:31.790051 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-04a735ba-c15f-405f-a125-cacc296b1b07 tempest-VolumesNegativeTest-45234477 tempest-VolumesNegativeTest-45234477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '340cefa576c947d08978a99d288304c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c9877c06a2445a3a34c5d35bafeb7a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:55:31.803086 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-04a735ba-c15f-405f-a125-cacc296b1b07 tempest-VolumesNegativeTest-45234477 tempest-VolumesNegativeTest-45234477-project] 10.222.0.31 "GET /compute/v2.1/servers/1bcda922-2a2b-4382-9d9e-f083519473d8" status: 200 len: 1471 microversion: 2.1 time: 0.206603 Apr 29 08:55:31.803680 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 248/503] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 08:55:31 2022] GET /compute/v2.1/servers/1bcda922-2a2b-4382-9d9e-f083519473d8 => generated 1471 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 08:55:31.813274 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-34657409-e793-425f-9f53-694c25539495 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Calling method '>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:55:31.813930 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-34657409-e793-425f-9f53-694c25539495 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] [instance: 21ab666e-c39f-4202-9e7a-aa431a96a130] Fetching instance by UUID {{(pid=123458) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:55:31.820410 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-34657409-e793-425f-9f53-694c25539495 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:55:31.820900 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-34657409-e793-425f-9f53-694c25539495 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:55:31.821694 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-34657409-e793-425f-9f53-694c25539495 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:55:31.822165 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-34657409-e793-425f-9f53-694c25539495 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:55:31.963638 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-34657409-e793-425f-9f53-694c25539495 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e47ecdfb01f447699275b13255c15d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578e6a35974d4e5c8a0cd4e5fa994259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:55:31.971571 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-34657409-e793-425f-9f53-694c25539495 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] 10.222.0.31 "GET /compute/v2.1/servers/21ab666e-c39f-4202-9e7a-aa431a96a130" status: 200 len: 1367 microversion: 2.1 time: 0.162766 Apr 29 08:55:31.972179 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 256/504] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 08:55:31 2022] GET /compute/v2.1/servers/21ab666e-c39f-4202-9e7a-aa431a96a130 => generated 1367 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 08:55:32.082612 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-5b8cd98c-32f3-422d-ba82-66cbd063bb94 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Calling method '>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:55:32.083305 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-5b8cd98c-32f3-422d-ba82-66cbd063bb94 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] [instance: 406b5ad6-698e-457f-93f4-cdfd45fb3e8e] Fetching instance by UUID {{(pid=123459) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:55:32.090914 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-5b8cd98c-32f3-422d-ba82-66cbd063bb94 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:55:32.091394 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-5b8cd98c-32f3-422d-ba82-66cbd063bb94 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:55:32.092214 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-5b8cd98c-32f3-422d-ba82-66cbd063bb94 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:55:32.092661 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-5b8cd98c-32f3-422d-ba82-66cbd063bb94 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:55:32.230990 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-2e2aefd0-bcd8-49a6-876b-22e19043ced5 tempest-VolumesSnapshotTestJSON-1697003112 tempest-VolumesSnapshotTestJSON-1697003112-project] Calling method '>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:55:32.231491 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-2e2aefd0-bcd8-49a6-876b-22e19043ced5 tempest-VolumesSnapshotTestJSON-1697003112 tempest-VolumesSnapshotTestJSON-1697003112-project] [instance: 4a2c7e29-e0ec-456b-bd06-ff7127f84e54] Fetching instance by UUID {{(pid=123458) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:55:32.236633 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-5b8cd98c-32f3-422d-ba82-66cbd063bb94 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:55:32.237838 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-2e2aefd0-bcd8-49a6-876b-22e19043ced5 tempest-VolumesSnapshotTestJSON-1697003112 tempest-VolumesSnapshotTestJSON-1697003112-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:55:32.238959 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-2e2aefd0-bcd8-49a6-876b-22e19043ced5 tempest-VolumesSnapshotTestJSON-1697003112 tempest-VolumesSnapshotTestJSON-1697003112-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:55:32.239244 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-2e2aefd0-bcd8-49a6-876b-22e19043ced5 tempest-VolumesSnapshotTestJSON-1697003112 tempest-VolumesSnapshotTestJSON-1697003112-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:55:32.239928 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-2e2aefd0-bcd8-49a6-876b-22e19043ced5 tempest-VolumesSnapshotTestJSON-1697003112 tempest-VolumesSnapshotTestJSON-1697003112-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:55:32.246248 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-5b8cd98c-32f3-422d-ba82-66cbd063bb94 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:55:32.247773 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-5b8cd98c-32f3-422d-ba82-66cbd063bb94 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:55:32.248976 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-5b8cd98c-32f3-422d-ba82-66cbd063bb94 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] 10.222.0.31 "GET /compute/v2.1/servers/406b5ad6-698e-457f-93f4-cdfd45fb3e8e" status: 200 len: 1747 microversion: 2.20 time: 0.171627 Apr 29 08:55:32.249571 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 249/505] 10.222.0.31 () {60 vars in 1276 bytes} [Fri Apr 29 08:55:32 2022] GET /compute/v2.1/servers/406b5ad6-698e-457f-93f4-cdfd45fb3e8e => generated 1747 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 29 08:55:32.376920 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-2e2aefd0-bcd8-49a6-876b-22e19043ced5 tempest-VolumesSnapshotTestJSON-1697003112 tempest-VolumesSnapshotTestJSON-1697003112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a210cf812fb54682ac28a13a5dce0563', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c0d26c7abcc4bc7b175ac175bb5f2ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:55:32.385372 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-2e2aefd0-bcd8-49a6-876b-22e19043ced5 tempest-VolumesSnapshotTestJSON-1697003112 tempest-VolumesSnapshotTestJSON-1697003112-project] 10.222.0.31 "GET /compute/v2.1/servers/4a2c7e29-e0ec-456b-bd06-ff7127f84e54" status: 200 len: 1319 microversion: 2.1 time: 0.158294 Apr 29 08:55:32.385963 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 257/506] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 08:55:32 2022] GET /compute/v2.1/servers/4a2c7e29-e0ec-456b-bd06-ff7127f84e54 => generated 1319 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 29 08:55:32.767908 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-ce4a3417-743c-4fcf-a4b7-3c500241fccf tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Calling method '>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:55:32.769161 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-ce4a3417-743c-4fcf-a4b7-3c500241fccf tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] [instance: f4be98bb-be88-421f-a448-f04a4f97702b] Fetching instance by UUID {{(pid=123459) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:55:32.775834 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-ce4a3417-743c-4fcf-a4b7-3c500241fccf tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:55:32.776319 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-ce4a3417-743c-4fcf-a4b7-3c500241fccf tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:55:32.777092 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-ce4a3417-743c-4fcf-a4b7-3c500241fccf tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:55:32.777532 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-ce4a3417-743c-4fcf-a4b7-3c500241fccf tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:55:32.820948 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-1b59aa7f-4f69-4b8f-b5e0-5e21c7f0c469 tempest-VolumesNegativeTest-45234477 tempest-VolumesNegativeTest-45234477-project] Calling method '>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:55:32.821678 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-1b59aa7f-4f69-4b8f-b5e0-5e21c7f0c469 tempest-VolumesNegativeTest-45234477 tempest-VolumesNegativeTest-45234477-project] [instance: 1bcda922-2a2b-4382-9d9e-f083519473d8] Fetching instance by UUID {{(pid=123458) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:55:32.827602 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-1b59aa7f-4f69-4b8f-b5e0-5e21c7f0c469 tempest-VolumesNegativeTest-45234477 tempest-VolumesNegativeTest-45234477-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:55:32.828117 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-1b59aa7f-4f69-4b8f-b5e0-5e21c7f0c469 tempest-VolumesNegativeTest-45234477 tempest-VolumesNegativeTest-45234477-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:55:32.828982 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-1b59aa7f-4f69-4b8f-b5e0-5e21c7f0c469 tempest-VolumesNegativeTest-45234477 tempest-VolumesNegativeTest-45234477-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:55:32.829479 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-1b59aa7f-4f69-4b8f-b5e0-5e21c7f0c469 tempest-VolumesNegativeTest-45234477 tempest-VolumesNegativeTest-45234477-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:55:32.839061 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-ce4a3417-743c-4fcf-a4b7-3c500241fccf tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c18e88436f14dc7a2001220b87ce9ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60998f08c40446e787ead285e40665b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:55:32.846420 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-ce4a3417-743c-4fcf-a4b7-3c500241fccf tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] 10.222.0.31 "GET /compute/v2.1/servers/f4be98bb-be88-421f-a448-f04a4f97702b" status: 200 len: 1249 microversion: 2.1 time: 0.082304 Apr 29 08:55:32.846991 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 250/507] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 08:55:32 2022] GET /compute/v2.1/servers/f4be98bb-be88-421f-a448-f04a4f97702b => generated 1249 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 08:55:32.958707 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-1b59aa7f-4f69-4b8f-b5e0-5e21c7f0c469 tempest-VolumesNegativeTest-45234477 tempest-VolumesNegativeTest-45234477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '340cefa576c947d08978a99d288304c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c9877c06a2445a3a34c5d35bafeb7a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:55:32.966209 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-1b59aa7f-4f69-4b8f-b5e0-5e21c7f0c469 tempest-VolumesNegativeTest-45234477 tempest-VolumesNegativeTest-45234477-project] 10.222.0.31 "GET /compute/v2.1/servers/1bcda922-2a2b-4382-9d9e-f083519473d8" status: 200 len: 1471 microversion: 2.1 time: 0.149779 Apr 29 08:55:32.966806 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 258/508] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 08:55:32 2022] GET /compute/v2.1/servers/1bcda922-2a2b-4382-9d9e-f083519473d8 => generated 1471 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 29 08:55:32.989763 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-220ad884-df92-4a54-b7fa-328a212fe8c2 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Calling method '>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:55:32.990375 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-220ad884-df92-4a54-b7fa-328a212fe8c2 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] [instance: 21ab666e-c39f-4202-9e7a-aa431a96a130] Fetching instance by UUID {{(pid=123459) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:55:32.997213 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-220ad884-df92-4a54-b7fa-328a212fe8c2 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:55:32.997664 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-220ad884-df92-4a54-b7fa-328a212fe8c2 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:55:32.998448 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-220ad884-df92-4a54-b7fa-328a212fe8c2 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:55:32.998887 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-220ad884-df92-4a54-b7fa-328a212fe8c2 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:55:33.137425 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-220ad884-df92-4a54-b7fa-328a212fe8c2 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e47ecdfb01f447699275b13255c15d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578e6a35974d4e5c8a0cd4e5fa994259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:55:33.146812 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-220ad884-df92-4a54-b7fa-328a212fe8c2 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] 10.222.0.31 "GET /compute/v2.1/servers/21ab666e-c39f-4202-9e7a-aa431a96a130" status: 200 len: 1367 microversion: 2.1 time: 0.160815 Apr 29 08:55:33.147667 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 251/509] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 08:55:32 2022] GET /compute/v2.1/servers/21ab666e-c39f-4202-9e7a-aa431a96a130 => generated 1367 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 08:55:33.268091 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-61545980-a72d-4ad4-b6ab-d7c196108878 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Calling method '>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:55:33.268779 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-61545980-a72d-4ad4-b6ab-d7c196108878 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] [instance: 406b5ad6-698e-457f-93f4-cdfd45fb3e8e] Fetching instance by UUID {{(pid=123458) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:55:33.275792 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-61545980-a72d-4ad4-b6ab-d7c196108878 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:55:33.276365 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-61545980-a72d-4ad4-b6ab-d7c196108878 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:55:33.277075 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-61545980-a72d-4ad4-b6ab-d7c196108878 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:55:33.277713 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-61545980-a72d-4ad4-b6ab-d7c196108878 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:55:33.403824 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-a8890304-ccec-465d-ada1-82f853f1b9b6 tempest-VolumesSnapshotTestJSON-1697003112 tempest-VolumesSnapshotTestJSON-1697003112-project] Calling method '>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:55:33.404494 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-a8890304-ccec-465d-ada1-82f853f1b9b6 tempest-VolumesSnapshotTestJSON-1697003112 tempest-VolumesSnapshotTestJSON-1697003112-project] [instance: 4a2c7e29-e0ec-456b-bd06-ff7127f84e54] Fetching instance by UUID {{(pid=123459) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:55:33.412490 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-a8890304-ccec-465d-ada1-82f853f1b9b6 tempest-VolumesSnapshotTestJSON-1697003112 tempest-VolumesSnapshotTestJSON-1697003112-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:55:33.412941 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-a8890304-ccec-465d-ada1-82f853f1b9b6 tempest-VolumesSnapshotTestJSON-1697003112 tempest-VolumesSnapshotTestJSON-1697003112-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:55:33.413729 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-a8890304-ccec-465d-ada1-82f853f1b9b6 tempest-VolumesSnapshotTestJSON-1697003112 tempest-VolumesSnapshotTestJSON-1697003112-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:55:33.414168 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-a8890304-ccec-465d-ada1-82f853f1b9b6 tempest-VolumesSnapshotTestJSON-1697003112 tempest-VolumesSnapshotTestJSON-1697003112-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:55:33.414970 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-61545980-a72d-4ad4-b6ab-d7c196108878 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:55:33.423250 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-61545980-a72d-4ad4-b6ab-d7c196108878 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:55:33.424856 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-61545980-a72d-4ad4-b6ab-d7c196108878 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:55:33.426144 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-61545980-a72d-4ad4-b6ab-d7c196108878 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] 10.222.0.31 "GET /compute/v2.1/servers/406b5ad6-698e-457f-93f4-cdfd45fb3e8e" status: 200 len: 1747 microversion: 2.20 time: 0.161971 Apr 29 08:55:33.426710 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 259/510] 10.222.0.31 () {60 vars in 1276 bytes} [Fri Apr 29 08:55:33 2022] GET /compute/v2.1/servers/406b5ad6-698e-457f-93f4-cdfd45fb3e8e => generated 1747 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 29 08:55:33.558771 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-a8890304-ccec-465d-ada1-82f853f1b9b6 tempest-VolumesSnapshotTestJSON-1697003112 tempest-VolumesSnapshotTestJSON-1697003112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a210cf812fb54682ac28a13a5dce0563', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c0d26c7abcc4bc7b175ac175bb5f2ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:55:33.566424 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-a8890304-ccec-465d-ada1-82f853f1b9b6 tempest-VolumesSnapshotTestJSON-1697003112 tempest-VolumesSnapshotTestJSON-1697003112-project] 10.222.0.31 "GET /compute/v2.1/servers/4a2c7e29-e0ec-456b-bd06-ff7127f84e54" status: 200 len: 1508 microversion: 2.1 time: 0.166942 Apr 29 08:55:33.567253 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 252/511] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 08:55:33 2022] GET /compute/v2.1/servers/4a2c7e29-e0ec-456b-bd06-ff7127f84e54 => generated 1508 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 29 08:55:33.583697 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-ccc5cfdb-72dd-4f0f-a873-61c01ed3209a tempest-VolumesSnapshotTestJSON-1697003112 tempest-VolumesSnapshotTestJSON-1697003112-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "33ed02bf-60cc-4995-93ff-a4495d02b345", "device": "/dev/sdb"}} {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 29 08:55:33.585340 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-ccc5cfdb-72dd-4f0f-a873-61c01ed3209a tempest-VolumesSnapshotTestJSON-1697003112 tempest-VolumesSnapshotTestJSON-1697003112-project] [instance: 4a2c7e29-e0ec-456b-bd06-ff7127f84e54] Fetching instance by UUID {{(pid=123458) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:55:33.591458 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-ccc5cfdb-72dd-4f0f-a873-61c01ed3209a tempest-VolumesSnapshotTestJSON-1697003112 tempest-VolumesSnapshotTestJSON-1697003112-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:55:33.591900 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-ccc5cfdb-72dd-4f0f-a873-61c01ed3209a tempest-VolumesSnapshotTestJSON-1697003112 tempest-VolumesSnapshotTestJSON-1697003112-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:55:33.592702 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-ccc5cfdb-72dd-4f0f-a873-61c01ed3209a tempest-VolumesSnapshotTestJSON-1697003112 tempest-VolumesSnapshotTestJSON-1697003112-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:55:33.593134 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-ccc5cfdb-72dd-4f0f-a873-61c01ed3209a tempest-VolumesSnapshotTestJSON-1697003112 tempest-VolumesSnapshotTestJSON-1697003112-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:55:33.868192 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-7d09de93-9e6f-4371-8780-ae535205e269 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Calling method '>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:55:33.869105 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-7d09de93-9e6f-4371-8780-ae535205e269 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] [instance: f4be98bb-be88-421f-a448-f04a4f97702b] Fetching instance by UUID {{(pid=123459) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:55:33.877030 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-7d09de93-9e6f-4371-8780-ae535205e269 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:55:33.877396 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-7d09de93-9e6f-4371-8780-ae535205e269 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:55:33.878187 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-7d09de93-9e6f-4371-8780-ae535205e269 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:55:33.879146 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-7d09de93-9e6f-4371-8780-ae535205e269 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:55:33.954796 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-7d09de93-9e6f-4371-8780-ae535205e269 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c18e88436f14dc7a2001220b87ce9ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60998f08c40446e787ead285e40665b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:55:33.963406 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-7d09de93-9e6f-4371-8780-ae535205e269 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] 10.222.0.31 "GET /compute/v2.1/servers/f4be98bb-be88-421f-a448-f04a4f97702b" status: 200 len: 1249 microversion: 2.1 time: 0.103431 Apr 29 08:55:33.963954 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 253/512] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 08:55:33 2022] GET /compute/v2.1/servers/f4be98bb-be88-421f-a448-f04a4f97702b => generated 1249 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 08:55:33.984514 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-5d5f3679-77be-4b1e-aa7d-6995b3b3a432 tempest-VolumesNegativeTest-45234477 tempest-VolumesNegativeTest-45234477-project] Calling method '>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:55:33.985137 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-5d5f3679-77be-4b1e-aa7d-6995b3b3a432 tempest-VolumesNegativeTest-45234477 tempest-VolumesNegativeTest-45234477-project] [instance: 1bcda922-2a2b-4382-9d9e-f083519473d8] Fetching instance by UUID {{(pid=123459) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:55:33.992299 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-5d5f3679-77be-4b1e-aa7d-6995b3b3a432 tempest-VolumesNegativeTest-45234477 tempest-VolumesNegativeTest-45234477-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:55:33.992747 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-5d5f3679-77be-4b1e-aa7d-6995b3b3a432 tempest-VolumesNegativeTest-45234477 tempest-VolumesNegativeTest-45234477-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:55:33.993529 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-5d5f3679-77be-4b1e-aa7d-6995b3b3a432 tempest-VolumesNegativeTest-45234477 tempest-VolumesNegativeTest-45234477-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:55:33.993962 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-5d5f3679-77be-4b1e-aa7d-6995b3b3a432 tempest-VolumesNegativeTest-45234477 tempest-VolumesNegativeTest-45234477-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:55:34.126624 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-5d5f3679-77be-4b1e-aa7d-6995b3b3a432 tempest-VolumesNegativeTest-45234477 tempest-VolumesNegativeTest-45234477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '340cefa576c947d08978a99d288304c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c9877c06a2445a3a34c5d35bafeb7a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:55:34.135434 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-5d5f3679-77be-4b1e-aa7d-6995b3b3a432 tempest-VolumesNegativeTest-45234477 tempest-VolumesNegativeTest-45234477-project] 10.222.0.31 "GET /compute/v2.1/servers/1bcda922-2a2b-4382-9d9e-f083519473d8" status: 200 len: 1471 microversion: 2.1 time: 0.154794 Apr 29 08:55:34.135934 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 254/513] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 08:55:33 2022] GET /compute/v2.1/servers/1bcda922-2a2b-4382-9d9e-f083519473d8 => generated 1471 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 29 08:55:34.164105 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-0e774b13-61ec-48a6-86c5-dd175b40643a tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Calling method '>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:55:34.164720 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-0e774b13-61ec-48a6-86c5-dd175b40643a tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] [instance: 21ab666e-c39f-4202-9e7a-aa431a96a130] Fetching instance by UUID {{(pid=123459) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:55:34.170562 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-0e774b13-61ec-48a6-86c5-dd175b40643a tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:55:34.171008 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-0e774b13-61ec-48a6-86c5-dd175b40643a tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:55:34.171777 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-0e774b13-61ec-48a6-86c5-dd175b40643a tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:55:34.172242 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-0e774b13-61ec-48a6-86c5-dd175b40643a tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:55:34.303116 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-0e774b13-61ec-48a6-86c5-dd175b40643a tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e47ecdfb01f447699275b13255c15d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578e6a35974d4e5c8a0cd4e5fa994259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:55:34.310375 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-0e774b13-61ec-48a6-86c5-dd175b40643a tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] 10.222.0.31 "GET /compute/v2.1/servers/21ab666e-c39f-4202-9e7a-aa431a96a130" status: 200 len: 1367 microversion: 2.1 time: 0.150430 Apr 29 08:55:34.310918 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 255/514] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 08:55:34 2022] GET /compute/v2.1/servers/21ab666e-c39f-4202-9e7a-aa431a96a130 => generated 1367 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 29 08:55:34.444634 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-89a6fb5b-6ea5-452e-9a1d-cf7e51e53a70 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Calling method '>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:55:34.445156 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-89a6fb5b-6ea5-452e-9a1d-cf7e51e53a70 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] [instance: 406b5ad6-698e-457f-93f4-cdfd45fb3e8e] Fetching instance by UUID {{(pid=123459) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:55:34.451205 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-89a6fb5b-6ea5-452e-9a1d-cf7e51e53a70 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:55:34.451656 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-89a6fb5b-6ea5-452e-9a1d-cf7e51e53a70 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:55:34.452457 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-89a6fb5b-6ea5-452e-9a1d-cf7e51e53a70 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:55:34.452900 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-89a6fb5b-6ea5-452e-9a1d-cf7e51e53a70 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:55:34.585591 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-89a6fb5b-6ea5-452e-9a1d-cf7e51e53a70 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:55:34.593884 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-89a6fb5b-6ea5-452e-9a1d-cf7e51e53a70 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:55:34.595984 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-89a6fb5b-6ea5-452e-9a1d-cf7e51e53a70 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:55:34.597199 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-89a6fb5b-6ea5-452e-9a1d-cf7e51e53a70 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] 10.222.0.31 "GET /compute/v2.1/servers/406b5ad6-698e-457f-93f4-cdfd45fb3e8e" status: 200 len: 1747 microversion: 2.20 time: 0.157319 Apr 29 08:55:34.598529 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 256/515] 10.222.0.31 () {60 vars in 1276 bytes} [Fri Apr 29 08:55:34 2022] GET /compute/v2.1/servers/406b5ad6-698e-457f-93f4-cdfd45fb3e8e => generated 1747 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 29 08:55:34.980144 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-9c30130c-b686-4ebd-bc14-7e457b386de2 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Calling method '>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:55:34.980865 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-9c30130c-b686-4ebd-bc14-7e457b386de2 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] [instance: f4be98bb-be88-421f-a448-f04a4f97702b] Fetching instance by UUID {{(pid=123459) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:55:34.987115 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-9c30130c-b686-4ebd-bc14-7e457b386de2 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:55:34.987566 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-9c30130c-b686-4ebd-bc14-7e457b386de2 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:55:34.988982 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-9c30130c-b686-4ebd-bc14-7e457b386de2 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:55:34.989429 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-9c30130c-b686-4ebd-bc14-7e457b386de2 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:55:35.053191 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-9c30130c-b686-4ebd-bc14-7e457b386de2 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c18e88436f14dc7a2001220b87ce9ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60998f08c40446e787ead285e40665b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:55:35.060614 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-9c30130c-b686-4ebd-bc14-7e457b386de2 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] 10.222.0.31 "GET /compute/v2.1/servers/f4be98bb-be88-421f-a448-f04a4f97702b" status: 200 len: 1241 microversion: 2.1 time: 0.084367 Apr 29 08:55:35.061194 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 257/516] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 08:55:34 2022] GET /compute/v2.1/servers/f4be98bb-be88-421f-a448-f04a4f97702b => generated 1241 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 29 08:55:35.153019 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-5ac5dd6c-0bad-4b5b-bbbc-6b5b0599b967 tempest-VolumesNegativeTest-45234477 tempest-VolumesNegativeTest-45234477-project] Calling method '>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:55:35.153627 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-5ac5dd6c-0bad-4b5b-bbbc-6b5b0599b967 tempest-VolumesNegativeTest-45234477 tempest-VolumesNegativeTest-45234477-project] [instance: 1bcda922-2a2b-4382-9d9e-f083519473d8] Fetching instance by UUID {{(pid=123459) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:55:35.159699 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-5ac5dd6c-0bad-4b5b-bbbc-6b5b0599b967 tempest-VolumesNegativeTest-45234477 tempest-VolumesNegativeTest-45234477-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:55:35.160175 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-5ac5dd6c-0bad-4b5b-bbbc-6b5b0599b967 tempest-VolumesNegativeTest-45234477 tempest-VolumesNegativeTest-45234477-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:55:35.160959 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-5ac5dd6c-0bad-4b5b-bbbc-6b5b0599b967 tempest-VolumesNegativeTest-45234477 tempest-VolumesNegativeTest-45234477-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:55:35.161417 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-5ac5dd6c-0bad-4b5b-bbbc-6b5b0599b967 tempest-VolumesNegativeTest-45234477 tempest-VolumesNegativeTest-45234477-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:55:35.294036 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-5ac5dd6c-0bad-4b5b-bbbc-6b5b0599b967 tempest-VolumesNegativeTest-45234477 tempest-VolumesNegativeTest-45234477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '340cefa576c947d08978a99d288304c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c9877c06a2445a3a34c5d35bafeb7a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:55:35.301377 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-5ac5dd6c-0bad-4b5b-bbbc-6b5b0599b967 tempest-VolumesNegativeTest-45234477 tempest-VolumesNegativeTest-45234477-project] 10.222.0.31 "GET /compute/v2.1/servers/1bcda922-2a2b-4382-9d9e-f083519473d8" status: 200 len: 1471 microversion: 2.1 time: 0.152274 Apr 29 08:55:35.301940 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 258/517] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 08:55:35 2022] GET /compute/v2.1/servers/1bcda922-2a2b-4382-9d9e-f083519473d8 => generated 1471 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 29 08:55:35.327215 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-e17612d9-2549-466a-99b7-92c54f16e8cf tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Calling method '>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:55:35.327825 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-e17612d9-2549-466a-99b7-92c54f16e8cf tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] [instance: 21ab666e-c39f-4202-9e7a-aa431a96a130] Fetching instance by UUID {{(pid=123459) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:55:35.334559 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-e17612d9-2549-466a-99b7-92c54f16e8cf tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:55:35.335011 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-e17612d9-2549-466a-99b7-92c54f16e8cf tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:55:35.335786 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-e17612d9-2549-466a-99b7-92c54f16e8cf tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:55:35.336268 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-e17612d9-2549-466a-99b7-92c54f16e8cf tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:55:35.470509 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-e17612d9-2549-466a-99b7-92c54f16e8cf tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e47ecdfb01f447699275b13255c15d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578e6a35974d4e5c8a0cd4e5fa994259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:55:35.478751 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-e17612d9-2549-466a-99b7-92c54f16e8cf tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] 10.222.0.31 "GET /compute/v2.1/servers/21ab666e-c39f-4202-9e7a-aa431a96a130" status: 200 len: 1367 microversion: 2.1 time: 0.155189 Apr 29 08:55:35.479328 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 259/518] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 08:55:35 2022] GET /compute/v2.1/servers/21ab666e-c39f-4202-9e7a-aa431a96a130 => generated 1367 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 29 08:55:35.616628 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-1f2ad541-a457-456d-aabd-532029752ec6 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Calling method '>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:55:35.617147 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-1f2ad541-a457-456d-aabd-532029752ec6 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] [instance: 406b5ad6-698e-457f-93f4-cdfd45fb3e8e] Fetching instance by UUID {{(pid=123459) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:55:35.623249 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-1f2ad541-a457-456d-aabd-532029752ec6 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:55:35.623692 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-1f2ad541-a457-456d-aabd-532029752ec6 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:55:35.624503 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-1f2ad541-a457-456d-aabd-532029752ec6 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:55:35.624940 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-1f2ad541-a457-456d-aabd-532029752ec6 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:55:35.763024 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-1f2ad541-a457-456d-aabd-532029752ec6 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:55:35.771424 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-1f2ad541-a457-456d-aabd-532029752ec6 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:55:35.772978 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-1f2ad541-a457-456d-aabd-532029752ec6 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:55:35.774184 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-1f2ad541-a457-456d-aabd-532029752ec6 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] 10.222.0.31 "GET /compute/v2.1/servers/406b5ad6-698e-457f-93f4-cdfd45fb3e8e" status: 200 len: 1747 microversion: 2.20 time: 0.162412 Apr 29 08:55:35.774755 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 260/519] 10.222.0.31 () {60 vars in 1276 bytes} [Fri Apr 29 08:55:35 2022] GET /compute/v2.1/servers/406b5ad6-698e-457f-93f4-cdfd45fb3e8e => generated 1747 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 29 08:55:36.078892 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-e5349c90-db21-45bf-baf0-da92369340ee tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Calling method '>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:55:36.079548 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-e5349c90-db21-45bf-baf0-da92369340ee tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] [instance: f4be98bb-be88-421f-a448-f04a4f97702b] Fetching instance by UUID {{(pid=123459) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:55:36.086149 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-e5349c90-db21-45bf-baf0-da92369340ee tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:55:36.086593 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-e5349c90-db21-45bf-baf0-da92369340ee tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:55:36.087362 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-e5349c90-db21-45bf-baf0-da92369340ee tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:55:36.087797 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-e5349c90-db21-45bf-baf0-da92369340ee tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:55:36.151416 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-e5349c90-db21-45bf-baf0-da92369340ee tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c18e88436f14dc7a2001220b87ce9ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60998f08c40446e787ead285e40665b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:55:36.159007 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-e5349c90-db21-45bf-baf0-da92369340ee tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] 10.222.0.31 "GET /compute/v2.1/servers/f4be98bb-be88-421f-a448-f04a4f97702b" status: 200 len: 1297 microversion: 2.1 time: 0.083964 Apr 29 08:55:36.159587 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 261/520] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 08:55:36 2022] GET /compute/v2.1/servers/f4be98bb-be88-421f-a448-f04a4f97702b => generated 1297 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 29 08:55:36.323689 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-931d10a0-d8a7-4ca2-9139-2f5728d299e4 tempest-VolumesNegativeTest-45234477 tempest-VolumesNegativeTest-45234477-project] Calling method '>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:55:36.325099 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-931d10a0-d8a7-4ca2-9139-2f5728d299e4 tempest-VolumesNegativeTest-45234477 tempest-VolumesNegativeTest-45234477-project] [instance: 1bcda922-2a2b-4382-9d9e-f083519473d8] Fetching instance by UUID {{(pid=123459) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:55:36.336769 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-931d10a0-d8a7-4ca2-9139-2f5728d299e4 tempest-VolumesNegativeTest-45234477 tempest-VolumesNegativeTest-45234477-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:55:36.337636 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-931d10a0-d8a7-4ca2-9139-2f5728d299e4 tempest-VolumesNegativeTest-45234477 tempest-VolumesNegativeTest-45234477-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:55:36.339124 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-931d10a0-d8a7-4ca2-9139-2f5728d299e4 tempest-VolumesNegativeTest-45234477 tempest-VolumesNegativeTest-45234477-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:55:36.339876 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-931d10a0-d8a7-4ca2-9139-2f5728d299e4 tempest-VolumesNegativeTest-45234477 tempest-VolumesNegativeTest-45234477-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:55:36.343159 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-ccc5cfdb-72dd-4f0f-a873-61c01ed3209a tempest-VolumesSnapshotTestJSON-1697003112 tempest-VolumesSnapshotTestJSON-1697003112-project] 10.222.0.31 "POST /compute/v2.1/servers/4a2c7e29-e0ec-456b-bd06-ff7127f84e54/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.763168 Apr 29 08:55:36.347748 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 260/521] 10.222.0.31 () {60 vars in 1322 bytes} [Fri Apr 29 08:55:33 2022] POST /compute/v2.1/servers/4a2c7e29-e0ec-456b-bd06-ff7127f84e54/os-volume_attachments => generated 194 bytes in 2769 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 29 08:55:36.453558 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [req-c3996c9a-a8db-49c9-b851-c6b95fc91df0 req-2c899830-bcd2-4709-9a22-ced60b2513f0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "21ab666e-c39f-4202-9e7a-aa431a96a130", "name": "network-vif-plugged", "status": "completed", "tag": "9e72371e-8d60-4d5c-8356-4c1a4228bf38"}]} {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 29 08:55:36.469712 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [req-c3996c9a-a8db-49c9-b851-c6b95fc91df0 req-2c899830-bcd2-4709-9a22-ced60b2513f0 service nova] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:55:36.470168 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [req-c3996c9a-a8db-49c9-b851-c6b95fc91df0 req-2c899830-bcd2-4709-9a22-ced60b2513f0 service nova] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:55:36.497896 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.compute.server_external_events [req-c3996c9a-a8db-49c9-b851-c6b95fc91df0 req-2c899830-bcd2-4709-9a22-ced60b2513f0 service nova] Creating event network-vif-plugged:9e72371e-8d60-4d5c-8356-4c1a4228bf38 for instance 21ab666e-c39f-4202-9e7a-aa431a96a130 on hv-cinder-83987 Apr 29 08:55:36.503841 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [req-c3996c9a-a8db-49c9-b851-c6b95fc91df0 req-2c899830-bcd2-4709-9a22-ced60b2513f0 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055201 Apr 29 08:55:36.504493 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 261/522] 10.222.0.31 () {64 vars in 1317 bytes} [Fri Apr 29 08:55:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 29 08:55:36.511728 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-528ad502-a280-4e16-aab2-4720c79cc2d0 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Calling method '>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:55:36.513483 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-528ad502-a280-4e16-aab2-4720c79cc2d0 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] [instance: 21ab666e-c39f-4202-9e7a-aa431a96a130] Fetching instance by UUID {{(pid=123458) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:55:36.520734 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-931d10a0-d8a7-4ca2-9139-2f5728d299e4 tempest-VolumesNegativeTest-45234477 tempest-VolumesNegativeTest-45234477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '340cefa576c947d08978a99d288304c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c9877c06a2445a3a34c5d35bafeb7a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:55:36.529046 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-528ad502-a280-4e16-aab2-4720c79cc2d0 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:55:36.529502 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-528ad502-a280-4e16-aab2-4720c79cc2d0 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:55:36.530103 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-931d10a0-d8a7-4ca2-9139-2f5728d299e4 tempest-VolumesNegativeTest-45234477 tempest-VolumesNegativeTest-45234477-project] 10.222.0.31 "GET /compute/v2.1/servers/1bcda922-2a2b-4382-9d9e-f083519473d8" status: 200 len: 1471 microversion: 2.1 time: 0.213263 Apr 29 08:55:36.530295 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-528ad502-a280-4e16-aab2-4720c79cc2d0 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:55:36.531066 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 262/523] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 08:55:36 2022] GET /compute/v2.1/servers/1bcda922-2a2b-4382-9d9e-f083519473d8 => generated 1471 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 29 08:55:36.531259 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-528ad502-a280-4e16-aab2-4720c79cc2d0 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:55:36.705816 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-528ad502-a280-4e16-aab2-4720c79cc2d0 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e47ecdfb01f447699275b13255c15d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578e6a35974d4e5c8a0cd4e5fa994259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:55:36.715603 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-528ad502-a280-4e16-aab2-4720c79cc2d0 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] 10.222.0.31 "GET /compute/v2.1/servers/21ab666e-c39f-4202-9e7a-aa431a96a130" status: 200 len: 1367 microversion: 2.1 time: 0.208880 Apr 29 08:55:36.716500 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 262/524] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 08:55:36 2022] GET /compute/v2.1/servers/21ab666e-c39f-4202-9e7a-aa431a96a130 => generated 1367 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 08:55:36.793546 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-6dac566c-961d-4b66-8015-307e16359c4b tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Calling method '>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:55:36.794313 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-6dac566c-961d-4b66-8015-307e16359c4b tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] [instance: 406b5ad6-698e-457f-93f4-cdfd45fb3e8e] Fetching instance by UUID {{(pid=123459) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:55:36.801124 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-6dac566c-961d-4b66-8015-307e16359c4b tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:55:36.801736 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-6dac566c-961d-4b66-8015-307e16359c4b tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:55:36.803367 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-6dac566c-961d-4b66-8015-307e16359c4b tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:55:36.804172 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-6dac566c-961d-4b66-8015-307e16359c4b tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:55:37.068086 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-6dac566c-961d-4b66-8015-307e16359c4b tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:55:37.081334 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-6dac566c-961d-4b66-8015-307e16359c4b tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:55:37.082929 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-6dac566c-961d-4b66-8015-307e16359c4b tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:55:37.085536 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-6dac566c-961d-4b66-8015-307e16359c4b tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] 10.222.0.31 "GET /compute/v2.1/servers/406b5ad6-698e-457f-93f4-cdfd45fb3e8e" status: 200 len: 1742 microversion: 2.20 time: 0.296054 Apr 29 08:55:37.089987 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 263/525] 10.222.0.31 () {60 vars in 1276 bytes} [Fri Apr 29 08:55:36 2022] GET /compute/v2.1/servers/406b5ad6-698e-457f-93f4-cdfd45fb3e8e => generated 1742 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 29 08:55:37.176478 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-f0133b29-beb3-40d0-af01-a48b7546f542 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Calling method '>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:55:37.177409 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-f0133b29-beb3-40d0-af01-a48b7546f542 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] [instance: f4be98bb-be88-421f-a448-f04a4f97702b] Fetching instance by UUID {{(pid=123458) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:55:37.186400 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-f0133b29-beb3-40d0-af01-a48b7546f542 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:55:37.187146 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-f0133b29-beb3-40d0-af01-a48b7546f542 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:55:37.188093 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-f0133b29-beb3-40d0-af01-a48b7546f542 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:55:37.188855 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-f0133b29-beb3-40d0-af01-a48b7546f542 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:55:37.274909 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-f0133b29-beb3-40d0-af01-a48b7546f542 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c18e88436f14dc7a2001220b87ce9ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60998f08c40446e787ead285e40665b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:55:37.283522 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-f0133b29-beb3-40d0-af01-a48b7546f542 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] 10.222.0.31 "GET /compute/v2.1/servers/f4be98bb-be88-421f-a448-f04a4f97702b" status: 200 len: 1303 microversion: 2.1 time: 0.110957 Apr 29 08:55:37.284796 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 263/526] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 08:55:37 2022] GET /compute/v2.1/servers/f4be98bb-be88-421f-a448-f04a4f97702b => generated 1303 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 08:55:37.423076 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [req-f0079503-403c-40ea-980d-2ac336249cc1 req-b5c6fb4d-fc50-4f98-8d89-613b3cd9545f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1bcda922-2a2b-4382-9d9e-f083519473d8", "name": "network-vif-deleted", "tag": "d36cb7cb-6510-45a5-844a-79c10ae9bc6d"}]} {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 29 08:55:37.442289 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [req-f0079503-403c-40ea-980d-2ac336249cc1 req-b5c6fb4d-fc50-4f98-8d89-613b3cd9545f service nova] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:55:37.443119 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [req-f0079503-403c-40ea-980d-2ac336249cc1 req-b5c6fb4d-fc50-4f98-8d89-613b3cd9545f service nova] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:55:37.476264 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.compute.server_external_events [req-f0079503-403c-40ea-980d-2ac336249cc1 req-b5c6fb4d-fc50-4f98-8d89-613b3cd9545f service nova] Creating event network-vif-deleted:d36cb7cb-6510-45a5-844a-79c10ae9bc6d for instance 1bcda922-2a2b-4382-9d9e-f083519473d8 on hv-cinder-83987 Apr 29 08:55:37.486860 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [req-f0079503-403c-40ea-980d-2ac336249cc1 req-b5c6fb4d-fc50-4f98-8d89-613b3cd9545f service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071773 Apr 29 08:55:37.488636 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 264/527] 10.222.0.31 () {64 vars in 1317 bytes} [Fri Apr 29 08:55:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 29 08:55:37.546855 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-1c31178c-a4c9-4eb2-8301-e2181e7be1b0 tempest-VolumesNegativeTest-45234477 tempest-VolumesNegativeTest-45234477-project] Calling method '>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:55:37.547792 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-1c31178c-a4c9-4eb2-8301-e2181e7be1b0 tempest-VolumesNegativeTest-45234477 tempest-VolumesNegativeTest-45234477-project] [instance: 1bcda922-2a2b-4382-9d9e-f083519473d8] Fetching instance by UUID {{(pid=123458) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:55:37.555838 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-1c31178c-a4c9-4eb2-8301-e2181e7be1b0 tempest-VolumesNegativeTest-45234477 tempest-VolumesNegativeTest-45234477-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:55:37.556342 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-1c31178c-a4c9-4eb2-8301-e2181e7be1b0 tempest-VolumesNegativeTest-45234477 tempest-VolumesNegativeTest-45234477-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:55:37.557137 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-1c31178c-a4c9-4eb2-8301-e2181e7be1b0 tempest-VolumesNegativeTest-45234477 tempest-VolumesNegativeTest-45234477-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:55:37.557612 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-1c31178c-a4c9-4eb2-8301-e2181e7be1b0 tempest-VolumesNegativeTest-45234477 tempest-VolumesNegativeTest-45234477-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:55:37.641131 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-1c31178c-a4c9-4eb2-8301-e2181e7be1b0 tempest-VolumesNegativeTest-45234477 tempest-VolumesNegativeTest-45234477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '340cefa576c947d08978a99d288304c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c9877c06a2445a3a34c5d35bafeb7a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:55:37.652380 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-1c31178c-a4c9-4eb2-8301-e2181e7be1b0 tempest-VolumesNegativeTest-45234477 tempest-VolumesNegativeTest-45234477-project] 10.222.0.31 "GET /compute/v2.1/servers/1bcda922-2a2b-4382-9d9e-f083519473d8" status: 200 len: 1429 microversion: 2.1 time: 0.109300 Apr 29 08:55:37.653032 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 264/528] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 08:55:37 2022] GET /compute/v2.1/servers/1bcda922-2a2b-4382-9d9e-f083519473d8 => generated 1429 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 29 08:55:37.738463 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-d21d8cb2-92ed-4cd0-a491-a8301ebc42a9 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Calling method '>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:55:37.740342 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-d21d8cb2-92ed-4cd0-a491-a8301ebc42a9 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] [instance: 21ab666e-c39f-4202-9e7a-aa431a96a130] Fetching instance by UUID {{(pid=123459) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:55:37.753631 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-d21d8cb2-92ed-4cd0-a491-a8301ebc42a9 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:55:37.754419 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-d21d8cb2-92ed-4cd0-a491-a8301ebc42a9 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:55:37.757267 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-d21d8cb2-92ed-4cd0-a491-a8301ebc42a9 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:55:37.757991 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-d21d8cb2-92ed-4cd0-a491-a8301ebc42a9 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:55:37.985156 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-d21d8cb2-92ed-4cd0-a491-a8301ebc42a9 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e47ecdfb01f447699275b13255c15d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578e6a35974d4e5c8a0cd4e5fa994259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:55:37.994830 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-d21d8cb2-92ed-4cd0-a491-a8301ebc42a9 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] 10.222.0.31 "GET /compute/v2.1/servers/21ab666e-c39f-4202-9e7a-aa431a96a130" status: 200 len: 1367 microversion: 2.1 time: 0.263804 Apr 29 08:55:37.996019 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 265/529] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 08:55:37 2022] GET /compute/v2.1/servers/21ab666e-c39f-4202-9e7a-aa431a96a130 => generated 1367 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 08:55:38.107191 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-bfec789a-eeb7-419c-8e96-6290b999f00d tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Calling method '>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:55:38.108283 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-bfec789a-eeb7-419c-8e96-6290b999f00d tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] [instance: 406b5ad6-698e-457f-93f4-cdfd45fb3e8e] Fetching instance by UUID {{(pid=123458) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:55:38.116981 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-bfec789a-eeb7-419c-8e96-6290b999f00d tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:55:38.117729 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-bfec789a-eeb7-419c-8e96-6290b999f00d tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:55:38.118581 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-bfec789a-eeb7-419c-8e96-6290b999f00d tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:55:38.119032 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-bfec789a-eeb7-419c-8e96-6290b999f00d tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:55:38.284804 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-bfec789a-eeb7-419c-8e96-6290b999f00d tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:55:38.296866 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-bfec789a-eeb7-419c-8e96-6290b999f00d tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:55:38.298725 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-bfec789a-eeb7-419c-8e96-6290b999f00d tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:55:38.300160 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-bfec789a-eeb7-419c-8e96-6290b999f00d tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] 10.222.0.31 "GET /compute/v2.1/servers/406b5ad6-698e-457f-93f4-cdfd45fb3e8e" status: 200 len: 1742 microversion: 2.20 time: 0.197263 Apr 29 08:55:38.300716 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 265/530] 10.222.0.31 () {60 vars in 1276 bytes} [Fri Apr 29 08:55:38 2022] GET /compute/v2.1/servers/406b5ad6-698e-457f-93f4-cdfd45fb3e8e => generated 1742 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 29 08:55:38.309730 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-62b3cec2-fc80-41ed-af6d-e8e690c9f347 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Calling method '>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:55:38.311754 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-62b3cec2-fc80-41ed-af6d-e8e690c9f347 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] [instance: f4be98bb-be88-421f-a448-f04a4f97702b] Fetching instance by UUID {{(pid=123459) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:55:38.323112 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-62b3cec2-fc80-41ed-af6d-e8e690c9f347 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:55:38.324907 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-62b3cec2-fc80-41ed-af6d-e8e690c9f347 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:55:38.324907 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-62b3cec2-fc80-41ed-af6d-e8e690c9f347 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:55:38.324907 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-62b3cec2-fc80-41ed-af6d-e8e690c9f347 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:55:38.458755 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-62b3cec2-fc80-41ed-af6d-e8e690c9f347 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c18e88436f14dc7a2001220b87ce9ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60998f08c40446e787ead285e40665b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:55:38.468815 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-62b3cec2-fc80-41ed-af6d-e8e690c9f347 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] 10.222.0.31 "GET /compute/v2.1/servers/f4be98bb-be88-421f-a448-f04a4f97702b" status: 200 len: 1303 microversion: 2.1 time: 0.167927 Apr 29 08:55:38.470390 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 266/531] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 08:55:38 2022] GET /compute/v2.1/servers/f4be98bb-be88-421f-a448-f04a4f97702b => generated 1303 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 29 08:55:38.671578 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-b112a700-e8d6-4548-962a-08e94e0ae1c0 tempest-VolumesNegativeTest-45234477 tempest-VolumesNegativeTest-45234477-project] Calling method '>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:55:38.672925 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-b112a700-e8d6-4548-962a-08e94e0ae1c0 tempest-VolumesNegativeTest-45234477 tempest-VolumesNegativeTest-45234477-project] [instance: 1bcda922-2a2b-4382-9d9e-f083519473d8] Fetching instance by UUID {{(pid=123458) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:55:38.681100 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-b112a700-e8d6-4548-962a-08e94e0ae1c0 tempest-VolumesNegativeTest-45234477 tempest-VolumesNegativeTest-45234477-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:55:38.681541 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-b112a700-e8d6-4548-962a-08e94e0ae1c0 tempest-VolumesNegativeTest-45234477 tempest-VolumesNegativeTest-45234477-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:55:38.682316 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-b112a700-e8d6-4548-962a-08e94e0ae1c0 tempest-VolumesNegativeTest-45234477 tempest-VolumesNegativeTest-45234477-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:55:38.682747 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-b112a700-e8d6-4548-962a-08e94e0ae1c0 tempest-VolumesNegativeTest-45234477 tempest-VolumesNegativeTest-45234477-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:55:38.752874 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-b112a700-e8d6-4548-962a-08e94e0ae1c0 tempest-VolumesNegativeTest-45234477 tempest-VolumesNegativeTest-45234477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '340cefa576c947d08978a99d288304c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c9877c06a2445a3a34c5d35bafeb7a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:55:38.762207 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-b112a700-e8d6-4548-962a-08e94e0ae1c0 tempest-VolumesNegativeTest-45234477 tempest-VolumesNegativeTest-45234477-project] 10.222.0.31 "GET /compute/v2.1/servers/1bcda922-2a2b-4382-9d9e-f083519473d8" status: 200 len: 1300 microversion: 2.1 time: 0.096194 Apr 29 08:55:38.763080 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 266/532] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 08:55:38 2022] GET /compute/v2.1/servers/1bcda922-2a2b-4382-9d9e-f083519473d8 => generated 1300 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 08:55:39.013096 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-2e1d88b0-5a5d-46ef-ad4d-683eda75c56f tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Calling method '>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:55:39.013709 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-2e1d88b0-5a5d-46ef-ad4d-683eda75c56f tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] [instance: 21ab666e-c39f-4202-9e7a-aa431a96a130] Fetching instance by UUID {{(pid=123459) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:55:39.025424 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-2e1d88b0-5a5d-46ef-ad4d-683eda75c56f tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:55:39.028540 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-2e1d88b0-5a5d-46ef-ad4d-683eda75c56f tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:55:39.029646 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-2e1d88b0-5a5d-46ef-ad4d-683eda75c56f tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:55:39.030319 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-2e1d88b0-5a5d-46ef-ad4d-683eda75c56f tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:55:39.190836 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-2e1d88b0-5a5d-46ef-ad4d-683eda75c56f tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e47ecdfb01f447699275b13255c15d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578e6a35974d4e5c8a0cd4e5fa994259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:55:39.199871 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-2e1d88b0-5a5d-46ef-ad4d-683eda75c56f tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] 10.222.0.31 "GET /compute/v2.1/servers/21ab666e-c39f-4202-9e7a-aa431a96a130" status: 200 len: 1367 microversion: 2.1 time: 0.190422 Apr 29 08:55:39.201315 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 267/533] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 08:55:39 2022] GET /compute/v2.1/servers/21ab666e-c39f-4202-9e7a-aa431a96a130 => generated 1367 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 08:55:39.340068 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-d278f251-fd1a-4595-b323-27f7068276c5 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Calling method '>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:55:39.340792 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-d278f251-fd1a-4595-b323-27f7068276c5 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] [instance: 406b5ad6-698e-457f-93f4-cdfd45fb3e8e] Fetching instance by UUID {{(pid=123458) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:55:39.348023 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-d278f251-fd1a-4595-b323-27f7068276c5 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:55:39.348496 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-d278f251-fd1a-4595-b323-27f7068276c5 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:55:39.349323 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-d278f251-fd1a-4595-b323-27f7068276c5 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:55:39.349756 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-d278f251-fd1a-4595-b323-27f7068276c5 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:55:39.495424 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-17c75ef8-6046-45fb-9b61-c5bfc6647233 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Calling method '>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:55:39.496811 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-17c75ef8-6046-45fb-9b61-c5bfc6647233 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] [instance: f4be98bb-be88-421f-a448-f04a4f97702b] Fetching instance by UUID {{(pid=123459) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:55:39.514562 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-17c75ef8-6046-45fb-9b61-c5bfc6647233 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:55:39.540461 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-17c75ef8-6046-45fb-9b61-c5bfc6647233 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:55:39.541460 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-17c75ef8-6046-45fb-9b61-c5bfc6647233 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:55:39.553748 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-17c75ef8-6046-45fb-9b61-c5bfc6647233 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:55:39.782902 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-d278f251-fd1a-4595-b323-27f7068276c5 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:55:39.797459 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-d278f251-fd1a-4595-b323-27f7068276c5 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:55:39.804676 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-d278f251-fd1a-4595-b323-27f7068276c5 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:55:39.806841 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-d278f251-fd1a-4595-b323-27f7068276c5 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] 10.222.0.31 "GET /compute/v2.1/servers/406b5ad6-698e-457f-93f4-cdfd45fb3e8e" status: 200 len: 1742 microversion: 2.20 time: 0.486103 Apr 29 08:55:39.815279 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 267/534] 10.222.0.31 () {60 vars in 1276 bytes} [Fri Apr 29 08:55:39 2022] GET /compute/v2.1/servers/406b5ad6-698e-457f-93f4-cdfd45fb3e8e => generated 1742 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 29 08:55:39.824273 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-a54910da-d512-490d-ac57-6239b21ffa58 tempest-VolumesNegativeTest-45234477 tempest-VolumesNegativeTest-45234477-project] Calling method '>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:55:39.825667 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-a54910da-d512-490d-ac57-6239b21ffa58 tempest-VolumesNegativeTest-45234477 tempest-VolumesNegativeTest-45234477-project] [instance: 1bcda922-2a2b-4382-9d9e-f083519473d8] Fetching instance by UUID {{(pid=123458) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:55:39.835590 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-a54910da-d512-490d-ac57-6239b21ffa58 tempest-VolumesNegativeTest-45234477 tempest-VolumesNegativeTest-45234477-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:55:39.836462 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-a54910da-d512-490d-ac57-6239b21ffa58 tempest-VolumesNegativeTest-45234477 tempest-VolumesNegativeTest-45234477-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:55:39.837520 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-a54910da-d512-490d-ac57-6239b21ffa58 tempest-VolumesNegativeTest-45234477 tempest-VolumesNegativeTest-45234477-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:55:39.838209 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-a54910da-d512-490d-ac57-6239b21ffa58 tempest-VolumesNegativeTest-45234477 tempest-VolumesNegativeTest-45234477-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:55:39.888704 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-17c75ef8-6046-45fb-9b61-c5bfc6647233 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c18e88436f14dc7a2001220b87ce9ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60998f08c40446e787ead285e40665b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:55:39.894428 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-a54910da-d512-490d-ac57-6239b21ffa58 tempest-VolumesNegativeTest-45234477 tempest-VolumesNegativeTest-45234477-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:55:39.895161 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-a54910da-d512-490d-ac57-6239b21ffa58 tempest-VolumesNegativeTest-45234477 tempest-VolumesNegativeTest-45234477-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:55:39.896807 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.objects.instance [None req-a54910da-d512-490d-ac57-6239b21ffa58 tempest-VolumesNegativeTest-45234477 tempest-VolumesNegativeTest-45234477-project] Lazy-loading 'fault' on Instance uuid 1bcda922-2a2b-4382-9d9e-f083519473d8 {{(pid=123458) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 29 08:55:39.914052 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-17c75ef8-6046-45fb-9b61-c5bfc6647233 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] 10.222.0.31 "GET /compute/v2.1/servers/f4be98bb-be88-421f-a448-f04a4f97702b" status: 200 len: 1370 microversion: 2.1 time: 0.429381 Apr 29 08:55:39.915072 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 268/535] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 08:55:39 2022] GET /compute/v2.1/servers/f4be98bb-be88-421f-a448-f04a4f97702b => generated 1370 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 08:55:39.970814 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-a54910da-d512-490d-ac57-6239b21ffa58 tempest-VolumesNegativeTest-45234477 tempest-VolumesNegativeTest-45234477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '340cefa576c947d08978a99d288304c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c9877c06a2445a3a34c5d35bafeb7a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:55:39.981985 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-a54910da-d512-490d-ac57-6239b21ffa58 tempest-VolumesNegativeTest-45234477 tempest-VolumesNegativeTest-45234477-project] 10.222.0.31 "GET /compute/v2.1/servers/1bcda922-2a2b-4382-9d9e-f083519473d8" status: 200 len: 1305 microversion: 2.1 time: 0.164246 Apr 29 08:55:39.983373 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 268/536] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 08:55:39 2022] GET /compute/v2.1/servers/1bcda922-2a2b-4382-9d9e-f083519473d8 => generated 1305 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 08:55:40.229321 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-542cbf67-b7bf-4b5d-be66-777c306b0af5 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Calling method '>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:55:40.232716 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-542cbf67-b7bf-4b5d-be66-777c306b0af5 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] [instance: 21ab666e-c39f-4202-9e7a-aa431a96a130] Fetching instance by UUID {{(pid=123459) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:55:40.258321 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-542cbf67-b7bf-4b5d-be66-777c306b0af5 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:55:40.265394 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-542cbf67-b7bf-4b5d-be66-777c306b0af5 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:55:40.267561 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-542cbf67-b7bf-4b5d-be66-777c306b0af5 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:55:40.268998 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-542cbf67-b7bf-4b5d-be66-777c306b0af5 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:55:40.685539 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-542cbf67-b7bf-4b5d-be66-777c306b0af5 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e47ecdfb01f447699275b13255c15d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578e6a35974d4e5c8a0cd4e5fa994259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:55:40.694132 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-542cbf67-b7bf-4b5d-be66-777c306b0af5 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] 10.222.0.31 "GET /compute/v2.1/servers/21ab666e-c39f-4202-9e7a-aa431a96a130" status: 200 len: 1557 microversion: 2.1 time: 0.479463 Apr 29 08:55:40.698852 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 269/537] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 08:55:40 2022] GET /compute/v2.1/servers/21ab666e-c39f-4202-9e7a-aa431a96a130 => generated 1557 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 08:55:40.712513 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-176d633b-f1b2-416b-a143-af33b346fea5 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Calling method '>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:55:40.713439 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-176d633b-f1b2-416b-a143-af33b346fea5 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] [instance: 21ab666e-c39f-4202-9e7a-aa431a96a130] Fetching instance by UUID {{(pid=123458) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:55:40.729899 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-176d633b-f1b2-416b-a143-af33b346fea5 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:55:40.730201 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-176d633b-f1b2-416b-a143-af33b346fea5 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:55:40.736095 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-176d633b-f1b2-416b-a143-af33b346fea5 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:55:40.741256 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-176d633b-f1b2-416b-a143-af33b346fea5 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:55:40.829783 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-c7e73f56-5b92-4c87-9419-a7889833f8ad tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Calling method '>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:55:40.830297 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-c7e73f56-5b92-4c87-9419-a7889833f8ad tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] [instance: 406b5ad6-698e-457f-93f4-cdfd45fb3e8e] Fetching instance by UUID {{(pid=123459) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:55:40.843367 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-c7e73f56-5b92-4c87-9419-a7889833f8ad tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:55:40.843825 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-c7e73f56-5b92-4c87-9419-a7889833f8ad tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:55:40.850003 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-c7e73f56-5b92-4c87-9419-a7889833f8ad tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:55:40.852393 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-c7e73f56-5b92-4c87-9419-a7889833f8ad tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:55:40.935598 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-176d633b-f1b2-416b-a143-af33b346fea5 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] 10.222.0.31 "GET /compute/v2.1/servers/21ab666e-c39f-4202-9e7a-aa431a96a130/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.227781 Apr 29 08:55:40.937258 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 269/538] 10.222.0.31 () {58 vars in 1274 bytes} [Fri Apr 29 08:55:40 2022] GET /compute/v2.1/servers/21ab666e-c39f-4202-9e7a-aa431a96a130/os-interface => generated 284 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 29 08:55:40.943195 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-5ba22ab4-fb92-41b7-b5fc-56762502af7c tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Calling method '>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:55:40.944039 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-5ba22ab4-fb92-41b7-b5fc-56762502af7c tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] [instance: f4be98bb-be88-421f-a448-f04a4f97702b] Fetching instance by UUID {{(pid=123458) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:55:40.963681 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-5ba22ab4-fb92-41b7-b5fc-56762502af7c tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:55:40.964543 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-5ba22ab4-fb92-41b7-b5fc-56762502af7c tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:55:40.966380 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-5ba22ab4-fb92-41b7-b5fc-56762502af7c tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:55:40.966909 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-5ba22ab4-fb92-41b7-b5fc-56762502af7c tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:55:41.124486 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-c7e73f56-5b92-4c87-9419-a7889833f8ad tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:55:41.135144 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-c7e73f56-5b92-4c87-9419-a7889833f8ad tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:55:41.136804 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-c7e73f56-5b92-4c87-9419-a7889833f8ad tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:55:41.138041 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-c7e73f56-5b92-4c87-9419-a7889833f8ad tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] 10.222.0.31 "GET /compute/v2.1/servers/406b5ad6-698e-457f-93f4-cdfd45fb3e8e" status: 200 len: 1742 microversion: 2.20 time: 0.312316 Apr 29 08:55:41.139002 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 270/539] 10.222.0.31 () {60 vars in 1276 bytes} [Fri Apr 29 08:55:40 2022] GET /compute/v2.1/servers/406b5ad6-698e-457f-93f4-cdfd45fb3e8e => generated 1742 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 29 08:55:41.144108 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-bb59ede6-8216-47bd-b6cb-c62e01a3f3e0 tempest-VolumesNegativeTest-45234477 tempest-VolumesNegativeTest-45234477-project] Calling method '>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:55:41.144768 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-bb59ede6-8216-47bd-b6cb-c62e01a3f3e0 tempest-VolumesNegativeTest-45234477 tempest-VolumesNegativeTest-45234477-project] [instance: 1bcda922-2a2b-4382-9d9e-f083519473d8] Fetching instance by UUID {{(pid=123459) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:55:41.152154 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-bb59ede6-8216-47bd-b6cb-c62e01a3f3e0 tempest-VolumesNegativeTest-45234477 tempest-VolumesNegativeTest-45234477-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:55:41.152632 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-bb59ede6-8216-47bd-b6cb-c62e01a3f3e0 tempest-VolumesNegativeTest-45234477 tempest-VolumesNegativeTest-45234477-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:55:41.153440 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-bb59ede6-8216-47bd-b6cb-c62e01a3f3e0 tempest-VolumesNegativeTest-45234477 tempest-VolumesNegativeTest-45234477-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:55:41.153886 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-bb59ede6-8216-47bd-b6cb-c62e01a3f3e0 tempest-VolumesNegativeTest-45234477 tempest-VolumesNegativeTest-45234477-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:55:41.170992 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.wsgi [None req-bb59ede6-8216-47bd-b6cb-c62e01a3f3e0 tempest-VolumesNegativeTest-45234477 tempest-VolumesNegativeTest-45234477-project] HTTP exception thrown: Instance 1bcda922-2a2b-4382-9d9e-f083519473d8 could not be found. Apr 29 08:55:41.171605 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-bb59ede6-8216-47bd-b6cb-c62e01a3f3e0 tempest-VolumesNegativeTest-45234477 tempest-VolumesNegativeTest-45234477-project] Returning 404 to user: Instance 1bcda922-2a2b-4382-9d9e-f083519473d8 could not be found. {{(pid=123459) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 29 08:55:41.172509 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-bb59ede6-8216-47bd-b6cb-c62e01a3f3e0 tempest-VolumesNegativeTest-45234477 tempest-VolumesNegativeTest-45234477-project] 10.222.0.31 "GET /compute/v2.1/servers/1bcda922-2a2b-4382-9d9e-f083519473d8" status: 404 len: 111 microversion: 2.1 time: 0.032287 Apr 29 08:55:41.173460 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 271/540] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 08:55:41 2022] GET /compute/v2.1/servers/1bcda922-2a2b-4382-9d9e-f083519473d8 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 29 08:55:41.421085 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-5ba22ab4-fb92-41b7-b5fc-56762502af7c tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c18e88436f14dc7a2001220b87ce9ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60998f08c40446e787ead285e40665b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:55:41.434138 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-5ba22ab4-fb92-41b7-b5fc-56762502af7c tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] 10.222.0.31 "GET /compute/v2.1/servers/f4be98bb-be88-421f-a448-f04a4f97702b" status: 200 len: 1370 microversion: 2.1 time: 0.494544 Apr 29 08:55:41.435600 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 270/541] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 08:55:40 2022] GET /compute/v2.1/servers/f4be98bb-be88-421f-a448-f04a4f97702b => generated 1370 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 08:55:42.122392 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [req-d982d514-ad67-4b9d-9626-4e9d3e0b92a8 req-2ba99497-0600-46d9-a557-bd0ff6c7e7d9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f4be98bb-be88-421f-a448-f04a4f97702b", "tag": "e6ef8121-81a9-4773-903b-5d18906a76d1"}]} {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 29 08:55:42.151138 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [req-d982d514-ad67-4b9d-9626-4e9d3e0b92a8 req-2ba99497-0600-46d9-a557-bd0ff6c7e7d9 service nova] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:55:42.158149 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [req-d982d514-ad67-4b9d-9626-4e9d3e0b92a8 req-2ba99497-0600-46d9-a557-bd0ff6c7e7d9 service nova] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:55:42.158914 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-419c4f3c-8b8d-4160-8c4d-8f5d9e3ee39a tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Calling method '>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:55:42.160073 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-419c4f3c-8b8d-4160-8c4d-8f5d9e3ee39a tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] [instance: 406b5ad6-698e-457f-93f4-cdfd45fb3e8e] Fetching instance by UUID {{(pid=123458) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:55:42.169815 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-419c4f3c-8b8d-4160-8c4d-8f5d9e3ee39a tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:55:42.182405 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-419c4f3c-8b8d-4160-8c4d-8f5d9e3ee39a tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:55:42.182597 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.compute.server_external_events [req-d982d514-ad67-4b9d-9626-4e9d3e0b92a8 req-2ba99497-0600-46d9-a557-bd0ff6c7e7d9 service nova] Creating event network-changed:e6ef8121-81a9-4773-903b-5d18906a76d1 for instance f4be98bb-be88-421f-a448-f04a4f97702b on hv-cinder-83987 Apr 29 08:55:42.188253 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-419c4f3c-8b8d-4160-8c4d-8f5d9e3ee39a tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:55:42.188906 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-419c4f3c-8b8d-4160-8c4d-8f5d9e3ee39a tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:55:42.189385 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [req-d982d514-ad67-4b9d-9626-4e9d3e0b92a8 req-2ba99497-0600-46d9-a557-bd0ff6c7e7d9 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071929 Apr 29 08:55:42.190491 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 272/542] 10.222.0.31 () {64 vars in 1317 bytes} [Fri Apr 29 08:55:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 29 08:55:42.457616 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-18cc7757-660f-4247-92b3-c880a0d60cc8 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Calling method '>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:55:42.459112 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-18cc7757-660f-4247-92b3-c880a0d60cc8 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] [instance: f4be98bb-be88-421f-a448-f04a4f97702b] Fetching instance by UUID {{(pid=123459) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:55:42.475214 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-18cc7757-660f-4247-92b3-c880a0d60cc8 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:55:42.476126 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-18cc7757-660f-4247-92b3-c880a0d60cc8 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:55:42.477456 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-18cc7757-660f-4247-92b3-c880a0d60cc8 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:55:42.478123 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-18cc7757-660f-4247-92b3-c880a0d60cc8 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:55:42.683501 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-18cc7757-660f-4247-92b3-c880a0d60cc8 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c18e88436f14dc7a2001220b87ce9ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60998f08c40446e787ead285e40665b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:55:42.696426 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-18cc7757-660f-4247-92b3-c880a0d60cc8 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] 10.222.0.31 "GET /compute/v2.1/servers/f4be98bb-be88-421f-a448-f04a4f97702b" status: 200 len: 1370 microversion: 2.1 time: 0.246199 Apr 29 08:55:42.697373 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 273/543] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 08:55:42 2022] GET /compute/v2.1/servers/f4be98bb-be88-421f-a448-f04a4f97702b => generated 1370 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 08:55:42.972524 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-419c4f3c-8b8d-4160-8c4d-8f5d9e3ee39a tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:55:42.987119 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-419c4f3c-8b8d-4160-8c4d-8f5d9e3ee39a tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:55:42.990172 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-419c4f3c-8b8d-4160-8c4d-8f5d9e3ee39a tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:55:42.992414 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-419c4f3c-8b8d-4160-8c4d-8f5d9e3ee39a tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] 10.222.0.31 "GET /compute/v2.1/servers/406b5ad6-698e-457f-93f4-cdfd45fb3e8e" status: 200 len: 1742 microversion: 2.20 time: 0.838130 Apr 29 08:55:42.993769 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 271/544] 10.222.0.31 () {60 vars in 1276 bytes} [Fri Apr 29 08:55:42 2022] GET /compute/v2.1/servers/406b5ad6-698e-457f-93f4-cdfd45fb3e8e => generated 1742 bytes in 840 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 29 08:55:43.716626 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-334cbe94-2d1f-4951-9b4c-940d776a4994 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Calling method '>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:55:43.717233 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-334cbe94-2d1f-4951-9b4c-940d776a4994 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] [instance: f4be98bb-be88-421f-a448-f04a4f97702b] Fetching instance by UUID {{(pid=123459) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:55:43.732070 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-334cbe94-2d1f-4951-9b4c-940d776a4994 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:55:43.732550 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-334cbe94-2d1f-4951-9b4c-940d776a4994 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:55:43.733489 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-334cbe94-2d1f-4951-9b4c-940d776a4994 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:55:43.736492 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-334cbe94-2d1f-4951-9b4c-940d776a4994 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:55:43.963642 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-334cbe94-2d1f-4951-9b4c-940d776a4994 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c18e88436f14dc7a2001220b87ce9ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60998f08c40446e787ead285e40665b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:55:43.973467 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-334cbe94-2d1f-4951-9b4c-940d776a4994 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] 10.222.0.31 "GET /compute/v2.1/servers/f4be98bb-be88-421f-a448-f04a4f97702b" status: 200 len: 1370 microversion: 2.1 time: 0.261575 Apr 29 08:55:43.975147 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 274/545] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 08:55:43 2022] GET /compute/v2.1/servers/f4be98bb-be88-421f-a448-f04a4f97702b => generated 1370 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 08:55:44.011537 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-470fd074-6e90-476c-8438-a6bf6dec2093 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Calling method '>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:55:44.012170 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-470fd074-6e90-476c-8438-a6bf6dec2093 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] [instance: 406b5ad6-698e-457f-93f4-cdfd45fb3e8e] Fetching instance by UUID {{(pid=123458) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:55:44.019034 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-470fd074-6e90-476c-8438-a6bf6dec2093 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:55:44.019589 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-470fd074-6e90-476c-8438-a6bf6dec2093 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:55:44.033942 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-470fd074-6e90-476c-8438-a6bf6dec2093 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:55:44.034545 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-470fd074-6e90-476c-8438-a6bf6dec2093 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:55:44.266787 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [req-8ff8de68-45c1-4677-8ebd-653b7d4a5cb8 req-7a3cd1f6-219d-4959-9f20-ec59f977ae66 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "21ab666e-c39f-4202-9e7a-aa431a96a130", "tag": "9e72371e-8d60-4d5c-8356-4c1a4228bf38"}]} {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 29 08:55:44.274655 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-470fd074-6e90-476c-8438-a6bf6dec2093 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:55:44.283065 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-470fd074-6e90-476c-8438-a6bf6dec2093 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:55:44.283629 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [req-8ff8de68-45c1-4677-8ebd-653b7d4a5cb8 req-7a3cd1f6-219d-4959-9f20-ec59f977ae66 service nova] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:55:44.284078 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [req-8ff8de68-45c1-4677-8ebd-653b7d4a5cb8 req-7a3cd1f6-219d-4959-9f20-ec59f977ae66 service nova] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:55:44.285599 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-470fd074-6e90-476c-8438-a6bf6dec2093 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:55:44.287221 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-470fd074-6e90-476c-8438-a6bf6dec2093 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] 10.222.0.31 "GET /compute/v2.1/servers/406b5ad6-698e-457f-93f4-cdfd45fb3e8e" status: 200 len: 1742 microversion: 2.20 time: 0.279262 Apr 29 08:55:44.296169 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 272/546] 10.222.0.31 () {60 vars in 1276 bytes} [Fri Apr 29 08:55:44 2022] GET /compute/v2.1/servers/406b5ad6-698e-457f-93f4-cdfd45fb3e8e => generated 1742 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 29 08:55:44.308906 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.compute.server_external_events [req-8ff8de68-45c1-4677-8ebd-653b7d4a5cb8 req-7a3cd1f6-219d-4959-9f20-ec59f977ae66 service nova] Creating event network-changed:9e72371e-8d60-4d5c-8356-4c1a4228bf38 for instance 21ab666e-c39f-4202-9e7a-aa431a96a130 on hv-cinder-83987 Apr 29 08:55:44.320897 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [req-8ff8de68-45c1-4677-8ebd-653b7d4a5cb8 req-7a3cd1f6-219d-4959-9f20-ec59f977ae66 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057790 Apr 29 08:55:44.327137 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 275/547] 10.222.0.31 () {64 vars in 1317 bytes} [Fri Apr 29 08:55:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 29 08:55:44.997967 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-637a454f-a5d3-4879-9aff-9b3f845ce27c tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Calling method '>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:55:44.998886 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-637a454f-a5d3-4879-9aff-9b3f845ce27c tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] [instance: f4be98bb-be88-421f-a448-f04a4f97702b] Fetching instance by UUID {{(pid=123458) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:55:45.011435 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-637a454f-a5d3-4879-9aff-9b3f845ce27c tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:55:45.012199 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-637a454f-a5d3-4879-9aff-9b3f845ce27c tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:55:45.013619 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-637a454f-a5d3-4879-9aff-9b3f845ce27c tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:55:45.014151 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-637a454f-a5d3-4879-9aff-9b3f845ce27c tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:55:45.224975 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-637a454f-a5d3-4879-9aff-9b3f845ce27c tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c18e88436f14dc7a2001220b87ce9ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60998f08c40446e787ead285e40665b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:55:45.232941 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-637a454f-a5d3-4879-9aff-9b3f845ce27c tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] 10.222.0.31 "GET /compute/v2.1/servers/f4be98bb-be88-421f-a448-f04a4f97702b" status: 200 len: 1370 microversion: 2.1 time: 0.245965 Apr 29 08:55:45.233508 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 273/548] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 08:55:44 2022] GET /compute/v2.1/servers/f4be98bb-be88-421f-a448-f04a4f97702b => generated 1370 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 08:55:45.310217 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-8fed4f04-944e-42be-a263-4168b76716c1 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Calling method '>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:55:45.310916 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-8fed4f04-944e-42be-a263-4168b76716c1 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] [instance: 406b5ad6-698e-457f-93f4-cdfd45fb3e8e] Fetching instance by UUID {{(pid=123459) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:55:45.318933 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-8fed4f04-944e-42be-a263-4168b76716c1 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:55:45.319563 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-8fed4f04-944e-42be-a263-4168b76716c1 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:55:45.320689 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-8fed4f04-944e-42be-a263-4168b76716c1 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:55:45.321295 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-8fed4f04-944e-42be-a263-4168b76716c1 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:55:45.483717 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-8fed4f04-944e-42be-a263-4168b76716c1 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:55:45.500986 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-8fed4f04-944e-42be-a263-4168b76716c1 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:55:45.502909 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-8fed4f04-944e-42be-a263-4168b76716c1 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:55:45.504096 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-8fed4f04-944e-42be-a263-4168b76716c1 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] 10.222.0.31 "GET /compute/v2.1/servers/406b5ad6-698e-457f-93f4-cdfd45fb3e8e" status: 200 len: 1742 microversion: 2.20 time: 0.198282 Apr 29 08:55:45.504688 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 276/549] 10.222.0.31 () {60 vars in 1276 bytes} [Fri Apr 29 08:55:45 2022] GET /compute/v2.1/servers/406b5ad6-698e-457f-93f4-cdfd45fb3e8e => generated 1742 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 29 08:55:46.253005 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-6b52dc42-e015-4af4-b882-3f5a25c0b899 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Calling method '>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:55:46.253990 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-6b52dc42-e015-4af4-b882-3f5a25c0b899 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] [instance: f4be98bb-be88-421f-a448-f04a4f97702b] Fetching instance by UUID {{(pid=123458) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:55:46.264065 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-6b52dc42-e015-4af4-b882-3f5a25c0b899 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:55:46.264532 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-6b52dc42-e015-4af4-b882-3f5a25c0b899 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:55:46.265316 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-6b52dc42-e015-4af4-b882-3f5a25c0b899 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:55:46.265749 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-6b52dc42-e015-4af4-b882-3f5a25c0b899 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:55:46.462107 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-6b52dc42-e015-4af4-b882-3f5a25c0b899 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c18e88436f14dc7a2001220b87ce9ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60998f08c40446e787ead285e40665b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:55:46.472747 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-6b52dc42-e015-4af4-b882-3f5a25c0b899 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] 10.222.0.31 "GET /compute/v2.1/servers/f4be98bb-be88-421f-a448-f04a4f97702b" status: 200 len: 1370 microversion: 2.1 time: 0.223371 Apr 29 08:55:46.473348 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 274/550] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 08:55:46 2022] GET /compute/v2.1/servers/f4be98bb-be88-421f-a448-f04a4f97702b => generated 1370 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 08:55:46.524705 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-40808c6d-ec6f-4716-b122-bc19f7dea4c4 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Calling method '>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:55:46.525430 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-40808c6d-ec6f-4716-b122-bc19f7dea4c4 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] [instance: 406b5ad6-698e-457f-93f4-cdfd45fb3e8e] Fetching instance by UUID {{(pid=123459) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:55:46.532628 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-40808c6d-ec6f-4716-b122-bc19f7dea4c4 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:55:46.533166 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-40808c6d-ec6f-4716-b122-bc19f7dea4c4 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:55:46.534008 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-40808c6d-ec6f-4716-b122-bc19f7dea4c4 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:55:46.534576 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-40808c6d-ec6f-4716-b122-bc19f7dea4c4 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:55:46.695755 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-40808c6d-ec6f-4716-b122-bc19f7dea4c4 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:55:46.705217 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-40808c6d-ec6f-4716-b122-bc19f7dea4c4 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:55:46.710481 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-40808c6d-ec6f-4716-b122-bc19f7dea4c4 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:55:46.712027 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-40808c6d-ec6f-4716-b122-bc19f7dea4c4 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] 10.222.0.31 "GET /compute/v2.1/servers/406b5ad6-698e-457f-93f4-cdfd45fb3e8e" status: 200 len: 1742 microversion: 2.20 time: 0.192426 Apr 29 08:55:46.712963 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 277/551] 10.222.0.31 () {60 vars in 1276 bytes} [Fri Apr 29 08:55:46 2022] GET /compute/v2.1/servers/406b5ad6-698e-457f-93f4-cdfd45fb3e8e => generated 1742 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 29 08:55:47.491296 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-f5b14262-d866-4d58-8b43-78c888452d4e tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Calling method '>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:55:47.493178 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-f5b14262-d866-4d58-8b43-78c888452d4e tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] [instance: f4be98bb-be88-421f-a448-f04a4f97702b] Fetching instance by UUID {{(pid=123458) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:55:47.500217 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-f5b14262-d866-4d58-8b43-78c888452d4e tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:55:47.500964 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-f5b14262-d866-4d58-8b43-78c888452d4e tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:55:47.501902 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-f5b14262-d866-4d58-8b43-78c888452d4e tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:55:47.502523 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-f5b14262-d866-4d58-8b43-78c888452d4e tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:55:47.723704 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-f5b14262-d866-4d58-8b43-78c888452d4e tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c18e88436f14dc7a2001220b87ce9ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60998f08c40446e787ead285e40665b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:55:47.732083 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-45f00a64-f0a3-4386-b9b3-5b468815c02e tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Calling method '>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:55:47.732746 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-45f00a64-f0a3-4386-b9b3-5b468815c02e tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] [instance: 406b5ad6-698e-457f-93f4-cdfd45fb3e8e] Fetching instance by UUID {{(pid=123459) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:55:47.747249 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-f5b14262-d866-4d58-8b43-78c888452d4e tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] 10.222.0.31 "GET /compute/v2.1/servers/f4be98bb-be88-421f-a448-f04a4f97702b" status: 200 len: 1370 microversion: 2.1 time: 0.260636 Apr 29 08:55:47.761684 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-45f00a64-f0a3-4386-b9b3-5b468815c02e tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:55:47.762150 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-45f00a64-f0a3-4386-b9b3-5b468815c02e tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:55:47.762946 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-45f00a64-f0a3-4386-b9b3-5b468815c02e tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:55:47.763131 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 275/552] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 08:55:47 2022] GET /compute/v2.1/servers/f4be98bb-be88-421f-a448-f04a4f97702b => generated 1370 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 08:55:47.764540 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-45f00a64-f0a3-4386-b9b3-5b468815c02e tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:55:47.955317 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-45f00a64-f0a3-4386-b9b3-5b468815c02e tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:55:47.973305 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-45f00a64-f0a3-4386-b9b3-5b468815c02e tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:55:47.978593 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-45f00a64-f0a3-4386-b9b3-5b468815c02e tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:55:47.987333 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-45f00a64-f0a3-4386-b9b3-5b468815c02e tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] 10.222.0.31 "GET /compute/v2.1/servers/406b5ad6-698e-457f-93f4-cdfd45fb3e8e" status: 200 len: 1742 microversion: 2.20 time: 0.259636 Apr 29 08:55:47.989311 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 278/553] 10.222.0.31 () {60 vars in 1276 bytes} [Fri Apr 29 08:55:47 2022] GET /compute/v2.1/servers/406b5ad6-698e-457f-93f4-cdfd45fb3e8e => generated 1742 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 29 08:55:48.766167 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-4a3db8b6-808b-4d56-888e-5363e4f7d985 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Calling method '>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:55:48.766854 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-4a3db8b6-808b-4d56-888e-5363e4f7d985 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] [instance: f4be98bb-be88-421f-a448-f04a4f97702b] Fetching instance by UUID {{(pid=123458) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:55:48.774830 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-4a3db8b6-808b-4d56-888e-5363e4f7d985 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:55:48.775662 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-4a3db8b6-808b-4d56-888e-5363e4f7d985 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:55:48.776737 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-4a3db8b6-808b-4d56-888e-5363e4f7d985 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:55:48.791534 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-4a3db8b6-808b-4d56-888e-5363e4f7d985 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:55:49.010284 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-36aaf73e-266a-43d3-a00d-9924e6c50521 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Calling method '>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:55:49.011642 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-36aaf73e-266a-43d3-a00d-9924e6c50521 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] [instance: 406b5ad6-698e-457f-93f4-cdfd45fb3e8e] Fetching instance by UUID {{(pid=123459) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:55:49.022107 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-36aaf73e-266a-43d3-a00d-9924e6c50521 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:55:49.024701 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-36aaf73e-266a-43d3-a00d-9924e6c50521 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:55:49.025809 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-36aaf73e-266a-43d3-a00d-9924e6c50521 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:55:49.028706 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-36aaf73e-266a-43d3-a00d-9924e6c50521 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:55:49.287620 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-4a3db8b6-808b-4d56-888e-5363e4f7d985 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c18e88436f14dc7a2001220b87ce9ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60998f08c40446e787ead285e40665b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:55:49.296553 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-4a3db8b6-808b-4d56-888e-5363e4f7d985 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] 10.222.0.31 "GET /compute/v2.1/servers/f4be98bb-be88-421f-a448-f04a4f97702b" status: 200 len: 1370 microversion: 2.1 time: 0.534711 Apr 29 08:55:49.300495 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 276/554] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 08:55:48 2022] GET /compute/v2.1/servers/f4be98bb-be88-421f-a448-f04a4f97702b => generated 1370 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 08:55:49.628879 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-36aaf73e-266a-43d3-a00d-9924e6c50521 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:55:49.654207 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-36aaf73e-266a-43d3-a00d-9924e6c50521 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:55:49.664593 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-36aaf73e-266a-43d3-a00d-9924e6c50521 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:55:49.674311 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-36aaf73e-266a-43d3-a00d-9924e6c50521 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] 10.222.0.31 "GET /compute/v2.1/servers/406b5ad6-698e-457f-93f4-cdfd45fb3e8e" status: 200 len: 1742 microversion: 2.20 time: 0.659609 Apr 29 08:55:49.674550 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 279/555] 10.222.0.31 () {60 vars in 1276 bytes} [Fri Apr 29 08:55:49 2022] GET /compute/v2.1/servers/406b5ad6-698e-457f-93f4-cdfd45fb3e8e => generated 1742 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 29 08:55:50.314261 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-208f9732-056b-41a8-b6c9-9cd7d38fe339 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Calling method '>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:55:50.315113 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-208f9732-056b-41a8-b6c9-9cd7d38fe339 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] [instance: f4be98bb-be88-421f-a448-f04a4f97702b] Fetching instance by UUID {{(pid=123458) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:55:50.328439 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-208f9732-056b-41a8-b6c9-9cd7d38fe339 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:55:50.330795 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-208f9732-056b-41a8-b6c9-9cd7d38fe339 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:55:50.332052 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-208f9732-056b-41a8-b6c9-9cd7d38fe339 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:55:50.332787 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-208f9732-056b-41a8-b6c9-9cd7d38fe339 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:55:50.710123 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-15cbb143-4c2d-441c-b84b-a5ce98263872 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Calling method '>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:55:50.710898 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-15cbb143-4c2d-441c-b84b-a5ce98263872 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] [instance: 406b5ad6-698e-457f-93f4-cdfd45fb3e8e] Fetching instance by UUID {{(pid=123459) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:55:50.727720 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-15cbb143-4c2d-441c-b84b-a5ce98263872 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:55:50.728493 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-15cbb143-4c2d-441c-b84b-a5ce98263872 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:55:50.730221 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-15cbb143-4c2d-441c-b84b-a5ce98263872 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:55:50.730989 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-15cbb143-4c2d-441c-b84b-a5ce98263872 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:55:50.958942 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-208f9732-056b-41a8-b6c9-9cd7d38fe339 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c18e88436f14dc7a2001220b87ce9ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60998f08c40446e787ead285e40665b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:55:50.967033 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-208f9732-056b-41a8-b6c9-9cd7d38fe339 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] 10.222.0.31 "GET /compute/v2.1/servers/f4be98bb-be88-421f-a448-f04a4f97702b" status: 200 len: 1370 microversion: 2.1 time: 0.656611 Apr 29 08:55:50.972885 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 277/556] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 08:55:50 2022] GET /compute/v2.1/servers/f4be98bb-be88-421f-a448-f04a4f97702b => generated 1370 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 08:55:50.992588 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-15cbb143-4c2d-441c-b84b-a5ce98263872 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:55:51.007296 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-15cbb143-4c2d-441c-b84b-a5ce98263872 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:55:51.009778 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-15cbb143-4c2d-441c-b84b-a5ce98263872 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:55:51.010861 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-15cbb143-4c2d-441c-b84b-a5ce98263872 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] 10.222.0.31 "GET /compute/v2.1/servers/406b5ad6-698e-457f-93f4-cdfd45fb3e8e" status: 200 len: 1742 microversion: 2.20 time: 0.307658 Apr 29 08:55:51.011593 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 280/557] 10.222.0.31 () {60 vars in 1276 bytes} [Fri Apr 29 08:55:50 2022] GET /compute/v2.1/servers/406b5ad6-698e-457f-93f4-cdfd45fb3e8e => generated 1742 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 29 08:55:51.990934 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-e102424c-a28a-42df-a254-f38b028cb053 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Calling method '>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:55:51.992393 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-e102424c-a28a-42df-a254-f38b028cb053 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] [instance: f4be98bb-be88-421f-a448-f04a4f97702b] Fetching instance by UUID {{(pid=123458) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:55:51.999520 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-e102424c-a28a-42df-a254-f38b028cb053 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:55:52.000373 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-e102424c-a28a-42df-a254-f38b028cb053 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:55:52.001532 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-e102424c-a28a-42df-a254-f38b028cb053 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:55:52.002224 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-e102424c-a28a-42df-a254-f38b028cb053 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:55:52.031305 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-6931b98c-ff8d-4670-8e62-178459ca0fa7 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Calling method '>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:55:52.032821 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-6931b98c-ff8d-4670-8e62-178459ca0fa7 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] [instance: 406b5ad6-698e-457f-93f4-cdfd45fb3e8e] Fetching instance by UUID {{(pid=123459) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:55:52.044971 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-6931b98c-ff8d-4670-8e62-178459ca0fa7 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:55:52.045431 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-6931b98c-ff8d-4670-8e62-178459ca0fa7 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:55:52.046219 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-6931b98c-ff8d-4670-8e62-178459ca0fa7 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:55:52.046658 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-6931b98c-ff8d-4670-8e62-178459ca0fa7 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:55:52.285618 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-e102424c-a28a-42df-a254-f38b028cb053 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c18e88436f14dc7a2001220b87ce9ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60998f08c40446e787ead285e40665b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:55:52.294478 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-e102424c-a28a-42df-a254-f38b028cb053 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] 10.222.0.31 "GET /compute/v2.1/servers/f4be98bb-be88-421f-a448-f04a4f97702b" status: 200 len: 1370 microversion: 2.1 time: 0.309085 Apr 29 08:55:52.296018 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 278/558] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 08:55:51 2022] GET /compute/v2.1/servers/f4be98bb-be88-421f-a448-f04a4f97702b => generated 1370 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 08:55:52.328329 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-6931b98c-ff8d-4670-8e62-178459ca0fa7 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:55:52.337462 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-6931b98c-ff8d-4670-8e62-178459ca0fa7 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:55:52.339226 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-6931b98c-ff8d-4670-8e62-178459ca0fa7 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:55:52.340602 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-6931b98c-ff8d-4670-8e62-178459ca0fa7 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] 10.222.0.31 "GET /compute/v2.1/servers/406b5ad6-698e-457f-93f4-cdfd45fb3e8e" status: 200 len: 1742 microversion: 2.20 time: 0.314996 Apr 29 08:55:52.351979 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 281/559] 10.222.0.31 () {60 vars in 1276 bytes} [Fri Apr 29 08:55:52 2022] GET /compute/v2.1/servers/406b5ad6-698e-457f-93f4-cdfd45fb3e8e => generated 1742 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 29 08:55:53.312904 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-dccc296d-073e-44f7-a8c8-77861dbdf45a tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Calling method '>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:55:53.313673 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-dccc296d-073e-44f7-a8c8-77861dbdf45a tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] [instance: f4be98bb-be88-421f-a448-f04a4f97702b] Fetching instance by UUID {{(pid=123458) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:55:53.320770 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-dccc296d-073e-44f7-a8c8-77861dbdf45a tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:55:53.321213 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-dccc296d-073e-44f7-a8c8-77861dbdf45a tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:55:53.322217 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-dccc296d-073e-44f7-a8c8-77861dbdf45a tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:55:53.322653 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-dccc296d-073e-44f7-a8c8-77861dbdf45a tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:55:53.358779 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-bb6639c6-0e35-4d10-95b2-34615fcbc3a8 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Calling method '>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:55:53.359384 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-bb6639c6-0e35-4d10-95b2-34615fcbc3a8 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] [instance: 406b5ad6-698e-457f-93f4-cdfd45fb3e8e] Fetching instance by UUID {{(pid=123459) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:55:53.368767 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-bb6639c6-0e35-4d10-95b2-34615fcbc3a8 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:55:53.369503 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-bb6639c6-0e35-4d10-95b2-34615fcbc3a8 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:55:53.370458 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-bb6639c6-0e35-4d10-95b2-34615fcbc3a8 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:55:53.372233 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-bb6639c6-0e35-4d10-95b2-34615fcbc3a8 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:55:53.484650 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-dccc296d-073e-44f7-a8c8-77861dbdf45a tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c18e88436f14dc7a2001220b87ce9ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60998f08c40446e787ead285e40665b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:55:53.499380 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-dccc296d-073e-44f7-a8c8-77861dbdf45a tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] 10.222.0.31 "GET /compute/v2.1/servers/f4be98bb-be88-421f-a448-f04a4f97702b" status: 200 len: 1370 microversion: 2.1 time: 0.190331 Apr 29 08:55:53.499971 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 279/560] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 08:55:53 2022] GET /compute/v2.1/servers/f4be98bb-be88-421f-a448-f04a4f97702b => generated 1370 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 08:55:53.606079 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-bb6639c6-0e35-4d10-95b2-34615fcbc3a8 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:55:53.614656 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-bb6639c6-0e35-4d10-95b2-34615fcbc3a8 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:55:53.616502 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-bb6639c6-0e35-4d10-95b2-34615fcbc3a8 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:55:53.617775 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-bb6639c6-0e35-4d10-95b2-34615fcbc3a8 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] 10.222.0.31 "GET /compute/v2.1/servers/406b5ad6-698e-457f-93f4-cdfd45fb3e8e" status: 200 len: 1742 microversion: 2.20 time: 0.262787 Apr 29 08:55:53.618372 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 282/561] 10.222.0.31 () {60 vars in 1276 bytes} [Fri Apr 29 08:55:53 2022] GET /compute/v2.1/servers/406b5ad6-698e-457f-93f4-cdfd45fb3e8e => generated 1742 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 29 08:55:54.521182 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-d9148729-7805-4ac1-bb5b-b07612d91c63 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Calling method '>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:55:54.523304 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-d9148729-7805-4ac1-bb5b-b07612d91c63 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] [instance: f4be98bb-be88-421f-a448-f04a4f97702b] Fetching instance by UUID {{(pid=123458) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:55:54.530405 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-d9148729-7805-4ac1-bb5b-b07612d91c63 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:55:54.531111 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-d9148729-7805-4ac1-bb5b-b07612d91c63 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:55:54.531944 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-d9148729-7805-4ac1-bb5b-b07612d91c63 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:55:54.532412 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-d9148729-7805-4ac1-bb5b-b07612d91c63 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:55:54.637558 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-632febd3-e7dc-486e-9701-c602933adc88 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Calling method '>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:55:54.638193 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-632febd3-e7dc-486e-9701-c602933adc88 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] [instance: 406b5ad6-698e-457f-93f4-cdfd45fb3e8e] Fetching instance by UUID {{(pid=123459) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:55:54.644789 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-632febd3-e7dc-486e-9701-c602933adc88 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:55:54.645188 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-632febd3-e7dc-486e-9701-c602933adc88 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:55:54.646752 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-632febd3-e7dc-486e-9701-c602933adc88 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:55:54.647186 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-632febd3-e7dc-486e-9701-c602933adc88 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:55:54.681438 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-d9148729-7805-4ac1-bb5b-b07612d91c63 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c18e88436f14dc7a2001220b87ce9ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60998f08c40446e787ead285e40665b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:55:54.689616 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-d9148729-7805-4ac1-bb5b-b07612d91c63 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] 10.222.0.31 "GET /compute/v2.1/servers/f4be98bb-be88-421f-a448-f04a4f97702b" status: 200 len: 1370 microversion: 2.1 time: 0.175718 Apr 29 08:55:54.690094 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 280/562] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 08:55:54 2022] GET /compute/v2.1/servers/f4be98bb-be88-421f-a448-f04a4f97702b => generated 1370 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 08:55:54.789186 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-632febd3-e7dc-486e-9701-c602933adc88 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:55:54.797768 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-632febd3-e7dc-486e-9701-c602933adc88 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:55:54.799689 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-632febd3-e7dc-486e-9701-c602933adc88 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:55:54.801190 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-632febd3-e7dc-486e-9701-c602933adc88 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] 10.222.0.31 "GET /compute/v2.1/servers/406b5ad6-698e-457f-93f4-cdfd45fb3e8e" status: 200 len: 1742 microversion: 2.20 time: 0.168192 Apr 29 08:55:54.803369 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 283/563] 10.222.0.31 () {60 vars in 1276 bytes} [Fri Apr 29 08:55:54 2022] GET /compute/v2.1/servers/406b5ad6-698e-457f-93f4-cdfd45fb3e8e => generated 1742 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 29 08:55:55.019906 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [req-01afa870-27fb-424f-88e7-9def6ea9474e req-20352317-92fa-472b-97e8-559d4a978dee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f4be98bb-be88-421f-a448-f04a4f97702b", "name": "network-vif-plugged", "status": "completed", "tag": "e6ef8121-81a9-4773-903b-5d18906a76d1"}]} {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 29 08:55:55.028683 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [req-01afa870-27fb-424f-88e7-9def6ea9474e req-20352317-92fa-472b-97e8-559d4a978dee service nova] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:55:55.029269 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [req-01afa870-27fb-424f-88e7-9def6ea9474e req-20352317-92fa-472b-97e8-559d4a978dee service nova] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:55:55.050731 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.compute.server_external_events [req-01afa870-27fb-424f-88e7-9def6ea9474e req-20352317-92fa-472b-97e8-559d4a978dee service nova] Creating event network-vif-plugged:e6ef8121-81a9-4773-903b-5d18906a76d1 for instance f4be98bb-be88-421f-a448-f04a4f97702b on hv-cinder-83987 Apr 29 08:55:55.057123 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [req-01afa870-27fb-424f-88e7-9def6ea9474e req-20352317-92fa-472b-97e8-559d4a978dee service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041658 Apr 29 08:55:55.057835 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 281/564] 10.222.0.31 () {64 vars in 1317 bytes} [Fri Apr 29 08:55:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 29 08:55:55.712744 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-d50326ca-9ef1-4847-9934-79330b65af8e tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Calling method '>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:55:55.714094 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-d50326ca-9ef1-4847-9934-79330b65af8e tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] [instance: f4be98bb-be88-421f-a448-f04a4f97702b] Fetching instance by UUID {{(pid=123459) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:55:55.731396 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-d50326ca-9ef1-4847-9934-79330b65af8e tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:55:55.731854 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-d50326ca-9ef1-4847-9934-79330b65af8e tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:55:55.732679 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-d50326ca-9ef1-4847-9934-79330b65af8e tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:55:55.733297 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-d50326ca-9ef1-4847-9934-79330b65af8e tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:55:55.823441 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-082f628e-cdc5-4a1a-96cb-72a73d9027c2 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Calling method '>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:55:55.825026 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-082f628e-cdc5-4a1a-96cb-72a73d9027c2 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] [instance: 406b5ad6-698e-457f-93f4-cdfd45fb3e8e] Fetching instance by UUID {{(pid=123458) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:55:55.838609 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-082f628e-cdc5-4a1a-96cb-72a73d9027c2 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:55:55.840822 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-082f628e-cdc5-4a1a-96cb-72a73d9027c2 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:55:55.842323 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-082f628e-cdc5-4a1a-96cb-72a73d9027c2 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:55:55.842323 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-082f628e-cdc5-4a1a-96cb-72a73d9027c2 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:55:56.018134 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-082f628e-cdc5-4a1a-96cb-72a73d9027c2 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:55:56.018658 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-d50326ca-9ef1-4847-9934-79330b65af8e tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c18e88436f14dc7a2001220b87ce9ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60998f08c40446e787ead285e40665b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:55:56.031877 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-d50326ca-9ef1-4847-9934-79330b65af8e tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] 10.222.0.31 "GET /compute/v2.1/servers/f4be98bb-be88-421f-a448-f04a4f97702b" status: 200 len: 1370 microversion: 2.1 time: 0.326877 Apr 29 08:55:56.033388 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 284/565] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 08:55:55 2022] GET /compute/v2.1/servers/f4be98bb-be88-421f-a448-f04a4f97702b => generated 1370 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 08:55:56.034330 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-082f628e-cdc5-4a1a-96cb-72a73d9027c2 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:55:56.035957 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-082f628e-cdc5-4a1a-96cb-72a73d9027c2 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:55:56.037903 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-082f628e-cdc5-4a1a-96cb-72a73d9027c2 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] 10.222.0.31 "GET /compute/v2.1/servers/406b5ad6-698e-457f-93f4-cdfd45fb3e8e" status: 200 len: 1742 microversion: 2.20 time: 0.220467 Apr 29 08:55:56.038528 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 282/566] 10.222.0.31 () {60 vars in 1276 bytes} [Fri Apr 29 08:55:55 2022] GET /compute/v2.1/servers/406b5ad6-698e-457f-93f4-cdfd45fb3e8e => generated 1742 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 29 08:55:57.051365 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-8065757f-9f00-4b8c-a2c0-c027ec100180 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Calling method '>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:55:57.052355 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-8065757f-9f00-4b8c-a2c0-c027ec100180 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] [instance: f4be98bb-be88-421f-a448-f04a4f97702b] Fetching instance by UUID {{(pid=123459) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:55:57.059357 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-8065757f-9f00-4b8c-a2c0-c027ec100180 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:55:57.059810 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-8065757f-9f00-4b8c-a2c0-c027ec100180 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:55:57.059979 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-04591914-ee51-4756-8483-d1dbcb1429f0 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Calling method '>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:55:57.060658 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-8065757f-9f00-4b8c-a2c0-c027ec100180 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:55:57.061103 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-8065757f-9f00-4b8c-a2c0-c027ec100180 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:55:57.061337 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-04591914-ee51-4756-8483-d1dbcb1429f0 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] [instance: 406b5ad6-698e-457f-93f4-cdfd45fb3e8e] Fetching instance by UUID {{(pid=123458) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:55:57.075010 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-04591914-ee51-4756-8483-d1dbcb1429f0 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:55:57.076362 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-04591914-ee51-4756-8483-d1dbcb1429f0 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:55:57.077467 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-04591914-ee51-4756-8483-d1dbcb1429f0 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:55:57.078116 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-04591914-ee51-4756-8483-d1dbcb1429f0 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:55:57.333510 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-04591914-ee51-4756-8483-d1dbcb1429f0 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:55:57.353013 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-04591914-ee51-4756-8483-d1dbcb1429f0 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:55:57.358859 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-04591914-ee51-4756-8483-d1dbcb1429f0 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:55:57.362893 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-04591914-ee51-4756-8483-d1dbcb1429f0 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] 10.222.0.31 "GET /compute/v2.1/servers/406b5ad6-698e-457f-93f4-cdfd45fb3e8e" status: 200 len: 1724 microversion: 2.20 time: 0.308506 Apr 29 08:55:57.363654 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 283/567] 10.222.0.31 () {60 vars in 1276 bytes} [Fri Apr 29 08:55:57 2022] GET /compute/v2.1/servers/406b5ad6-698e-457f-93f4-cdfd45fb3e8e => generated 1724 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 29 08:55:57.446260 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-8065757f-9f00-4b8c-a2c0-c027ec100180 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c18e88436f14dc7a2001220b87ce9ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60998f08c40446e787ead285e40665b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:55:57.468066 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-8065757f-9f00-4b8c-a2c0-c027ec100180 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] 10.222.0.31 "GET /compute/v2.1/servers/f4be98bb-be88-421f-a448-f04a4f97702b" status: 200 len: 1370 microversion: 2.1 time: 0.422153 Apr 29 08:55:57.478639 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 285/568] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 08:55:57 2022] GET /compute/v2.1/servers/f4be98bb-be88-421f-a448-f04a4f97702b => generated 1370 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 08:55:58.384003 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-3ea4db08-d364-4398-bf16-a77a26e1abb5 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Calling method '>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:55:58.384757 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-3ea4db08-d364-4398-bf16-a77a26e1abb5 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] [instance: 406b5ad6-698e-457f-93f4-cdfd45fb3e8e] Fetching instance by UUID {{(pid=123458) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:55:58.401109 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-3ea4db08-d364-4398-bf16-a77a26e1abb5 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:55:58.401927 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-3ea4db08-d364-4398-bf16-a77a26e1abb5 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:55:58.403211 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-3ea4db08-d364-4398-bf16-a77a26e1abb5 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:55:58.404800 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-3ea4db08-d364-4398-bf16-a77a26e1abb5 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:55:58.485843 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-0f1fc229-25ce-4966-9d8f-a61112ec2522 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Calling method '>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:55:58.487359 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-0f1fc229-25ce-4966-9d8f-a61112ec2522 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] [instance: f4be98bb-be88-421f-a448-f04a4f97702b] Fetching instance by UUID {{(pid=123459) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:55:58.501443 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-0f1fc229-25ce-4966-9d8f-a61112ec2522 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:55:58.501914 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-0f1fc229-25ce-4966-9d8f-a61112ec2522 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:55:58.503204 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-0f1fc229-25ce-4966-9d8f-a61112ec2522 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:55:58.503957 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-0f1fc229-25ce-4966-9d8f-a61112ec2522 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:55:58.717158 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-3ea4db08-d364-4398-bf16-a77a26e1abb5 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:55:58.727376 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-3ea4db08-d364-4398-bf16-a77a26e1abb5 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:55:58.734977 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-3ea4db08-d364-4398-bf16-a77a26e1abb5 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:55:58.739673 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-3ea4db08-d364-4398-bf16-a77a26e1abb5 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] 10.222.0.31 "GET /compute/v2.1/servers/406b5ad6-698e-457f-93f4-cdfd45fb3e8e" status: 200 len: 1724 microversion: 2.20 time: 0.360262 Apr 29 08:55:58.740966 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-0f1fc229-25ce-4966-9d8f-a61112ec2522 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c18e88436f14dc7a2001220b87ce9ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60998f08c40446e787ead285e40665b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:55:58.749662 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 284/569] 10.222.0.31 () {60 vars in 1276 bytes} [Fri Apr 29 08:55:58 2022] GET /compute/v2.1/servers/406b5ad6-698e-457f-93f4-cdfd45fb3e8e => generated 1724 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 29 08:55:58.751512 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-0f1fc229-25ce-4966-9d8f-a61112ec2522 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] 10.222.0.31 "GET /compute/v2.1/servers/f4be98bb-be88-421f-a448-f04a4f97702b" status: 200 len: 1370 microversion: 2.1 time: 0.269421 Apr 29 08:55:58.768498 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 286/570] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 08:55:58 2022] GET /compute/v2.1/servers/f4be98bb-be88-421f-a448-f04a4f97702b => generated 1370 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 08:55:59.767931 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-aff83cfa-4a13-4c81-ad74-52408a19b2e7 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Calling method '>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:55:59.768575 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-9b0988e2-acb5-4d89-8af3-c4c56a37f5c4 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Calling method '>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:55:59.768936 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-aff83cfa-4a13-4c81-ad74-52408a19b2e7 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] [instance: 406b5ad6-698e-457f-93f4-cdfd45fb3e8e] Fetching instance by UUID {{(pid=123458) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:55:59.769030 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-9b0988e2-acb5-4d89-8af3-c4c56a37f5c4 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] [instance: f4be98bb-be88-421f-a448-f04a4f97702b] Fetching instance by UUID {{(pid=123459) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:55:59.782418 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-9b0988e2-acb5-4d89-8af3-c4c56a37f5c4 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:55:59.782866 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-aff83cfa-4a13-4c81-ad74-52408a19b2e7 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:55:59.782978 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-9b0988e2-acb5-4d89-8af3-c4c56a37f5c4 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:55:59.783530 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-aff83cfa-4a13-4c81-ad74-52408a19b2e7 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:55:59.783694 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-9b0988e2-acb5-4d89-8af3-c4c56a37f5c4 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:55:59.784217 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-9b0988e2-acb5-4d89-8af3-c4c56a37f5c4 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:55:59.796876 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-aff83cfa-4a13-4c81-ad74-52408a19b2e7 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:55:59.797502 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-aff83cfa-4a13-4c81-ad74-52408a19b2e7 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:56:00.025392 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-9b0988e2-acb5-4d89-8af3-c4c56a37f5c4 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c18e88436f14dc7a2001220b87ce9ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60998f08c40446e787ead285e40665b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:56:00.034004 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-aff83cfa-4a13-4c81-ad74-52408a19b2e7 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:56:00.042141 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-9b0988e2-acb5-4d89-8af3-c4c56a37f5c4 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] 10.222.0.31 "GET /compute/v2.1/servers/f4be98bb-be88-421f-a448-f04a4f97702b" status: 200 len: 1370 microversion: 2.1 time: 0.277746 Apr 29 08:56:00.042733 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 287/571] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 08:55:59 2022] GET /compute/v2.1/servers/f4be98bb-be88-421f-a448-f04a4f97702b => generated 1370 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 08:56:00.044416 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-aff83cfa-4a13-4c81-ad74-52408a19b2e7 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:56:00.046073 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-aff83cfa-4a13-4c81-ad74-52408a19b2e7 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:56:00.047788 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-aff83cfa-4a13-4c81-ad74-52408a19b2e7 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] 10.222.0.31 "GET /compute/v2.1/servers/406b5ad6-698e-457f-93f4-cdfd45fb3e8e" status: 200 len: 1724 microversion: 2.20 time: 0.283814 Apr 29 08:56:00.048414 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 285/572] 10.222.0.31 () {60 vars in 1276 bytes} [Fri Apr 29 08:55:59 2022] GET /compute/v2.1/servers/406b5ad6-698e-457f-93f4-cdfd45fb3e8e => generated 1724 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 29 08:56:01.065488 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-e8ad3a85-54c4-4f7a-9a69-b177e8098816 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Calling method '>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:56:01.067462 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-054cc02e-1e03-475a-b732-211264958ec7 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Calling method '>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:56:01.068449 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-e8ad3a85-54c4-4f7a-9a69-b177e8098816 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] [instance: f4be98bb-be88-421f-a448-f04a4f97702b] Fetching instance by UUID {{(pid=123459) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:56:01.069225 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-054cc02e-1e03-475a-b732-211264958ec7 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] [instance: 406b5ad6-698e-457f-93f4-cdfd45fb3e8e] Fetching instance by UUID {{(pid=123458) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:56:01.076068 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-054cc02e-1e03-475a-b732-211264958ec7 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:56:01.076550 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-054cc02e-1e03-475a-b732-211264958ec7 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:56:01.077327 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-054cc02e-1e03-475a-b732-211264958ec7 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:56:01.081697 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-e8ad3a85-54c4-4f7a-9a69-b177e8098816 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:56:01.082142 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-e8ad3a85-54c4-4f7a-9a69-b177e8098816 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:56:01.082921 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-e8ad3a85-54c4-4f7a-9a69-b177e8098816 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:56:01.083384 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-054cc02e-1e03-475a-b732-211264958ec7 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:56:01.083634 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-e8ad3a85-54c4-4f7a-9a69-b177e8098816 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:56:01.268638 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-e8ad3a85-54c4-4f7a-9a69-b177e8098816 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c18e88436f14dc7a2001220b87ce9ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60998f08c40446e787ead285e40665b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:56:01.279053 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-e8ad3a85-54c4-4f7a-9a69-b177e8098816 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] 10.222.0.31 "GET /compute/v2.1/servers/f4be98bb-be88-421f-a448-f04a4f97702b" status: 200 len: 1370 microversion: 2.1 time: 0.223695 Apr 29 08:56:01.280457 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 288/573] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 08:56:01 2022] GET /compute/v2.1/servers/f4be98bb-be88-421f-a448-f04a4f97702b => generated 1370 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 08:56:01.332665 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-054cc02e-1e03-475a-b732-211264958ec7 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:56:01.345424 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-054cc02e-1e03-475a-b732-211264958ec7 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:56:01.346939 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-054cc02e-1e03-475a-b732-211264958ec7 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:56:01.348104 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-054cc02e-1e03-475a-b732-211264958ec7 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] 10.222.0.31 "GET /compute/v2.1/servers/406b5ad6-698e-457f-93f4-cdfd45fb3e8e" status: 200 len: 1724 microversion: 2.20 time: 0.284548 Apr 29 08:56:01.349716 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 286/574] 10.222.0.31 () {60 vars in 1276 bytes} [Fri Apr 29 08:56:01 2022] GET /compute/v2.1/servers/406b5ad6-698e-457f-93f4-cdfd45fb3e8e => generated 1724 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 29 08:56:02.298183 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-e865e33a-91f3-46f7-a980-edef11dbbbe9 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Calling method '>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:56:02.298964 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-e865e33a-91f3-46f7-a980-edef11dbbbe9 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] [instance: f4be98bb-be88-421f-a448-f04a4f97702b] Fetching instance by UUID {{(pid=123459) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:56:02.308314 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-e865e33a-91f3-46f7-a980-edef11dbbbe9 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:56:02.309175 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-e865e33a-91f3-46f7-a980-edef11dbbbe9 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:56:02.310215 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-e865e33a-91f3-46f7-a980-edef11dbbbe9 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:56:02.312125 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-e865e33a-91f3-46f7-a980-edef11dbbbe9 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:56:02.376407 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-c1c9e229-dcd8-4d35-aaf6-34686f230b0c tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Calling method '>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:56:02.378094 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-c1c9e229-dcd8-4d35-aaf6-34686f230b0c tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] [instance: 406b5ad6-698e-457f-93f4-cdfd45fb3e8e] Fetching instance by UUID {{(pid=123458) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:56:02.395583 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-c1c9e229-dcd8-4d35-aaf6-34686f230b0c tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:56:02.396589 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-c1c9e229-dcd8-4d35-aaf6-34686f230b0c tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:56:02.398486 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-c1c9e229-dcd8-4d35-aaf6-34686f230b0c tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:56:02.399915 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-c1c9e229-dcd8-4d35-aaf6-34686f230b0c tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:56:02.606571 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-e865e33a-91f3-46f7-a980-edef11dbbbe9 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c18e88436f14dc7a2001220b87ce9ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60998f08c40446e787ead285e40665b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:56:02.615383 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-e865e33a-91f3-46f7-a980-edef11dbbbe9 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] 10.222.0.31 "GET /compute/v2.1/servers/f4be98bb-be88-421f-a448-f04a4f97702b" status: 200 len: 1370 microversion: 2.1 time: 0.321344 Apr 29 08:56:02.620304 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 289/575] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 08:56:02 2022] GET /compute/v2.1/servers/f4be98bb-be88-421f-a448-f04a4f97702b => generated 1370 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 08:56:02.689453 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-c1c9e229-dcd8-4d35-aaf6-34686f230b0c tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:56:02.700744 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-c1c9e229-dcd8-4d35-aaf6-34686f230b0c tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:56:02.706049 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-c1c9e229-dcd8-4d35-aaf6-34686f230b0c tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:56:02.710596 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-c1c9e229-dcd8-4d35-aaf6-34686f230b0c tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] 10.222.0.31 "GET /compute/v2.1/servers/406b5ad6-698e-457f-93f4-cdfd45fb3e8e" status: 200 len: 1724 microversion: 2.20 time: 0.342216 Apr 29 08:56:02.724268 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 287/576] 10.222.0.31 () {60 vars in 1276 bytes} [Fri Apr 29 08:56:02 2022] GET /compute/v2.1/servers/406b5ad6-698e-457f-93f4-cdfd45fb3e8e => generated 1724 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 29 08:56:02.761134 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [req-6c1e053c-954a-47bf-afa3-45bdafbf59ca req-481ce9f9-9f54-4131-a9ef-749e0bb22210 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "406b5ad6-698e-457f-93f4-cdfd45fb3e8e", "name": "network-vif-unplugged", "status": "completed", "tag": "afdeb60c-c7b1-441b-90f4-293273965fad"}]} {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 29 08:56:02.774404 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [req-6c1e053c-954a-47bf-afa3-45bdafbf59ca req-481ce9f9-9f54-4131-a9ef-749e0bb22210 service nova] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:56:02.774982 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [req-6c1e053c-954a-47bf-afa3-45bdafbf59ca req-481ce9f9-9f54-4131-a9ef-749e0bb22210 service nova] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:56:02.789304 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.compute.server_external_events [req-6c1e053c-954a-47bf-afa3-45bdafbf59ca req-481ce9f9-9f54-4131-a9ef-749e0bb22210 service nova] Creating event network-vif-unplugged:afdeb60c-c7b1-441b-90f4-293273965fad for instance 406b5ad6-698e-457f-93f4-cdfd45fb3e8e on hv-cinder-83987 Apr 29 08:56:02.797118 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [req-6c1e053c-954a-47bf-afa3-45bdafbf59ca req-481ce9f9-9f54-4131-a9ef-749e0bb22210 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.039642 Apr 29 08:56:02.798435 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 290/577] 10.222.0.31 () {64 vars in 1317 bytes} [Fri Apr 29 08:56:02 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 29 08:56:03.653223 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-caa9e196-a0b3-4934-acd2-a60376b75ce6 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Calling method '>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:56:03.654130 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-caa9e196-a0b3-4934-acd2-a60376b75ce6 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] [instance: f4be98bb-be88-421f-a448-f04a4f97702b] Fetching instance by UUID {{(pid=123458) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:56:03.667007 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-caa9e196-a0b3-4934-acd2-a60376b75ce6 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:56:03.669565 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-caa9e196-a0b3-4934-acd2-a60376b75ce6 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:56:03.670430 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-caa9e196-a0b3-4934-acd2-a60376b75ce6 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:56:03.670885 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-caa9e196-a0b3-4934-acd2-a60376b75ce6 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:56:03.732713 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-b60125af-b6d6-4f2e-bb91-5c6dccf08807 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Calling method '>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:56:03.733540 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-b60125af-b6d6-4f2e-bb91-5c6dccf08807 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] [instance: 406b5ad6-698e-457f-93f4-cdfd45fb3e8e] Fetching instance by UUID {{(pid=123459) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:56:03.771349 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-b60125af-b6d6-4f2e-bb91-5c6dccf08807 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:56:03.772301 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-b60125af-b6d6-4f2e-bb91-5c6dccf08807 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:56:03.780550 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-b60125af-b6d6-4f2e-bb91-5c6dccf08807 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:56:03.780662 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-b60125af-b6d6-4f2e-bb91-5c6dccf08807 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:56:04.074711 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-b60125af-b6d6-4f2e-bb91-5c6dccf08807 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:56:04.091671 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-b60125af-b6d6-4f2e-bb91-5c6dccf08807 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:56:04.094022 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-b60125af-b6d6-4f2e-bb91-5c6dccf08807 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:56:04.096170 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-b60125af-b6d6-4f2e-bb91-5c6dccf08807 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] 10.222.0.31 "GET /compute/v2.1/servers/406b5ad6-698e-457f-93f4-cdfd45fb3e8e" status: 200 len: 1724 microversion: 2.20 time: 0.368971 Apr 29 08:56:04.097441 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 291/578] 10.222.0.31 () {60 vars in 1276 bytes} [Fri Apr 29 08:56:03 2022] GET /compute/v2.1/servers/406b5ad6-698e-457f-93f4-cdfd45fb3e8e => generated 1724 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 29 08:56:04.448246 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-caa9e196-a0b3-4934-acd2-a60376b75ce6 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c18e88436f14dc7a2001220b87ce9ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60998f08c40446e787ead285e40665b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:56:04.459877 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-caa9e196-a0b3-4934-acd2-a60376b75ce6 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] 10.222.0.31 "GET /compute/v2.1/servers/f4be98bb-be88-421f-a448-f04a4f97702b" status: 200 len: 1370 microversion: 2.1 time: 0.826363 Apr 29 08:56:04.462585 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 288/579] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 08:56:03 2022] GET /compute/v2.1/servers/f4be98bb-be88-421f-a448-f04a4f97702b => generated 1370 bytes in 830 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 08:56:05.115250 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-bd1f6e06-9899-4088-85b2-231feee85294 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Calling method '>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:56:05.116588 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-bd1f6e06-9899-4088-85b2-231feee85294 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] [instance: 406b5ad6-698e-457f-93f4-cdfd45fb3e8e] Fetching instance by UUID {{(pid=123459) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:56:05.134183 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-bd1f6e06-9899-4088-85b2-231feee85294 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:56:05.136521 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-bd1f6e06-9899-4088-85b2-231feee85294 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:56:05.137533 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-bd1f6e06-9899-4088-85b2-231feee85294 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:56:05.140560 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-bd1f6e06-9899-4088-85b2-231feee85294 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:56:05.313970 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-bd1f6e06-9899-4088-85b2-231feee85294 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:56:05.326508 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-bd1f6e06-9899-4088-85b2-231feee85294 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:56:05.328102 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-bd1f6e06-9899-4088-85b2-231feee85294 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:56:05.329307 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-bd1f6e06-9899-4088-85b2-231feee85294 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] 10.222.0.31 "GET /compute/v2.1/servers/406b5ad6-698e-457f-93f4-cdfd45fb3e8e" status: 200 len: 1724 microversion: 2.20 time: 0.219213 Apr 29 08:56:05.340227 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 292/580] 10.222.0.31 () {60 vars in 1276 bytes} [Fri Apr 29 08:56:05 2022] GET /compute/v2.1/servers/406b5ad6-698e-457f-93f4-cdfd45fb3e8e => generated 1724 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 29 08:56:05.479867 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-7c683ce1-b909-4ec4-9f20-0aa263706025 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Calling method '>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:56:05.481407 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-7c683ce1-b909-4ec4-9f20-0aa263706025 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] [instance: f4be98bb-be88-421f-a448-f04a4f97702b] Fetching instance by UUID {{(pid=123458) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:56:05.489918 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-7c683ce1-b909-4ec4-9f20-0aa263706025 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:56:05.496862 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-7c683ce1-b909-4ec4-9f20-0aa263706025 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:56:05.497958 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-7c683ce1-b909-4ec4-9f20-0aa263706025 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:56:05.498852 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-7c683ce1-b909-4ec4-9f20-0aa263706025 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:56:05.674154 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-7c683ce1-b909-4ec4-9f20-0aa263706025 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c18e88436f14dc7a2001220b87ce9ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60998f08c40446e787ead285e40665b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:56:05.682300 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-7c683ce1-b909-4ec4-9f20-0aa263706025 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] 10.222.0.31 "GET /compute/v2.1/servers/f4be98bb-be88-421f-a448-f04a4f97702b" status: 200 len: 1564 microversion: 2.1 time: 0.207279 Apr 29 08:56:05.682864 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 289/581] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 08:56:05 2022] GET /compute/v2.1/servers/f4be98bb-be88-421f-a448-f04a4f97702b => generated 1564 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 08:56:05.699277 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-5f305713-70e5-49e9-a014-cef2b338fd66 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Calling method '>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:56:05.699934 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-5f305713-70e5-49e9-a014-cef2b338fd66 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] [instance: f4be98bb-be88-421f-a448-f04a4f97702b] Fetching instance by UUID {{(pid=123459) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:56:05.707644 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-5f305713-70e5-49e9-a014-cef2b338fd66 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:56:05.709317 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-5f305713-70e5-49e9-a014-cef2b338fd66 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:56:05.710254 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-5f305713-70e5-49e9-a014-cef2b338fd66 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:56:05.712097 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-5f305713-70e5-49e9-a014-cef2b338fd66 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:56:05.807563 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-5f305713-70e5-49e9-a014-cef2b338fd66 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] 10.222.0.31 "GET /compute/v2.1/servers/f4be98bb-be88-421f-a448-f04a4f97702b/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.112525 Apr 29 08:56:05.817046 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 293/582] 10.222.0.31 () {58 vars in 1274 bytes} [Fri Apr 29 08:56:05 2022] GET /compute/v2.1/servers/f4be98bb-be88-421f-a448-f04a4f97702b/os-interface => generated 284 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 29 08:56:06.350528 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-fa4bbb0e-3c84-459b-bb18-6aefd4ba2c6e tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Calling method '>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:56:06.351444 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-fa4bbb0e-3c84-459b-bb18-6aefd4ba2c6e tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] [instance: 406b5ad6-698e-457f-93f4-cdfd45fb3e8e] Fetching instance by UUID {{(pid=123458) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:56:06.363635 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-fa4bbb0e-3c84-459b-bb18-6aefd4ba2c6e tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:56:06.364098 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-fa4bbb0e-3c84-459b-bb18-6aefd4ba2c6e tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:56:06.366498 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-fa4bbb0e-3c84-459b-bb18-6aefd4ba2c6e tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:56:06.366942 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-fa4bbb0e-3c84-459b-bb18-6aefd4ba2c6e tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:56:06.934951 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-fa4bbb0e-3c84-459b-bb18-6aefd4ba2c6e tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:56:06.946027 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-fa4bbb0e-3c84-459b-bb18-6aefd4ba2c6e tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:56:06.948505 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-fa4bbb0e-3c84-459b-bb18-6aefd4ba2c6e tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:56:06.950169 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-fa4bbb0e-3c84-459b-bb18-6aefd4ba2c6e tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] 10.222.0.31 "GET /compute/v2.1/servers/406b5ad6-698e-457f-93f4-cdfd45fb3e8e" status: 200 len: 1724 microversion: 2.20 time: 0.603817 Apr 29 08:56:06.951009 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 290/583] 10.222.0.31 () {60 vars in 1276 bytes} [Fri Apr 29 08:56:06 2022] GET /compute/v2.1/servers/406b5ad6-698e-457f-93f4-cdfd45fb3e8e => generated 1724 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 29 08:56:07.240730 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [req-39c613d3-9e0b-4b76-9b9f-ef0997fb6531 req-ec1b228b-5def-4c94-b219-bf7143732cfc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f4be98bb-be88-421f-a448-f04a4f97702b", "tag": "e6ef8121-81a9-4773-903b-5d18906a76d1"}]} {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 29 08:56:07.255339 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [req-39c613d3-9e0b-4b76-9b9f-ef0997fb6531 req-ec1b228b-5def-4c94-b219-bf7143732cfc service nova] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:56:07.256034 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [req-39c613d3-9e0b-4b76-9b9f-ef0997fb6531 req-ec1b228b-5def-4c94-b219-bf7143732cfc service nova] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:56:07.279605 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.compute.server_external_events [req-39c613d3-9e0b-4b76-9b9f-ef0997fb6531 req-ec1b228b-5def-4c94-b219-bf7143732cfc service nova] Creating event network-changed:e6ef8121-81a9-4773-903b-5d18906a76d1 for instance f4be98bb-be88-421f-a448-f04a4f97702b on hv-cinder-83987 Apr 29 08:56:07.285450 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [req-39c613d3-9e0b-4b76-9b9f-ef0997fb6531 req-ec1b228b-5def-4c94-b219-bf7143732cfc service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048723 Apr 29 08:56:07.291617 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 294/584] 10.222.0.31 () {64 vars in 1317 bytes} [Fri Apr 29 08:56:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 29 08:56:07.314606 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-8e0cda87-584d-4245-86df-2d50bd20c43a tempest-VolumesSnapshotTestJSON-1697003112 tempest-VolumesSnapshotTestJSON-1697003112-project] Calling method '>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:56:07.315122 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-8e0cda87-584d-4245-86df-2d50bd20c43a tempest-VolumesSnapshotTestJSON-1697003112 tempest-VolumesSnapshotTestJSON-1697003112-project] [instance: 4a2c7e29-e0ec-456b-bd06-ff7127f84e54] Fetching instance by UUID {{(pid=123458) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:56:07.324664 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-8e0cda87-584d-4245-86df-2d50bd20c43a tempest-VolumesSnapshotTestJSON-1697003112 tempest-VolumesSnapshotTestJSON-1697003112-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:56:07.325361 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-8e0cda87-584d-4245-86df-2d50bd20c43a tempest-VolumesSnapshotTestJSON-1697003112 tempest-VolumesSnapshotTestJSON-1697003112-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:56:07.326321 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-8e0cda87-584d-4245-86df-2d50bd20c43a tempest-VolumesSnapshotTestJSON-1697003112 tempest-VolumesSnapshotTestJSON-1697003112-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:56:07.327005 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-8e0cda87-584d-4245-86df-2d50bd20c43a tempest-VolumesSnapshotTestJSON-1697003112 tempest-VolumesSnapshotTestJSON-1697003112-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:56:07.427828 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.objects.instance [None req-8e0cda87-584d-4245-86df-2d50bd20c43a tempest-VolumesSnapshotTestJSON-1697003112 tempest-VolumesSnapshotTestJSON-1697003112-project] Lazy-loading 'services' on Instance uuid 4a2c7e29-e0ec-456b-bd06-ff7127f84e54 {{(pid=123458) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 29 08:56:07.529118 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-8e0cda87-584d-4245-86df-2d50bd20c43a tempest-VolumesSnapshotTestJSON-1697003112 tempest-VolumesSnapshotTestJSON-1697003112-project] 10.222.0.31 "DELETE /compute/v2.1/servers/4a2c7e29-e0ec-456b-bd06-ff7127f84e54/os-volume_attachments/33ed02bf-60cc-4995-93ff-a4495d02b345" status: 202 len: 0 microversion: 2.1 time: 0.218304 Apr 29 08:56:07.530151 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 291/585] 10.222.0.31 () {58 vars in 1415 bytes} [Fri Apr 29 08:56:07 2022] DELETE /compute/v2.1/servers/4a2c7e29-e0ec-456b-bd06-ff7127f84e54/os-volume_attachments/33ed02bf-60cc-4995-93ff-a4495d02b345 => generated 0 bytes in 220 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 29 08:56:07.971980 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-a5fcfbd1-7f7a-4a34-ad7f-b680c5c5007c tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Calling method '>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:56:07.972870 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-a5fcfbd1-7f7a-4a34-ad7f-b680c5c5007c tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] [instance: 406b5ad6-698e-457f-93f4-cdfd45fb3e8e] Fetching instance by UUID {{(pid=123459) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:56:07.980453 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-a5fcfbd1-7f7a-4a34-ad7f-b680c5c5007c tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:56:07.981170 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-a5fcfbd1-7f7a-4a34-ad7f-b680c5c5007c tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:56:07.982856 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-a5fcfbd1-7f7a-4a34-ad7f-b680c5c5007c tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:56:07.983494 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-a5fcfbd1-7f7a-4a34-ad7f-b680c5c5007c tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:56:08.249440 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-a5fcfbd1-7f7a-4a34-ad7f-b680c5c5007c tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:56:08.259698 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-a5fcfbd1-7f7a-4a34-ad7f-b680c5c5007c tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:56:08.263527 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-a5fcfbd1-7f7a-4a34-ad7f-b680c5c5007c tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:56:08.264792 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-a5fcfbd1-7f7a-4a34-ad7f-b680c5c5007c tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] 10.222.0.31 "GET /compute/v2.1/servers/406b5ad6-698e-457f-93f4-cdfd45fb3e8e" status: 200 len: 1727 microversion: 2.20 time: 0.297310 Apr 29 08:56:08.279023 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 295/586] 10.222.0.31 () {60 vars in 1276 bytes} [Fri Apr 29 08:56:07 2022] GET /compute/v2.1/servers/406b5ad6-698e-457f-93f4-cdfd45fb3e8e => generated 1727 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 29 08:56:08.285649 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-1b74eb85-cf3f-46b3-93f3-c72f825b4284 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4f915c48-efb9-4b30-b885-514e4aecf245"}} {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 29 08:56:08.287578 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-1b74eb85-cf3f-46b3-93f3-c72f825b4284 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] [instance: 406b5ad6-698e-457f-93f4-cdfd45fb3e8e] Fetching instance by UUID {{(pid=123458) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:56:08.294310 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-1b74eb85-cf3f-46b3-93f3-c72f825b4284 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:56:08.294891 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-1b74eb85-cf3f-46b3-93f3-c72f825b4284 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:56:08.295796 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-1b74eb85-cf3f-46b3-93f3-c72f825b4284 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:56:08.296336 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-1b74eb85-cf3f-46b3-93f3-c72f825b4284 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:56:08.744879 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-1b74eb85-cf3f-46b3-93f3-c72f825b4284 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] 10.222.0.31 "POST /compute/v2.1/servers/406b5ad6-698e-457f-93f4-cdfd45fb3e8e/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.463843 Apr 29 08:56:08.745915 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 292/587] 10.222.0.31 () {62 vars in 1363 bytes} [Fri Apr 29 08:56:08 2022] POST /compute/v2.1/servers/406b5ad6-698e-457f-93f4-cdfd45fb3e8e/os-volume_attachments => generated 188 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 29 08:56:08.940542 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-938e6cf7-12c7-41a4-97ca-300d91ae2917 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 29 08:56:08.941344 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-938e6cf7-12c7-41a4-97ca-300d91ae2917 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] [instance: 406b5ad6-698e-457f-93f4-cdfd45fb3e8e] Fetching instance by UUID {{(pid=123459) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:56:08.953872 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-938e6cf7-12c7-41a4-97ca-300d91ae2917 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:56:08.955506 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-938e6cf7-12c7-41a4-97ca-300d91ae2917 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:56:08.961773 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-938e6cf7-12c7-41a4-97ca-300d91ae2917 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:56:08.963059 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-938e6cf7-12c7-41a4-97ca-300d91ae2917 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:56:09.160443 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-938e6cf7-12c7-41a4-97ca-300d91ae2917 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] 10.222.0.31 "POST /compute/v2.1/servers/406b5ad6-698e-457f-93f4-cdfd45fb3e8e/action" status: 202 len: 0 microversion: 2.20 time: 0.233258 Apr 29 08:56:09.161783 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 296/588] 10.222.0.31 () {62 vars in 1318 bytes} [Fri Apr 29 08:56:08 2022] POST /compute/v2.1/servers/406b5ad6-698e-457f-93f4-cdfd45fb3e8e/action => generated 0 bytes in 237 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Apr 29 08:56:09.169941 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-94d0edcf-395e-4644-b26b-a1c40efb3df1 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Calling method '>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:56:09.170838 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-94d0edcf-395e-4644-b26b-a1c40efb3df1 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] [instance: 406b5ad6-698e-457f-93f4-cdfd45fb3e8e] Fetching instance by UUID {{(pid=123458) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:56:09.184993 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-94d0edcf-395e-4644-b26b-a1c40efb3df1 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:56:09.185862 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-94d0edcf-395e-4644-b26b-a1c40efb3df1 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:56:09.186814 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-94d0edcf-395e-4644-b26b-a1c40efb3df1 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:56:09.187406 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-94d0edcf-395e-4644-b26b-a1c40efb3df1 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:56:09.806141 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-c78c7f1e-3d51-4d1e-84b2-b0f2b9551ff9 tempest-VolumesSnapshotTestJSON-1697003112 tempest-VolumesSnapshotTestJSON-1697003112-project] Calling method '>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:56:09.807171 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-c78c7f1e-3d51-4d1e-84b2-b0f2b9551ff9 tempest-VolumesSnapshotTestJSON-1697003112 tempest-VolumesSnapshotTestJSON-1697003112-project] [instance: 4a2c7e29-e0ec-456b-bd06-ff7127f84e54] Fetching instance by UUID {{(pid=123459) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:56:09.815379 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-c78c7f1e-3d51-4d1e-84b2-b0f2b9551ff9 tempest-VolumesSnapshotTestJSON-1697003112 tempest-VolumesSnapshotTestJSON-1697003112-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:56:09.820403 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-c78c7f1e-3d51-4d1e-84b2-b0f2b9551ff9 tempest-VolumesSnapshotTestJSON-1697003112 tempest-VolumesSnapshotTestJSON-1697003112-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:56:09.821490 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-c78c7f1e-3d51-4d1e-84b2-b0f2b9551ff9 tempest-VolumesSnapshotTestJSON-1697003112 tempest-VolumesSnapshotTestJSON-1697003112-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:56:09.822158 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-c78c7f1e-3d51-4d1e-84b2-b0f2b9551ff9 tempest-VolumesSnapshotTestJSON-1697003112 tempest-VolumesSnapshotTestJSON-1697003112-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:56:09.857634 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-c78c7f1e-3d51-4d1e-84b2-b0f2b9551ff9 tempest-VolumesSnapshotTestJSON-1697003112 tempest-VolumesSnapshotTestJSON-1697003112-project] [instance: 4a2c7e29-e0ec-456b-bd06-ff7127f84e54] Going to try to terminate instance {{(pid=123459) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 29 08:56:09.885500 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-94d0edcf-395e-4644-b26b-a1c40efb3df1 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:56:09.894818 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-94d0edcf-395e-4644-b26b-a1c40efb3df1 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:56:09.910149 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-94d0edcf-395e-4644-b26b-a1c40efb3df1 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:56:09.912226 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-94d0edcf-395e-4644-b26b-a1c40efb3df1 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] 10.222.0.31 "GET /compute/v2.1/servers/406b5ad6-698e-457f-93f4-cdfd45fb3e8e" status: 200 len: 1753 microversion: 2.20 time: 0.745540 Apr 29 08:56:09.923058 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 293/589] 10.222.0.31 () {60 vars in 1276 bytes} [Fri Apr 29 08:56:09 2022] GET /compute/v2.1/servers/406b5ad6-698e-457f-93f4-cdfd45fb3e8e => generated 1753 bytes in 748 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 29 08:56:10.018440 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-c78c7f1e-3d51-4d1e-84b2-b0f2b9551ff9 tempest-VolumesSnapshotTestJSON-1697003112 tempest-VolumesSnapshotTestJSON-1697003112-project] 10.222.0.31 "DELETE /compute/v2.1/servers/4a2c7e29-e0ec-456b-bd06-ff7127f84e54" status: 204 len: 0 microversion: 2.1 time: 0.216213 Apr 29 08:56:10.020095 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 297/590] 10.222.0.31 () {58 vars in 1238 bytes} [Fri Apr 29 08:56:09 2022] DELETE /compute/v2.1/servers/4a2c7e29-e0ec-456b-bd06-ff7127f84e54 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 29 08:56:10.028943 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-084db150-441b-41a2-805e-93fa7fa0f3b8 tempest-VolumesSnapshotTestJSON-1697003112 tempest-VolumesSnapshotTestJSON-1697003112-project] Calling method '>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:56:10.029552 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-084db150-441b-41a2-805e-93fa7fa0f3b8 tempest-VolumesSnapshotTestJSON-1697003112 tempest-VolumesSnapshotTestJSON-1697003112-project] [instance: 4a2c7e29-e0ec-456b-bd06-ff7127f84e54] Fetching instance by UUID {{(pid=123458) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:56:10.038964 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-084db150-441b-41a2-805e-93fa7fa0f3b8 tempest-VolumesSnapshotTestJSON-1697003112 tempest-VolumesSnapshotTestJSON-1697003112-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:56:10.039415 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-084db150-441b-41a2-805e-93fa7fa0f3b8 tempest-VolumesSnapshotTestJSON-1697003112 tempest-VolumesSnapshotTestJSON-1697003112-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:56:10.044185 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-084db150-441b-41a2-805e-93fa7fa0f3b8 tempest-VolumesSnapshotTestJSON-1697003112 tempest-VolumesSnapshotTestJSON-1697003112-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:56:10.044755 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-084db150-441b-41a2-805e-93fa7fa0f3b8 tempest-VolumesSnapshotTestJSON-1697003112 tempest-VolumesSnapshotTestJSON-1697003112-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:56:10.232300 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-084db150-441b-41a2-805e-93fa7fa0f3b8 tempest-VolumesSnapshotTestJSON-1697003112 tempest-VolumesSnapshotTestJSON-1697003112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a210cf812fb54682ac28a13a5dce0563', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c0d26c7abcc4bc7b175ac175bb5f2ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:56:10.243228 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-084db150-441b-41a2-805e-93fa7fa0f3b8 tempest-VolumesSnapshotTestJSON-1697003112 tempest-VolumesSnapshotTestJSON-1697003112-project] 10.222.0.31 "GET /compute/v2.1/servers/4a2c7e29-e0ec-456b-bd06-ff7127f84e54" status: 200 len: 1514 microversion: 2.1 time: 0.218258 Apr 29 08:56:10.252562 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 294/591] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 08:56:10 2022] GET /compute/v2.1/servers/4a2c7e29-e0ec-456b-bd06-ff7127f84e54 => generated 1514 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 08:56:10.932171 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-9944e73f-392c-4565-a7cb-9a12b133a0bf tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Calling method '>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:56:10.933584 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-9944e73f-392c-4565-a7cb-9a12b133a0bf tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] [instance: 406b5ad6-698e-457f-93f4-cdfd45fb3e8e] Fetching instance by UUID {{(pid=123459) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:56:10.941038 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-9944e73f-392c-4565-a7cb-9a12b133a0bf tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:56:10.950400 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-9944e73f-392c-4565-a7cb-9a12b133a0bf tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:56:10.951314 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-9944e73f-392c-4565-a7cb-9a12b133a0bf tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:56:10.951764 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-9944e73f-392c-4565-a7cb-9a12b133a0bf tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:56:11.101915 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-9944e73f-392c-4565-a7cb-9a12b133a0bf tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:56:11.111165 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-9944e73f-392c-4565-a7cb-9a12b133a0bf tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:56:11.112762 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-9944e73f-392c-4565-a7cb-9a12b133a0bf tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:56:11.114186 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-9944e73f-392c-4565-a7cb-9a12b133a0bf tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] 10.222.0.31 "GET /compute/v2.1/servers/406b5ad6-698e-457f-93f4-cdfd45fb3e8e" status: 200 len: 1753 microversion: 2.20 time: 0.187165 Apr 29 08:56:11.116071 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 298/592] 10.222.0.31 () {60 vars in 1276 bytes} [Fri Apr 29 08:56:10 2022] GET /compute/v2.1/servers/406b5ad6-698e-457f-93f4-cdfd45fb3e8e => generated 1753 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 29 08:56:11.264463 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-3e76ba87-ae1f-41af-94b9-a03a6cdab34a tempest-VolumesSnapshotTestJSON-1697003112 tempest-VolumesSnapshotTestJSON-1697003112-project] Calling method '>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:56:11.265042 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-3e76ba87-ae1f-41af-94b9-a03a6cdab34a tempest-VolumesSnapshotTestJSON-1697003112 tempest-VolumesSnapshotTestJSON-1697003112-project] [instance: 4a2c7e29-e0ec-456b-bd06-ff7127f84e54] Fetching instance by UUID {{(pid=123458) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:56:11.272091 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-3e76ba87-ae1f-41af-94b9-a03a6cdab34a tempest-VolumesSnapshotTestJSON-1697003112 tempest-VolumesSnapshotTestJSON-1697003112-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:56:11.272562 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-3e76ba87-ae1f-41af-94b9-a03a6cdab34a tempest-VolumesSnapshotTestJSON-1697003112 tempest-VolumesSnapshotTestJSON-1697003112-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:56:11.273517 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-3e76ba87-ae1f-41af-94b9-a03a6cdab34a tempest-VolumesSnapshotTestJSON-1697003112 tempest-VolumesSnapshotTestJSON-1697003112-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:56:11.274054 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-3e76ba87-ae1f-41af-94b9-a03a6cdab34a tempest-VolumesSnapshotTestJSON-1697003112 tempest-VolumesSnapshotTestJSON-1697003112-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:56:11.349383 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-e4a2eabe-5947-4875-9e2b-8cd54a5c9840 tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] Action: 'create', calling method: .version_select at 0x7f62383f8790>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1171703312"}} {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 29 08:56:11.365856 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.quota [None req-e4a2eabe-5947-4875-9e2b-8cd54a5c9840 tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] Getting quotas for project 6abb4912c175406ca0cefd03e327b7f5. Resources: {'key_pairs'} {{(pid=123459) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 29 08:56:11.369814 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.quota [None req-e4a2eabe-5947-4875-9e2b-8cd54a5c9840 tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] Getting quotas for user 5571352a755f45efa76b6720eb81c9c4 and project 6abb4912c175406ca0cefd03e327b7f5. Resources: {'key_pairs'} {{(pid=123459) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 29 08:56:11.413429 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-3e76ba87-ae1f-41af-94b9-a03a6cdab34a tempest-VolumesSnapshotTestJSON-1697003112 tempest-VolumesSnapshotTestJSON-1697003112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a210cf812fb54682ac28a13a5dce0563', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c0d26c7abcc4bc7b175ac175bb5f2ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:56:11.420891 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-3e76ba87-ae1f-41af-94b9-a03a6cdab34a tempest-VolumesSnapshotTestJSON-1697003112 tempest-VolumesSnapshotTestJSON-1697003112-project] 10.222.0.31 "GET /compute/v2.1/servers/4a2c7e29-e0ec-456b-bd06-ff7127f84e54" status: 200 len: 1514 microversion: 2.1 time: 0.160664 Apr 29 08:56:11.421463 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 295/593] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 08:56:11 2022] GET /compute/v2.1/servers/4a2c7e29-e0ec-456b-bd06-ff7127f84e54 => generated 1514 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 08:56:11.495042 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.quota [None req-e4a2eabe-5947-4875-9e2b-8cd54a5c9840 tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] Getting quotas for project 6abb4912c175406ca0cefd03e327b7f5. Resources: {'key_pairs'} {{(pid=123459) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 29 08:56:11.499901 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.quota [None req-e4a2eabe-5947-4875-9e2b-8cd54a5c9840 tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] Getting quotas for user 5571352a755f45efa76b6720eb81c9c4 and project 6abb4912c175406ca0cefd03e327b7f5. Resources: {'key_pairs'} {{(pid=123459) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 29 08:56:11.516231 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-e4a2eabe-5947-4875-9e2b-8cd54a5c9840 tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] 10.222.0.31 "POST /compute/v2.1/os-keypairs" status: 200 len: 2322 microversion: 2.1 time: 0.171241 Apr 29 08:56:11.517306 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 299/594] 10.222.0.31 () {60 vars in 1157 bytes} [Fri Apr 29 08:56:11 2022] POST /compute/v2.1/os-keypairs => generated 2322 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 29 08:56:11.572739 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-58d3feee-9e1b-49d4-92f1-a0e4c1ec890f tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-335120228", "imageRef": "e2f5bc11-f842-4840-b7ff-c0e07b0c73d3", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1171703312", "networks": [{"uuid": "0a891c5b-09e7-4302-9ec8-333749c80e11"}]}} {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 29 08:56:11.637062 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.network.neutron [None req-58d3feee-9e1b-49d4-92f1-a0e4c1ec890f tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] validate_networks() for [('0a891c5b-09e7-4302-9ec8-333749c80e11', None, None, None, None, None)] {{(pid=123458) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 29 08:56:12.080820 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.virt.hardware [None req-58d3feee-9e1b-49d4-92f1-a0e4c1ec890f tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] Flavor limits 0:0:0 {{(pid=123458) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 29 08:56:12.081249 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.virt.hardware [None req-58d3feee-9e1b-49d4-92f1-a0e4c1ec890f tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] Image limits 0:0:0 {{(pid=123458) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 29 08:56:12.081735 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.virt.hardware [None req-58d3feee-9e1b-49d4-92f1-a0e4c1ec890f tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] Flavor pref 0:0:0 {{(pid=123458) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 29 08:56:12.082154 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.virt.hardware [None req-58d3feee-9e1b-49d4-92f1-a0e4c1ec890f tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] Image pref 0:0:0 {{(pid=123458) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 29 08:56:12.082572 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.virt.hardware [None req-58d3feee-9e1b-49d4-92f1-a0e4c1ec890f tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123458) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 29 08:56:12.092105 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-58d3feee-9e1b-49d4-92f1-a0e4c1ec890f tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:56:12.092592 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-58d3feee-9e1b-49d4-92f1-a0e4c1ec890f tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:56:12.093400 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-58d3feee-9e1b-49d4-92f1-a0e4c1ec890f tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:56:12.093843 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-58d3feee-9e1b-49d4-92f1-a0e4c1ec890f tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:56:12.112305 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.quota [None req-58d3feee-9e1b-49d4-92f1-a0e4c1ec890f tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] Getting quotas for project 6abb4912c175406ca0cefd03e327b7f5. Resources: {'instances', 'cores', 'ram'} {{(pid=123458) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 29 08:56:12.117404 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.quota [None req-58d3feee-9e1b-49d4-92f1-a0e4c1ec890f tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] Getting quotas for user 5571352a755f45efa76b6720eb81c9c4 and project 6abb4912c175406ca0cefd03e327b7f5. Resources: {'instances', 'cores', 'ram'} {{(pid=123458) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 29 08:56:12.128252 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-58d3feee-9e1b-49d4-92f1-a0e4c1ec890f tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] Going to run 1 instances... {{(pid=123458) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 29 08:56:12.130896 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-58d3feee-9e1b-49d4-92f1-a0e4c1ec890f tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] [instance: c3ad1103-185b-4f84-beb9-e1d0e546b2ed] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e2f5bc11-f842-4840-b7ff-c0e07b0c73d3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123458) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 29 08:56:12.135310 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-314c224c-b930-44af-82fb-d92028ed3e3a tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Calling method '>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:56:12.135926 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-314c224c-b930-44af-82fb-d92028ed3e3a tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] [instance: 406b5ad6-698e-457f-93f4-cdfd45fb3e8e] Fetching instance by UUID {{(pid=123459) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:56:12.145061 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-314c224c-b930-44af-82fb-d92028ed3e3a tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:56:12.145576 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-314c224c-b930-44af-82fb-d92028ed3e3a tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:56:12.146708 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-314c224c-b930-44af-82fb-d92028ed3e3a tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:56:12.147654 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-314c224c-b930-44af-82fb-d92028ed3e3a tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:56:12.180168 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-58d3feee-9e1b-49d4-92f1-a0e4c1ec890f tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] 10.222.0.31 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.611287 Apr 29 08:56:12.180834 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 296/595] 10.222.0.31 () {60 vars in 1146 bytes} [Fri Apr 29 08:56:11 2022] POST /compute/v2.1/servers => generated 380 bytes in 613 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 29 08:56:12.190718 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-bac2d7a8-c515-41a3-95a8-46852e1fc20c tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] Calling method '>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:56:12.191337 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-bac2d7a8-c515-41a3-95a8-46852e1fc20c tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] [instance: c3ad1103-185b-4f84-beb9-e1d0e546b2ed] Fetching instance by UUID {{(pid=123458) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:56:12.279603 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-bac2d7a8-c515-41a3-95a8-46852e1fc20c tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5571352a755f45efa76b6720eb81c9c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6abb4912c175406ca0cefd03e327b7f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:56:12.291953 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-bac2d7a8-c515-41a3-95a8-46852e1fc20c tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] 10.222.0.31 "GET /compute/v2.1/servers/c3ad1103-185b-4f84-beb9-e1d0e546b2ed" status: 200 len: 1258 microversion: 2.1 time: 0.104817 Apr 29 08:56:12.297058 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-314c224c-b930-44af-82fb-d92028ed3e3a tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:56:12.303521 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 297/596] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 08:56:12 2022] GET /compute/v2.1/servers/c3ad1103-185b-4f84-beb9-e1d0e546b2ed => generated 1258 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 08:56:12.306504 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-314c224c-b930-44af-82fb-d92028ed3e3a tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:56:12.308102 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-314c224c-b930-44af-82fb-d92028ed3e3a tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:56:12.309974 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-314c224c-b930-44af-82fb-d92028ed3e3a tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] 10.222.0.31 "GET /compute/v2.1/servers/406b5ad6-698e-457f-93f4-cdfd45fb3e8e" status: 200 len: 1755 microversion: 2.20 time: 0.178745 Apr 29 08:56:12.310535 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 300/597] 10.222.0.31 () {60 vars in 1276 bytes} [Fri Apr 29 08:56:12 2022] GET /compute/v2.1/servers/406b5ad6-698e-457f-93f4-cdfd45fb3e8e => generated 1755 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 29 08:56:12.443918 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-bf576c35-09b4-4d4e-b313-e95181ea14bf tempest-VolumesSnapshotTestJSON-1697003112 tempest-VolumesSnapshotTestJSON-1697003112-project] Calling method '>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:56:12.444769 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-bf576c35-09b4-4d4e-b313-e95181ea14bf tempest-VolumesSnapshotTestJSON-1697003112 tempest-VolumesSnapshotTestJSON-1697003112-project] [instance: 4a2c7e29-e0ec-456b-bd06-ff7127f84e54] Fetching instance by UUID {{(pid=123458) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:56:12.451505 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-bf576c35-09b4-4d4e-b313-e95181ea14bf tempest-VolumesSnapshotTestJSON-1697003112 tempest-VolumesSnapshotTestJSON-1697003112-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:56:12.451954 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-bf576c35-09b4-4d4e-b313-e95181ea14bf tempest-VolumesSnapshotTestJSON-1697003112 tempest-VolumesSnapshotTestJSON-1697003112-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:56:12.452793 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-bf576c35-09b4-4d4e-b313-e95181ea14bf tempest-VolumesSnapshotTestJSON-1697003112 tempest-VolumesSnapshotTestJSON-1697003112-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:56:12.453211 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-bf576c35-09b4-4d4e-b313-e95181ea14bf tempest-VolumesSnapshotTestJSON-1697003112 tempest-VolumesSnapshotTestJSON-1697003112-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:56:12.666156 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-bf576c35-09b4-4d4e-b313-e95181ea14bf tempest-VolumesSnapshotTestJSON-1697003112 tempest-VolumesSnapshotTestJSON-1697003112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a210cf812fb54682ac28a13a5dce0563', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c0d26c7abcc4bc7b175ac175bb5f2ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:56:12.673977 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-bf576c35-09b4-4d4e-b313-e95181ea14bf tempest-VolumesSnapshotTestJSON-1697003112 tempest-VolumesSnapshotTestJSON-1697003112-project] 10.222.0.31 "GET /compute/v2.1/servers/4a2c7e29-e0ec-456b-bd06-ff7127f84e54" status: 200 len: 1514 microversion: 2.1 time: 0.237715 Apr 29 08:56:12.685200 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 298/598] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 08:56:12 2022] GET /compute/v2.1/servers/4a2c7e29-e0ec-456b-bd06-ff7127f84e54 => generated 1514 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 08:56:12.813353 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [req-f0119125-2501-4421-b186-b8baba210df2 req-40e9f643-263f-4038-9f91-cd7106851890 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4a2c7e29-e0ec-456b-bd06-ff7127f84e54", "name": "network-vif-deleted", "tag": "bb464fd8-11f7-4acb-9ffa-b51b7c033221"}]} {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 29 08:56:12.823761 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [req-f0119125-2501-4421-b186-b8baba210df2 req-40e9f643-263f-4038-9f91-cd7106851890 service nova] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:56:12.824205 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [req-f0119125-2501-4421-b186-b8baba210df2 req-40e9f643-263f-4038-9f91-cd7106851890 service nova] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:56:12.838232 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.compute.server_external_events [req-f0119125-2501-4421-b186-b8baba210df2 req-40e9f643-263f-4038-9f91-cd7106851890 service nova] Creating event network-vif-deleted:bb464fd8-11f7-4acb-9ffa-b51b7c033221 for instance 4a2c7e29-e0ec-456b-bd06-ff7127f84e54 on hv-cinder-83987 Apr 29 08:56:12.843258 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [req-f0119125-2501-4421-b186-b8baba210df2 req-40e9f643-263f-4038-9f91-cd7106851890 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034615 Apr 29 08:56:12.844215 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 301/599] 10.222.0.31 () {64 vars in 1317 bytes} [Fri Apr 29 08:56:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 29 08:56:13.309433 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-be1082a9-6e29-408f-8874-d4c8ba98d6c6 tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] Calling method '>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:56:13.310190 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-be1082a9-6e29-408f-8874-d4c8ba98d6c6 tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] [instance: c3ad1103-185b-4f84-beb9-e1d0e546b2ed] Fetching instance by UUID {{(pid=123458) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:56:13.316369 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-be1082a9-6e29-408f-8874-d4c8ba98d6c6 tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:56:13.316815 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-be1082a9-6e29-408f-8874-d4c8ba98d6c6 tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:56:13.318174 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-be1082a9-6e29-408f-8874-d4c8ba98d6c6 tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:56:13.318673 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-be1082a9-6e29-408f-8874-d4c8ba98d6c6 tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:56:13.329603 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-455206fd-19ca-4cd9-9f7d-9cf1f5a013a2 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Calling method '>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:56:13.330284 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-455206fd-19ca-4cd9-9f7d-9cf1f5a013a2 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] [instance: 406b5ad6-698e-457f-93f4-cdfd45fb3e8e] Fetching instance by UUID {{(pid=123459) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:56:13.336708 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-455206fd-19ca-4cd9-9f7d-9cf1f5a013a2 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:56:13.337146 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-455206fd-19ca-4cd9-9f7d-9cf1f5a013a2 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:56:13.337910 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-455206fd-19ca-4cd9-9f7d-9cf1f5a013a2 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:56:13.338342 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-455206fd-19ca-4cd9-9f7d-9cf1f5a013a2 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:56:13.382100 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-be1082a9-6e29-408f-8874-d4c8ba98d6c6 tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5571352a755f45efa76b6720eb81c9c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6abb4912c175406ca0cefd03e327b7f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:56:13.389700 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-be1082a9-6e29-408f-8874-d4c8ba98d6c6 tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] 10.222.0.31 "GET /compute/v2.1/servers/c3ad1103-185b-4f84-beb9-e1d0e546b2ed" status: 200 len: 1310 microversion: 2.1 time: 0.083960 Apr 29 08:56:13.390303 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 299/600] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 08:56:13 2022] GET /compute/v2.1/servers/c3ad1103-185b-4f84-beb9-e1d0e546b2ed => generated 1310 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 08:56:13.473989 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-455206fd-19ca-4cd9-9f7d-9cf1f5a013a2 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:56:13.482548 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-455206fd-19ca-4cd9-9f7d-9cf1f5a013a2 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:56:13.484029 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-455206fd-19ca-4cd9-9f7d-9cf1f5a013a2 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:56:13.485209 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-455206fd-19ca-4cd9-9f7d-9cf1f5a013a2 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] 10.222.0.31 "GET /compute/v2.1/servers/406b5ad6-698e-457f-93f4-cdfd45fb3e8e" status: 200 len: 1811 microversion: 2.20 time: 0.160167 Apr 29 08:56:13.485753 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 302/601] 10.222.0.31 () {60 vars in 1276 bytes} [Fri Apr 29 08:56:13 2022] GET /compute/v2.1/servers/406b5ad6-698e-457f-93f4-cdfd45fb3e8e => generated 1811 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 29 08:56:13.691489 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-92033418-8a3c-4e3e-a40b-ab61ce3044e3 tempest-VolumesSnapshotTestJSON-1697003112 tempest-VolumesSnapshotTestJSON-1697003112-project] Calling method '>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:56:13.692097 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-92033418-8a3c-4e3e-a40b-ab61ce3044e3 tempest-VolumesSnapshotTestJSON-1697003112 tempest-VolumesSnapshotTestJSON-1697003112-project] [instance: 4a2c7e29-e0ec-456b-bd06-ff7127f84e54] Fetching instance by UUID {{(pid=123458) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:56:13.698600 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-92033418-8a3c-4e3e-a40b-ab61ce3044e3 tempest-VolumesSnapshotTestJSON-1697003112 tempest-VolumesSnapshotTestJSON-1697003112-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:56:13.699046 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-92033418-8a3c-4e3e-a40b-ab61ce3044e3 tempest-VolumesSnapshotTestJSON-1697003112 tempest-VolumesSnapshotTestJSON-1697003112-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:56:13.699826 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-92033418-8a3c-4e3e-a40b-ab61ce3044e3 tempest-VolumesSnapshotTestJSON-1697003112 tempest-VolumesSnapshotTestJSON-1697003112-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:56:13.700293 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-92033418-8a3c-4e3e-a40b-ab61ce3044e3 tempest-VolumesSnapshotTestJSON-1697003112 tempest-VolumesSnapshotTestJSON-1697003112-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:56:13.732300 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-92033418-8a3c-4e3e-a40b-ab61ce3044e3 tempest-VolumesSnapshotTestJSON-1697003112 tempest-VolumesSnapshotTestJSON-1697003112-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:56:13.732747 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-92033418-8a3c-4e3e-a40b-ab61ce3044e3 tempest-VolumesSnapshotTestJSON-1697003112 tempest-VolumesSnapshotTestJSON-1697003112-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:56:13.733231 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.objects.instance [None req-92033418-8a3c-4e3e-a40b-ab61ce3044e3 tempest-VolumesSnapshotTestJSON-1697003112 tempest-VolumesSnapshotTestJSON-1697003112-project] Lazy-loading 'fault' on Instance uuid 4a2c7e29-e0ec-456b-bd06-ff7127f84e54 {{(pid=123458) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 29 08:56:13.777093 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-92033418-8a3c-4e3e-a40b-ab61ce3044e3 tempest-VolumesSnapshotTestJSON-1697003112 tempest-VolumesSnapshotTestJSON-1697003112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a210cf812fb54682ac28a13a5dce0563', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c0d26c7abcc4bc7b175ac175bb5f2ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:56:13.784603 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-92033418-8a3c-4e3e-a40b-ab61ce3044e3 tempest-VolumesSnapshotTestJSON-1697003112 tempest-VolumesSnapshotTestJSON-1697003112-project] 10.222.0.31 "GET /compute/v2.1/servers/4a2c7e29-e0ec-456b-bd06-ff7127f84e54" status: 200 len: 1309 microversion: 2.1 time: 0.096860 Apr 29 08:56:13.785190 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 300/602] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 08:56:13 2022] GET /compute/v2.1/servers/4a2c7e29-e0ec-456b-bd06-ff7127f84e54 => generated 1309 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 08:56:14.406982 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-fdc44098-9336-4afe-b319-dc587c599899 tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] Calling method '>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:56:14.407581 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-fdc44098-9336-4afe-b319-dc587c599899 tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] [instance: c3ad1103-185b-4f84-beb9-e1d0e546b2ed] Fetching instance by UUID {{(pid=123459) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:56:14.414124 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-fdc44098-9336-4afe-b319-dc587c599899 tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:56:14.414561 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-fdc44098-9336-4afe-b319-dc587c599899 tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:56:14.415313 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-fdc44098-9336-4afe-b319-dc587c599899 tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:56:14.415743 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-fdc44098-9336-4afe-b319-dc587c599899 tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:56:14.480932 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-fdc44098-9336-4afe-b319-dc587c599899 tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5571352a755f45efa76b6720eb81c9c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6abb4912c175406ca0cefd03e327b7f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:56:14.491253 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-fdc44098-9336-4afe-b319-dc587c599899 tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] 10.222.0.31 "GET /compute/v2.1/servers/c3ad1103-185b-4f84-beb9-e1d0e546b2ed" status: 200 len: 1316 microversion: 2.1 time: 0.088093 Apr 29 08:56:14.492022 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 303/603] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 08:56:14 2022] GET /compute/v2.1/servers/c3ad1103-185b-4f84-beb9-e1d0e546b2ed => generated 1316 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 08:56:14.504172 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-1dcbb8b0-38fa-4087-a1b0-4c8954c654f3 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Calling method '>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:56:14.505402 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-1dcbb8b0-38fa-4087-a1b0-4c8954c654f3 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] [instance: 406b5ad6-698e-457f-93f4-cdfd45fb3e8e] Fetching instance by UUID {{(pid=123458) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:56:14.513600 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-1dcbb8b0-38fa-4087-a1b0-4c8954c654f3 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:56:14.514285 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-1dcbb8b0-38fa-4087-a1b0-4c8954c654f3 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:56:14.515209 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-1dcbb8b0-38fa-4087-a1b0-4c8954c654f3 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:56:14.516454 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-1dcbb8b0-38fa-4087-a1b0-4c8954c654f3 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:56:14.804224 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-9e839048-1ef5-49b0-a553-31f667c03b51 tempest-VolumesSnapshotTestJSON-1697003112 tempest-VolumesSnapshotTestJSON-1697003112-project] Calling method '>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:56:14.805106 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-9e839048-1ef5-49b0-a553-31f667c03b51 tempest-VolumesSnapshotTestJSON-1697003112 tempest-VolumesSnapshotTestJSON-1697003112-project] [instance: 4a2c7e29-e0ec-456b-bd06-ff7127f84e54] Fetching instance by UUID {{(pid=123459) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:56:14.815126 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-9e839048-1ef5-49b0-a553-31f667c03b51 tempest-VolumesSnapshotTestJSON-1697003112 tempest-VolumesSnapshotTestJSON-1697003112-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:56:14.815826 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-9e839048-1ef5-49b0-a553-31f667c03b51 tempest-VolumesSnapshotTestJSON-1697003112 tempest-VolumesSnapshotTestJSON-1697003112-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:56:14.816815 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-9e839048-1ef5-49b0-a553-31f667c03b51 tempest-VolumesSnapshotTestJSON-1697003112 tempest-VolumesSnapshotTestJSON-1697003112-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:56:14.819422 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-9e839048-1ef5-49b0-a553-31f667c03b51 tempest-VolumesSnapshotTestJSON-1697003112 tempest-VolumesSnapshotTestJSON-1697003112-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:56:14.841798 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.wsgi [None req-9e839048-1ef5-49b0-a553-31f667c03b51 tempest-VolumesSnapshotTestJSON-1697003112 tempest-VolumesSnapshotTestJSON-1697003112-project] HTTP exception thrown: Instance 4a2c7e29-e0ec-456b-bd06-ff7127f84e54 could not be found. Apr 29 08:56:14.842660 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-9e839048-1ef5-49b0-a553-31f667c03b51 tempest-VolumesSnapshotTestJSON-1697003112 tempest-VolumesSnapshotTestJSON-1697003112-project] Returning 404 to user: Instance 4a2c7e29-e0ec-456b-bd06-ff7127f84e54 could not be found. {{(pid=123459) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 29 08:56:14.843676 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-9e839048-1ef5-49b0-a553-31f667c03b51 tempest-VolumesSnapshotTestJSON-1697003112 tempest-VolumesSnapshotTestJSON-1697003112-project] 10.222.0.31 "GET /compute/v2.1/servers/4a2c7e29-e0ec-456b-bd06-ff7127f84e54" status: 404 len: 111 microversion: 2.1 time: 0.045027 Apr 29 08:56:14.844718 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 304/604] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 08:56:14 2022] GET /compute/v2.1/servers/4a2c7e29-e0ec-456b-bd06-ff7127f84e54 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 29 08:56:14.952154 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-1dcbb8b0-38fa-4087-a1b0-4c8954c654f3 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:56:14.970075 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-1dcbb8b0-38fa-4087-a1b0-4c8954c654f3 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:56:14.971883 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-1dcbb8b0-38fa-4087-a1b0-4c8954c654f3 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:56:14.974475 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-1dcbb8b0-38fa-4087-a1b0-4c8954c654f3 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] 10.222.0.31 "GET /compute/v2.1/servers/406b5ad6-698e-457f-93f4-cdfd45fb3e8e" status: 200 len: 1811 microversion: 2.20 time: 0.474035 Apr 29 08:56:14.986859 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 301/605] 10.222.0.31 () {60 vars in 1276 bytes} [Fri Apr 29 08:56:14 2022] GET /compute/v2.1/servers/406b5ad6-698e-457f-93f4-cdfd45fb3e8e => generated 1811 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 29 08:56:15.508580 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-d9a4846e-aa9d-4116-9654-a36688128a32 tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] Calling method '>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:56:15.509191 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-d9a4846e-aa9d-4116-9654-a36688128a32 tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] [instance: c3ad1103-185b-4f84-beb9-e1d0e546b2ed] Fetching instance by UUID {{(pid=123459) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:56:15.516265 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-d9a4846e-aa9d-4116-9654-a36688128a32 tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:56:15.516662 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-d9a4846e-aa9d-4116-9654-a36688128a32 tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:56:15.517548 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-d9a4846e-aa9d-4116-9654-a36688128a32 tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:56:15.517987 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-d9a4846e-aa9d-4116-9654-a36688128a32 tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:56:15.674361 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-d9a4846e-aa9d-4116-9654-a36688128a32 tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5571352a755f45efa76b6720eb81c9c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6abb4912c175406ca0cefd03e327b7f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:56:15.682927 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-d9a4846e-aa9d-4116-9654-a36688128a32 tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] 10.222.0.31 "GET /compute/v2.1/servers/c3ad1103-185b-4f84-beb9-e1d0e546b2ed" status: 200 len: 1358 microversion: 2.1 time: 0.178422 Apr 29 08:56:15.683493 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 305/606] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 08:56:15 2022] GET /compute/v2.1/servers/c3ad1103-185b-4f84-beb9-e1d0e546b2ed => generated 1358 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 08:56:15.994727 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-8f8d83f7-7dfa-4db3-b055-b1dc70ab55b5 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Calling method '>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:56:15.995332 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-8f8d83f7-7dfa-4db3-b055-b1dc70ab55b5 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] [instance: 406b5ad6-698e-457f-93f4-cdfd45fb3e8e] Fetching instance by UUID {{(pid=123458) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:56:16.002803 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-8f8d83f7-7dfa-4db3-b055-b1dc70ab55b5 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:56:16.003252 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-8f8d83f7-7dfa-4db3-b055-b1dc70ab55b5 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:56:16.004013 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-8f8d83f7-7dfa-4db3-b055-b1dc70ab55b5 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:56:16.004479 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-8f8d83f7-7dfa-4db3-b055-b1dc70ab55b5 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:56:16.144070 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-8f8d83f7-7dfa-4db3-b055-b1dc70ab55b5 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:56:16.153088 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-8f8d83f7-7dfa-4db3-b055-b1dc70ab55b5 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:56:16.154587 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-8f8d83f7-7dfa-4db3-b055-b1dc70ab55b5 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:56:16.155737 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-8f8d83f7-7dfa-4db3-b055-b1dc70ab55b5 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] 10.222.0.31 "GET /compute/v2.1/servers/406b5ad6-698e-457f-93f4-cdfd45fb3e8e" status: 200 len: 1811 microversion: 2.20 time: 0.165228 Apr 29 08:56:16.156331 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 302/607] 10.222.0.31 () {60 vars in 1276 bytes} [Fri Apr 29 08:56:15 2022] GET /compute/v2.1/servers/406b5ad6-698e-457f-93f4-cdfd45fb3e8e => generated 1811 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 29 08:56:16.700115 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-84b917b9-e89f-4726-a40e-b7b48266d4ce tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] Calling method '>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:56:16.700737 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-84b917b9-e89f-4726-a40e-b7b48266d4ce tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] [instance: c3ad1103-185b-4f84-beb9-e1d0e546b2ed] Fetching instance by UUID {{(pid=123459) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:56:16.716026 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-84b917b9-e89f-4726-a40e-b7b48266d4ce tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:56:16.716504 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-84b917b9-e89f-4726-a40e-b7b48266d4ce tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:56:16.717280 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-84b917b9-e89f-4726-a40e-b7b48266d4ce tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:56:16.717710 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-84b917b9-e89f-4726-a40e-b7b48266d4ce tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:56:16.867967 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-84b917b9-e89f-4726-a40e-b7b48266d4ce tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5571352a755f45efa76b6720eb81c9c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6abb4912c175406ca0cefd03e327b7f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:56:16.875686 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-84b917b9-e89f-4726-a40e-b7b48266d4ce tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] 10.222.0.31 "GET /compute/v2.1/servers/c3ad1103-185b-4f84-beb9-e1d0e546b2ed" status: 200 len: 1358 microversion: 2.1 time: 0.179399 Apr 29 08:56:16.876301 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 306/608] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 08:56:16 2022] GET /compute/v2.1/servers/c3ad1103-185b-4f84-beb9-e1d0e546b2ed => generated 1358 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 08:56:17.174620 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-af0ce40e-e856-4dc9-a934-ff9c382db2c7 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Calling method '>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:56:17.175250 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-af0ce40e-e856-4dc9-a934-ff9c382db2c7 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] [instance: 406b5ad6-698e-457f-93f4-cdfd45fb3e8e] Fetching instance by UUID {{(pid=123458) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:56:17.185424 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-af0ce40e-e856-4dc9-a934-ff9c382db2c7 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:56:17.185881 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-af0ce40e-e856-4dc9-a934-ff9c382db2c7 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:56:17.186875 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-af0ce40e-e856-4dc9-a934-ff9c382db2c7 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:56:17.187624 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-af0ce40e-e856-4dc9-a934-ff9c382db2c7 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:56:17.394709 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-af0ce40e-e856-4dc9-a934-ff9c382db2c7 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:56:17.416397 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-af0ce40e-e856-4dc9-a934-ff9c382db2c7 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:56:17.418254 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-af0ce40e-e856-4dc9-a934-ff9c382db2c7 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:56:17.419716 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-af0ce40e-e856-4dc9-a934-ff9c382db2c7 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] 10.222.0.31 "GET /compute/v2.1/servers/406b5ad6-698e-457f-93f4-cdfd45fb3e8e" status: 200 len: 1811 microversion: 2.20 time: 0.249003 Apr 29 08:56:17.424193 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 303/609] 10.222.0.31 () {60 vars in 1276 bytes} [Fri Apr 29 08:56:17 2022] GET /compute/v2.1/servers/406b5ad6-698e-457f-93f4-cdfd45fb3e8e => generated 1811 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 29 08:56:17.894226 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-7e4a07bf-9727-472e-ad3b-defcdf07156b tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] Calling method '>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:56:17.896370 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-7e4a07bf-9727-472e-ad3b-defcdf07156b tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] [instance: c3ad1103-185b-4f84-beb9-e1d0e546b2ed] Fetching instance by UUID {{(pid=123459) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:56:17.904347 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-7e4a07bf-9727-472e-ad3b-defcdf07156b tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:56:17.905155 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-7e4a07bf-9727-472e-ad3b-defcdf07156b tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:56:17.906261 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-7e4a07bf-9727-472e-ad3b-defcdf07156b tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:56:17.906687 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-7e4a07bf-9727-472e-ad3b-defcdf07156b tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:56:18.091820 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-7e4a07bf-9727-472e-ad3b-defcdf07156b tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5571352a755f45efa76b6720eb81c9c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6abb4912c175406ca0cefd03e327b7f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:56:18.100579 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-7e4a07bf-9727-472e-ad3b-defcdf07156b tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] 10.222.0.31 "GET /compute/v2.1/servers/c3ad1103-185b-4f84-beb9-e1d0e546b2ed" status: 200 len: 1358 microversion: 2.1 time: 0.210629 Apr 29 08:56:18.101171 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 307/610] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 08:56:17 2022] GET /compute/v2.1/servers/c3ad1103-185b-4f84-beb9-e1d0e546b2ed => generated 1358 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 08:56:18.438316 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-87c6a24a-5431-4b02-a13d-44a98d73f205 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Calling method '>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:56:18.438910 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-87c6a24a-5431-4b02-a13d-44a98d73f205 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] [instance: 406b5ad6-698e-457f-93f4-cdfd45fb3e8e] Fetching instance by UUID {{(pid=123458) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:56:18.446287 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-87c6a24a-5431-4b02-a13d-44a98d73f205 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:56:18.446732 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-87c6a24a-5431-4b02-a13d-44a98d73f205 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:56:18.447522 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-87c6a24a-5431-4b02-a13d-44a98d73f205 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:56:18.447966 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-87c6a24a-5431-4b02-a13d-44a98d73f205 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:56:18.594464 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-87c6a24a-5431-4b02-a13d-44a98d73f205 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:56:18.603695 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-87c6a24a-5431-4b02-a13d-44a98d73f205 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:56:18.605560 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-87c6a24a-5431-4b02-a13d-44a98d73f205 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:56:18.606735 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-87c6a24a-5431-4b02-a13d-44a98d73f205 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] 10.222.0.31 "GET /compute/v2.1/servers/406b5ad6-698e-457f-93f4-cdfd45fb3e8e" status: 200 len: 1811 microversion: 2.20 time: 0.172660 Apr 29 08:56:18.607297 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 304/611] 10.222.0.31 () {60 vars in 1276 bytes} [Fri Apr 29 08:56:18 2022] GET /compute/v2.1/servers/406b5ad6-698e-457f-93f4-cdfd45fb3e8e => generated 1811 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 29 08:56:19.118930 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-722f1c45-af50-43bf-95a2-7952dc3c114a tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] Calling method '>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:56:19.119539 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-722f1c45-af50-43bf-95a2-7952dc3c114a tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] [instance: c3ad1103-185b-4f84-beb9-e1d0e546b2ed] Fetching instance by UUID {{(pid=123459) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:56:19.125922 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-722f1c45-af50-43bf-95a2-7952dc3c114a tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:56:19.126369 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-722f1c45-af50-43bf-95a2-7952dc3c114a tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:56:19.127162 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-722f1c45-af50-43bf-95a2-7952dc3c114a tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:56:19.127591 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-722f1c45-af50-43bf-95a2-7952dc3c114a tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:56:19.258441 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-722f1c45-af50-43bf-95a2-7952dc3c114a tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5571352a755f45efa76b6720eb81c9c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6abb4912c175406ca0cefd03e327b7f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:56:19.265760 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-722f1c45-af50-43bf-95a2-7952dc3c114a tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] 10.222.0.31 "GET /compute/v2.1/servers/c3ad1103-185b-4f84-beb9-e1d0e546b2ed" status: 200 len: 1358 microversion: 2.1 time: 0.152138 Apr 29 08:56:19.266323 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 308/612] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 08:56:19 2022] GET /compute/v2.1/servers/c3ad1103-185b-4f84-beb9-e1d0e546b2ed => generated 1358 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 08:56:19.625237 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-2b6a233d-ec65-4ed0-979c-af9a208f8da5 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Calling method '>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:56:19.625859 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-2b6a233d-ec65-4ed0-979c-af9a208f8da5 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] [instance: 406b5ad6-698e-457f-93f4-cdfd45fb3e8e] Fetching instance by UUID {{(pid=123458) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:56:19.632387 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-2b6a233d-ec65-4ed0-979c-af9a208f8da5 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:56:19.632837 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-2b6a233d-ec65-4ed0-979c-af9a208f8da5 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:56:19.633610 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-2b6a233d-ec65-4ed0-979c-af9a208f8da5 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:56:19.634042 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-2b6a233d-ec65-4ed0-979c-af9a208f8da5 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:56:19.762306 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-2b6a233d-ec65-4ed0-979c-af9a208f8da5 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:56:19.771104 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-2b6a233d-ec65-4ed0-979c-af9a208f8da5 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:56:19.772798 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-2b6a233d-ec65-4ed0-979c-af9a208f8da5 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:56:19.774054 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-2b6a233d-ec65-4ed0-979c-af9a208f8da5 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] 10.222.0.31 "GET /compute/v2.1/servers/406b5ad6-698e-457f-93f4-cdfd45fb3e8e" status: 200 len: 1811 microversion: 2.20 time: 0.152704 Apr 29 08:56:19.774619 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 305/613] 10.222.0.31 () {60 vars in 1276 bytes} [Fri Apr 29 08:56:19 2022] GET /compute/v2.1/servers/406b5ad6-698e-457f-93f4-cdfd45fb3e8e => generated 1811 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 29 08:56:20.285311 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-3f365105-17c0-41a4-9578-a9615860c6e1 tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] Calling method '>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:56:20.286011 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-3f365105-17c0-41a4-9578-a9615860c6e1 tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] [instance: c3ad1103-185b-4f84-beb9-e1d0e546b2ed] Fetching instance by UUID {{(pid=123459) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:56:20.292876 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-3f365105-17c0-41a4-9578-a9615860c6e1 tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:56:20.293325 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-3f365105-17c0-41a4-9578-a9615860c6e1 tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:56:20.294108 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-3f365105-17c0-41a4-9578-a9615860c6e1 tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:56:20.294548 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-3f365105-17c0-41a4-9578-a9615860c6e1 tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:56:20.443168 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-3f365105-17c0-41a4-9578-a9615860c6e1 tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5571352a755f45efa76b6720eb81c9c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6abb4912c175406ca0cefd03e327b7f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:56:20.450790 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-3f365105-17c0-41a4-9578-a9615860c6e1 tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] 10.222.0.31 "GET /compute/v2.1/servers/c3ad1103-185b-4f84-beb9-e1d0e546b2ed" status: 200 len: 1358 microversion: 2.1 time: 0.172111 Apr 29 08:56:20.451362 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 309/614] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 08:56:20 2022] GET /compute/v2.1/servers/c3ad1103-185b-4f84-beb9-e1d0e546b2ed => generated 1358 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 08:56:20.792964 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-9dc82b14-291f-4ce3-95b5-58db366de233 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Calling method '>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:56:20.793578 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-9dc82b14-291f-4ce3-95b5-58db366de233 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] [instance: 406b5ad6-698e-457f-93f4-cdfd45fb3e8e] Fetching instance by UUID {{(pid=123458) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:56:20.801456 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-9dc82b14-291f-4ce3-95b5-58db366de233 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:56:20.802921 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-9dc82b14-291f-4ce3-95b5-58db366de233 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:56:20.803787 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-9dc82b14-291f-4ce3-95b5-58db366de233 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:56:20.804248 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-9dc82b14-291f-4ce3-95b5-58db366de233 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:56:20.960073 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-9dc82b14-291f-4ce3-95b5-58db366de233 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:56:20.968737 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-9dc82b14-291f-4ce3-95b5-58db366de233 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:56:20.970361 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-9dc82b14-291f-4ce3-95b5-58db366de233 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:56:20.971681 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-9dc82b14-291f-4ce3-95b5-58db366de233 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] 10.222.0.31 "GET /compute/v2.1/servers/406b5ad6-698e-457f-93f4-cdfd45fb3e8e" status: 200 len: 1811 microversion: 2.20 time: 0.182546 Apr 29 08:56:20.972289 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 306/615] 10.222.0.31 () {60 vars in 1276 bytes} [Fri Apr 29 08:56:20 2022] GET /compute/v2.1/servers/406b5ad6-698e-457f-93f4-cdfd45fb3e8e => generated 1811 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 29 08:56:21.468719 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-437623e1-f982-4ed6-b20d-12407e10df30 tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] Calling method '>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:56:21.469465 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-437623e1-f982-4ed6-b20d-12407e10df30 tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] [instance: c3ad1103-185b-4f84-beb9-e1d0e546b2ed] Fetching instance by UUID {{(pid=123459) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:56:21.483820 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-437623e1-f982-4ed6-b20d-12407e10df30 tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:56:21.484316 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-437623e1-f982-4ed6-b20d-12407e10df30 tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:56:21.485130 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-437623e1-f982-4ed6-b20d-12407e10df30 tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:56:21.485578 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-437623e1-f982-4ed6-b20d-12407e10df30 tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:56:21.638807 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-437623e1-f982-4ed6-b20d-12407e10df30 tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5571352a755f45efa76b6720eb81c9c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6abb4912c175406ca0cefd03e327b7f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:56:21.653466 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-437623e1-f982-4ed6-b20d-12407e10df30 tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] 10.222.0.31 "GET /compute/v2.1/servers/c3ad1103-185b-4f84-beb9-e1d0e546b2ed" status: 200 len: 1358 microversion: 2.1 time: 0.188478 Apr 29 08:56:21.664242 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 310/616] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 08:56:21 2022] GET /compute/v2.1/servers/c3ad1103-185b-4f84-beb9-e1d0e546b2ed => generated 1358 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 08:56:21.992592 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-ad291da8-d9e4-4e71-b276-98deab1c155e tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Calling method '>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:56:21.993153 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-ad291da8-d9e4-4e71-b276-98deab1c155e tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] [instance: 406b5ad6-698e-457f-93f4-cdfd45fb3e8e] Fetching instance by UUID {{(pid=123458) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:56:21.999616 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-ad291da8-d9e4-4e71-b276-98deab1c155e tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:56:22.000065 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-ad291da8-d9e4-4e71-b276-98deab1c155e tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:56:22.000864 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-ad291da8-d9e4-4e71-b276-98deab1c155e tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:56:22.001300 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-ad291da8-d9e4-4e71-b276-98deab1c155e tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:56:22.129603 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-ad291da8-d9e4-4e71-b276-98deab1c155e tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:56:22.138477 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-ad291da8-d9e4-4e71-b276-98deab1c155e tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:56:22.139972 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-ad291da8-d9e4-4e71-b276-98deab1c155e tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:56:22.141137 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-ad291da8-d9e4-4e71-b276-98deab1c155e tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] 10.222.0.31 "GET /compute/v2.1/servers/406b5ad6-698e-457f-93f4-cdfd45fb3e8e" status: 200 len: 1811 microversion: 2.20 time: 0.153545 Apr 29 08:56:22.141698 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 307/617] 10.222.0.31 () {60 vars in 1276 bytes} [Fri Apr 29 08:56:21 2022] GET /compute/v2.1/servers/406b5ad6-698e-457f-93f4-cdfd45fb3e8e => generated 1811 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 29 08:56:22.675121 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-d0fe1cec-80b6-4d93-b1dc-740f9975a68b tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] Calling method '>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:56:22.675879 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-d0fe1cec-80b6-4d93-b1dc-740f9975a68b tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] [instance: c3ad1103-185b-4f84-beb9-e1d0e546b2ed] Fetching instance by UUID {{(pid=123459) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:56:22.683894 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-d0fe1cec-80b6-4d93-b1dc-740f9975a68b tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:56:22.684434 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-d0fe1cec-80b6-4d93-b1dc-740f9975a68b tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:56:22.685248 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-d0fe1cec-80b6-4d93-b1dc-740f9975a68b tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:56:22.685687 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-d0fe1cec-80b6-4d93-b1dc-740f9975a68b tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:56:22.849282 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-d0fe1cec-80b6-4d93-b1dc-740f9975a68b tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5571352a755f45efa76b6720eb81c9c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6abb4912c175406ca0cefd03e327b7f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:56:22.857375 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-d0fe1cec-80b6-4d93-b1dc-740f9975a68b tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] 10.222.0.31 "GET /compute/v2.1/servers/c3ad1103-185b-4f84-beb9-e1d0e546b2ed" status: 200 len: 1358 microversion: 2.1 time: 0.187072 Apr 29 08:56:22.858002 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 311/618] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 08:56:22 2022] GET /compute/v2.1/servers/c3ad1103-185b-4f84-beb9-e1d0e546b2ed => generated 1358 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 08:56:23.163126 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-5bdd876b-1de9-4983-a2f1-622863604b65 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Calling method '>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:56:23.164961 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-5bdd876b-1de9-4983-a2f1-622863604b65 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] [instance: 406b5ad6-698e-457f-93f4-cdfd45fb3e8e] Fetching instance by UUID {{(pid=123458) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:56:23.175815 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-5bdd876b-1de9-4983-a2f1-622863604b65 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:56:23.176369 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-5bdd876b-1de9-4983-a2f1-622863604b65 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:56:23.177474 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-5bdd876b-1de9-4983-a2f1-622863604b65 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:56:23.177989 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-5bdd876b-1de9-4983-a2f1-622863604b65 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:56:23.344477 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-5bdd876b-1de9-4983-a2f1-622863604b65 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:56:23.355390 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-5bdd876b-1de9-4983-a2f1-622863604b65 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:56:23.357474 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-5bdd876b-1de9-4983-a2f1-622863604b65 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:56:23.359241 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-5bdd876b-1de9-4983-a2f1-622863604b65 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] 10.222.0.31 "GET /compute/v2.1/servers/406b5ad6-698e-457f-93f4-cdfd45fb3e8e" status: 200 len: 1811 microversion: 2.20 time: 0.202318 Apr 29 08:56:23.360564 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 308/619] 10.222.0.31 () {60 vars in 1276 bytes} [Fri Apr 29 08:56:23 2022] GET /compute/v2.1/servers/406b5ad6-698e-457f-93f4-cdfd45fb3e8e => generated 1811 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 29 08:56:23.874773 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-4bfad392-a144-4532-989c-cad18d2575d9 tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] Calling method '>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:56:23.875428 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-4bfad392-a144-4532-989c-cad18d2575d9 tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] [instance: c3ad1103-185b-4f84-beb9-e1d0e546b2ed] Fetching instance by UUID {{(pid=123459) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:56:23.881580 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-4bfad392-a144-4532-989c-cad18d2575d9 tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:56:23.882025 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-4bfad392-a144-4532-989c-cad18d2575d9 tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:56:23.882867 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-4bfad392-a144-4532-989c-cad18d2575d9 tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:56:23.883302 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-4bfad392-a144-4532-989c-cad18d2575d9 tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:56:24.030699 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-4bfad392-a144-4532-989c-cad18d2575d9 tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5571352a755f45efa76b6720eb81c9c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6abb4912c175406ca0cefd03e327b7f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:56:24.039914 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-4bfad392-a144-4532-989c-cad18d2575d9 tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] 10.222.0.31 "GET /compute/v2.1/servers/c3ad1103-185b-4f84-beb9-e1d0e546b2ed" status: 200 len: 1358 microversion: 2.1 time: 0.169125 Apr 29 08:56:24.043297 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 312/620] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 08:56:23 2022] GET /compute/v2.1/servers/c3ad1103-185b-4f84-beb9-e1d0e546b2ed => generated 1358 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 08:56:24.382497 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-890618e3-6d36-44c4-b656-14b187036e98 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Calling method '>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:56:24.383075 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-890618e3-6d36-44c4-b656-14b187036e98 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] [instance: 406b5ad6-698e-457f-93f4-cdfd45fb3e8e] Fetching instance by UUID {{(pid=123458) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:56:24.389574 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-890618e3-6d36-44c4-b656-14b187036e98 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:56:24.390026 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-890618e3-6d36-44c4-b656-14b187036e98 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:56:24.390818 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-890618e3-6d36-44c4-b656-14b187036e98 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:56:24.391257 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-890618e3-6d36-44c4-b656-14b187036e98 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:56:24.528830 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-890618e3-6d36-44c4-b656-14b187036e98 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:56:24.539226 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-890618e3-6d36-44c4-b656-14b187036e98 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:56:24.540999 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-890618e3-6d36-44c4-b656-14b187036e98 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:56:24.542203 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-890618e3-6d36-44c4-b656-14b187036e98 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] 10.222.0.31 "GET /compute/v2.1/servers/406b5ad6-698e-457f-93f4-cdfd45fb3e8e" status: 200 len: 1811 microversion: 2.20 time: 0.164171 Apr 29 08:56:24.542763 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 309/621] 10.222.0.31 () {60 vars in 1276 bytes} [Fri Apr 29 08:56:24 2022] GET /compute/v2.1/servers/406b5ad6-698e-457f-93f4-cdfd45fb3e8e => generated 1811 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 29 08:56:25.058803 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-6e913e71-7c9e-4a4a-bd4f-b98b01acc0ac tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] Calling method '>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:56:25.059397 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-6e913e71-7c9e-4a4a-bd4f-b98b01acc0ac tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] [instance: c3ad1103-185b-4f84-beb9-e1d0e546b2ed] Fetching instance by UUID {{(pid=123459) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:56:25.065835 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-6e913e71-7c9e-4a4a-bd4f-b98b01acc0ac tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:56:25.066279 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-6e913e71-7c9e-4a4a-bd4f-b98b01acc0ac tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:56:25.067154 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-6e913e71-7c9e-4a4a-bd4f-b98b01acc0ac tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:56:25.068097 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-6e913e71-7c9e-4a4a-bd4f-b98b01acc0ac tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:56:25.210041 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-6e913e71-7c9e-4a4a-bd4f-b98b01acc0ac tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5571352a755f45efa76b6720eb81c9c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6abb4912c175406ca0cefd03e327b7f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:56:25.216027 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-6e913e71-7c9e-4a4a-bd4f-b98b01acc0ac tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] 10.222.0.31 "GET /compute/v2.1/servers/c3ad1103-185b-4f84-beb9-e1d0e546b2ed" status: 200 len: 1358 microversion: 2.1 time: 0.161155 Apr 29 08:56:25.216655 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 313/622] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 08:56:25 2022] GET /compute/v2.1/servers/c3ad1103-185b-4f84-beb9-e1d0e546b2ed => generated 1358 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 08:56:25.561120 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-70f711d0-d1c2-4e79-bf75-cd854281fc73 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Calling method '>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:56:25.561866 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-70f711d0-d1c2-4e79-bf75-cd854281fc73 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] [instance: 406b5ad6-698e-457f-93f4-cdfd45fb3e8e] Fetching instance by UUID {{(pid=123458) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:56:25.569263 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-70f711d0-d1c2-4e79-bf75-cd854281fc73 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:56:25.569721 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-70f711d0-d1c2-4e79-bf75-cd854281fc73 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:56:25.570515 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-70f711d0-d1c2-4e79-bf75-cd854281fc73 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:56:25.570959 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-70f711d0-d1c2-4e79-bf75-cd854281fc73 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:56:25.726071 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-70f711d0-d1c2-4e79-bf75-cd854281fc73 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:56:25.735136 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-70f711d0-d1c2-4e79-bf75-cd854281fc73 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:56:25.736680 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-70f711d0-d1c2-4e79-bf75-cd854281fc73 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:56:25.737878 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-70f711d0-d1c2-4e79-bf75-cd854281fc73 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] 10.222.0.31 "GET /compute/v2.1/servers/406b5ad6-698e-457f-93f4-cdfd45fb3e8e" status: 200 len: 1811 microversion: 2.20 time: 0.180660 Apr 29 08:56:25.738841 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 310/623] 10.222.0.31 () {60 vars in 1276 bytes} [Fri Apr 29 08:56:25 2022] GET /compute/v2.1/servers/406b5ad6-698e-457f-93f4-cdfd45fb3e8e => generated 1811 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 29 08:56:26.233621 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-35be5187-0a12-4723-b8a7-f6cb34b076f4 tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] Calling method '>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:56:26.234952 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-35be5187-0a12-4723-b8a7-f6cb34b076f4 tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] [instance: c3ad1103-185b-4f84-beb9-e1d0e546b2ed] Fetching instance by UUID {{(pid=123459) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:56:26.245580 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-35be5187-0a12-4723-b8a7-f6cb34b076f4 tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:56:26.256980 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-35be5187-0a12-4723-b8a7-f6cb34b076f4 tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:56:26.258941 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-35be5187-0a12-4723-b8a7-f6cb34b076f4 tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:56:26.260481 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-35be5187-0a12-4723-b8a7-f6cb34b076f4 tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:56:26.418077 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-35be5187-0a12-4723-b8a7-f6cb34b076f4 tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5571352a755f45efa76b6720eb81c9c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6abb4912c175406ca0cefd03e327b7f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:56:26.427681 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-35be5187-0a12-4723-b8a7-f6cb34b076f4 tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] 10.222.0.31 "GET /compute/v2.1/servers/c3ad1103-185b-4f84-beb9-e1d0e546b2ed" status: 200 len: 1358 microversion: 2.1 time: 0.197211 Apr 29 08:56:26.428639 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 314/624] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 08:56:26 2022] GET /compute/v2.1/servers/c3ad1103-185b-4f84-beb9-e1d0e546b2ed => generated 1358 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 08:56:26.760543 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-94b31a2b-ed84-4b11-91ea-a4069b3ebd65 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Calling method '>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:56:26.762216 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-94b31a2b-ed84-4b11-91ea-a4069b3ebd65 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] [instance: 406b5ad6-698e-457f-93f4-cdfd45fb3e8e] Fetching instance by UUID {{(pid=123458) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:56:26.768913 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-94b31a2b-ed84-4b11-91ea-a4069b3ebd65 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:56:26.769363 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-94b31a2b-ed84-4b11-91ea-a4069b3ebd65 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:56:26.770144 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-94b31a2b-ed84-4b11-91ea-a4069b3ebd65 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:56:26.771064 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-94b31a2b-ed84-4b11-91ea-a4069b3ebd65 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:56:26.915101 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-94b31a2b-ed84-4b11-91ea-a4069b3ebd65 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:56:26.924521 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-94b31a2b-ed84-4b11-91ea-a4069b3ebd65 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:56:26.926057 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-94b31a2b-ed84-4b11-91ea-a4069b3ebd65 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:56:26.927525 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-94b31a2b-ed84-4b11-91ea-a4069b3ebd65 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] 10.222.0.31 "GET /compute/v2.1/servers/406b5ad6-698e-457f-93f4-cdfd45fb3e8e" status: 200 len: 1811 microversion: 2.20 time: 0.172238 Apr 29 08:56:26.928114 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 311/625] 10.222.0.31 () {60 vars in 1276 bytes} [Fri Apr 29 08:56:26 2022] GET /compute/v2.1/servers/406b5ad6-698e-457f-93f4-cdfd45fb3e8e => generated 1811 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 29 08:56:27.445699 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-e40ed3b9-6947-4410-83e2-4113975bff8d tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] Calling method '>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:56:27.446322 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-e40ed3b9-6947-4410-83e2-4113975bff8d tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] [instance: c3ad1103-185b-4f84-beb9-e1d0e546b2ed] Fetching instance by UUID {{(pid=123459) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:56:27.454190 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-e40ed3b9-6947-4410-83e2-4113975bff8d tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:56:27.454686 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-e40ed3b9-6947-4410-83e2-4113975bff8d tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:56:27.455845 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-e40ed3b9-6947-4410-83e2-4113975bff8d tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:56:27.456318 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-e40ed3b9-6947-4410-83e2-4113975bff8d tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:56:27.600480 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-e40ed3b9-6947-4410-83e2-4113975bff8d tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5571352a755f45efa76b6720eb81c9c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6abb4912c175406ca0cefd03e327b7f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:56:27.607649 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-e40ed3b9-6947-4410-83e2-4113975bff8d tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] 10.222.0.31 "GET /compute/v2.1/servers/c3ad1103-185b-4f84-beb9-e1d0e546b2ed" status: 200 len: 1358 microversion: 2.1 time: 0.166597 Apr 29 08:56:27.608235 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 315/626] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 08:56:27 2022] GET /compute/v2.1/servers/c3ad1103-185b-4f84-beb9-e1d0e546b2ed => generated 1358 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 29 08:56:27.946575 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-81ec3320-395e-484a-af06-be22c7441f5c tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Calling method '>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:56:27.947179 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-81ec3320-395e-484a-af06-be22c7441f5c tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] [instance: 406b5ad6-698e-457f-93f4-cdfd45fb3e8e] Fetching instance by UUID {{(pid=123458) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:56:27.953612 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-81ec3320-395e-484a-af06-be22c7441f5c tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:56:27.954065 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-81ec3320-395e-484a-af06-be22c7441f5c tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:56:27.954833 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-81ec3320-395e-484a-af06-be22c7441f5c tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:56:27.955267 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-81ec3320-395e-484a-af06-be22c7441f5c tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:56:28.088513 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-81ec3320-395e-484a-af06-be22c7441f5c tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:56:28.097644 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-81ec3320-395e-484a-af06-be22c7441f5c tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:56:28.099172 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-81ec3320-395e-484a-af06-be22c7441f5c tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:56:28.100389 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-81ec3320-395e-484a-af06-be22c7441f5c tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] 10.222.0.31 "GET /compute/v2.1/servers/406b5ad6-698e-457f-93f4-cdfd45fb3e8e" status: 200 len: 1811 microversion: 2.20 time: 0.158295 Apr 29 08:56:28.100954 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 312/627] 10.222.0.31 () {60 vars in 1276 bytes} [Fri Apr 29 08:56:27 2022] GET /compute/v2.1/servers/406b5ad6-698e-457f-93f4-cdfd45fb3e8e => generated 1811 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 29 08:56:28.624965 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-7d2d3f3f-2ea9-40e0-aa6f-e7bccee8cf97 tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] Calling method '>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:56:28.625598 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-7d2d3f3f-2ea9-40e0-aa6f-e7bccee8cf97 tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] [instance: c3ad1103-185b-4f84-beb9-e1d0e546b2ed] Fetching instance by UUID {{(pid=123459) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:56:28.632309 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-7d2d3f3f-2ea9-40e0-aa6f-e7bccee8cf97 tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:56:28.632777 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-7d2d3f3f-2ea9-40e0-aa6f-e7bccee8cf97 tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:56:28.633580 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-7d2d3f3f-2ea9-40e0-aa6f-e7bccee8cf97 tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:56:28.634092 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-7d2d3f3f-2ea9-40e0-aa6f-e7bccee8cf97 tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:56:28.788658 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-7d2d3f3f-2ea9-40e0-aa6f-e7bccee8cf97 tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5571352a755f45efa76b6720eb81c9c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6abb4912c175406ca0cefd03e327b7f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:56:28.796175 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-7d2d3f3f-2ea9-40e0-aa6f-e7bccee8cf97 tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] 10.222.0.31 "GET /compute/v2.1/servers/c3ad1103-185b-4f84-beb9-e1d0e546b2ed" status: 200 len: 1358 microversion: 2.1 time: 0.174934 Apr 29 08:56:28.796742 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 316/628] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 08:56:28 2022] GET /compute/v2.1/servers/c3ad1103-185b-4f84-beb9-e1d0e546b2ed => generated 1358 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 08:56:29.120152 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-7ab1aaa1-b0de-4bba-a84d-d2e90a5c4dc5 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Calling method '>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:56:29.121001 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-7ab1aaa1-b0de-4bba-a84d-d2e90a5c4dc5 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] [instance: 406b5ad6-698e-457f-93f4-cdfd45fb3e8e] Fetching instance by UUID {{(pid=123458) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:56:29.127499 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-7ab1aaa1-b0de-4bba-a84d-d2e90a5c4dc5 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:56:29.127951 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-7ab1aaa1-b0de-4bba-a84d-d2e90a5c4dc5 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:56:29.128783 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-7ab1aaa1-b0de-4bba-a84d-d2e90a5c4dc5 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:56:29.129219 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-7ab1aaa1-b0de-4bba-a84d-d2e90a5c4dc5 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:56:29.265255 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-7ab1aaa1-b0de-4bba-a84d-d2e90a5c4dc5 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:56:29.274208 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-7ab1aaa1-b0de-4bba-a84d-d2e90a5c4dc5 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:56:29.275705 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-7ab1aaa1-b0de-4bba-a84d-d2e90a5c4dc5 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:56:29.276891 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-7ab1aaa1-b0de-4bba-a84d-d2e90a5c4dc5 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] 10.222.0.31 "GET /compute/v2.1/servers/406b5ad6-698e-457f-93f4-cdfd45fb3e8e" status: 200 len: 1811 microversion: 2.20 time: 0.161834 Apr 29 08:56:29.277450 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 313/629] 10.222.0.31 () {60 vars in 1276 bytes} [Fri Apr 29 08:56:29 2022] GET /compute/v2.1/servers/406b5ad6-698e-457f-93f4-cdfd45fb3e8e => generated 1811 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 29 08:56:29.812883 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-49fe31af-6ce8-4f79-b724-69439521c4d4 tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] Calling method '>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:56:29.813522 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-49fe31af-6ce8-4f79-b724-69439521c4d4 tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] [instance: c3ad1103-185b-4f84-beb9-e1d0e546b2ed] Fetching instance by UUID {{(pid=123459) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:56:29.821168 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-49fe31af-6ce8-4f79-b724-69439521c4d4 tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:56:29.821618 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-49fe31af-6ce8-4f79-b724-69439521c4d4 tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:56:29.822395 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-49fe31af-6ce8-4f79-b724-69439521c4d4 tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:56:29.822841 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-49fe31af-6ce8-4f79-b724-69439521c4d4 tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:56:29.959951 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-49fe31af-6ce8-4f79-b724-69439521c4d4 tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5571352a755f45efa76b6720eb81c9c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6abb4912c175406ca0cefd03e327b7f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:56:29.967324 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-49fe31af-6ce8-4f79-b724-69439521c4d4 tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] 10.222.0.31 "GET /compute/v2.1/servers/c3ad1103-185b-4f84-beb9-e1d0e546b2ed" status: 200 len: 1358 microversion: 2.1 time: 0.158209 Apr 29 08:56:29.967854 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 317/630] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 08:56:29 2022] GET /compute/v2.1/servers/c3ad1103-185b-4f84-beb9-e1d0e546b2ed => generated 1358 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 08:56:30.295068 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-d7fe83f0-a809-485d-8c3f-5aed1446e3a5 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Calling method '>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:56:30.295620 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-d7fe83f0-a809-485d-8c3f-5aed1446e3a5 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] [instance: 406b5ad6-698e-457f-93f4-cdfd45fb3e8e] Fetching instance by UUID {{(pid=123458) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:56:30.302782 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-d7fe83f0-a809-485d-8c3f-5aed1446e3a5 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:56:30.303225 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-d7fe83f0-a809-485d-8c3f-5aed1446e3a5 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:56:30.304005 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-d7fe83f0-a809-485d-8c3f-5aed1446e3a5 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:56:30.304476 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-d7fe83f0-a809-485d-8c3f-5aed1446e3a5 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:56:30.450244 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-d7fe83f0-a809-485d-8c3f-5aed1446e3a5 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:56:30.458970 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-d7fe83f0-a809-485d-8c3f-5aed1446e3a5 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:56:30.460482 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-d7fe83f0-a809-485d-8c3f-5aed1446e3a5 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:56:30.461804 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-d7fe83f0-a809-485d-8c3f-5aed1446e3a5 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] 10.222.0.31 "GET /compute/v2.1/servers/406b5ad6-698e-457f-93f4-cdfd45fb3e8e" status: 200 len: 1811 microversion: 2.20 time: 0.170744 Apr 29 08:56:30.462392 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 314/631] 10.222.0.31 () {60 vars in 1276 bytes} [Fri Apr 29 08:56:30 2022] GET /compute/v2.1/servers/406b5ad6-698e-457f-93f4-cdfd45fb3e8e => generated 1811 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 29 08:56:30.986621 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-f66766e4-04ca-43c5-b7b5-4c465dc481f2 tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] Calling method '>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:56:30.987243 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-f66766e4-04ca-43c5-b7b5-4c465dc481f2 tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] [instance: c3ad1103-185b-4f84-beb9-e1d0e546b2ed] Fetching instance by UUID {{(pid=123459) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:56:30.995050 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-f66766e4-04ca-43c5-b7b5-4c465dc481f2 tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:56:30.995753 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-f66766e4-04ca-43c5-b7b5-4c465dc481f2 tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:56:30.997076 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-f66766e4-04ca-43c5-b7b5-4c465dc481f2 tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:56:30.997547 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-f66766e4-04ca-43c5-b7b5-4c465dc481f2 tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:56:31.163895 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-f66766e4-04ca-43c5-b7b5-4c465dc481f2 tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5571352a755f45efa76b6720eb81c9c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6abb4912c175406ca0cefd03e327b7f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:56:31.171138 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-f66766e4-04ca-43c5-b7b5-4c465dc481f2 tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] 10.222.0.31 "GET /compute/v2.1/servers/c3ad1103-185b-4f84-beb9-e1d0e546b2ed" status: 200 len: 1358 microversion: 2.1 time: 0.189540 Apr 29 08:56:31.171743 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 318/632] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 08:56:30 2022] GET /compute/v2.1/servers/c3ad1103-185b-4f84-beb9-e1d0e546b2ed => generated 1358 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 08:56:31.480364 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-bf1f329b-5c3b-46d3-a2b5-69f4ef976109 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Calling method '>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:56:31.481008 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-bf1f329b-5c3b-46d3-a2b5-69f4ef976109 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] [instance: 406b5ad6-698e-457f-93f4-cdfd45fb3e8e] Fetching instance by UUID {{(pid=123458) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:56:31.488197 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-bf1f329b-5c3b-46d3-a2b5-69f4ef976109 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:56:31.488681 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-bf1f329b-5c3b-46d3-a2b5-69f4ef976109 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:56:31.490176 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-bf1f329b-5c3b-46d3-a2b5-69f4ef976109 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:56:31.490886 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-bf1f329b-5c3b-46d3-a2b5-69f4ef976109 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:56:31.628374 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-bf1f329b-5c3b-46d3-a2b5-69f4ef976109 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:56:31.637494 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-bf1f329b-5c3b-46d3-a2b5-69f4ef976109 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:56:31.638993 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-bf1f329b-5c3b-46d3-a2b5-69f4ef976109 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:56:31.640178 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-bf1f329b-5c3b-46d3-a2b5-69f4ef976109 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] 10.222.0.31 "GET /compute/v2.1/servers/406b5ad6-698e-457f-93f4-cdfd45fb3e8e" status: 200 len: 1811 microversion: 2.20 time: 0.164127 Apr 29 08:56:31.640778 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 315/633] 10.222.0.31 () {60 vars in 1276 bytes} [Fri Apr 29 08:56:31 2022] GET /compute/v2.1/servers/406b5ad6-698e-457f-93f4-cdfd45fb3e8e => generated 1811 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 29 08:56:32.188649 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-6f3cf5d8-6905-426e-be3d-2e5df4a2bbc8 tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] Calling method '>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:56:32.189237 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-6f3cf5d8-6905-426e-be3d-2e5df4a2bbc8 tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] [instance: c3ad1103-185b-4f84-beb9-e1d0e546b2ed] Fetching instance by UUID {{(pid=123459) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:56:32.196544 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-6f3cf5d8-6905-426e-be3d-2e5df4a2bbc8 tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:56:32.196996 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-6f3cf5d8-6905-426e-be3d-2e5df4a2bbc8 tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:56:32.197776 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-6f3cf5d8-6905-426e-be3d-2e5df4a2bbc8 tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:56:32.198213 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-6f3cf5d8-6905-426e-be3d-2e5df4a2bbc8 tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:56:32.335064 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-6f3cf5d8-6905-426e-be3d-2e5df4a2bbc8 tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5571352a755f45efa76b6720eb81c9c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6abb4912c175406ca0cefd03e327b7f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:56:32.342827 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-6f3cf5d8-6905-426e-be3d-2e5df4a2bbc8 tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] 10.222.0.31 "GET /compute/v2.1/servers/c3ad1103-185b-4f84-beb9-e1d0e546b2ed" status: 200 len: 1358 microversion: 2.1 time: 0.157985 Apr 29 08:56:32.343409 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 319/634] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 08:56:32 2022] GET /compute/v2.1/servers/c3ad1103-185b-4f84-beb9-e1d0e546b2ed => generated 1358 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 08:56:32.660889 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-258597d0-5de7-4b2b-bbba-cf53ccb344c0 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Calling method '>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:56:32.661444 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-258597d0-5de7-4b2b-bbba-cf53ccb344c0 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] [instance: 406b5ad6-698e-457f-93f4-cdfd45fb3e8e] Fetching instance by UUID {{(pid=123458) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:56:32.668516 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-258597d0-5de7-4b2b-bbba-cf53ccb344c0 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:56:32.668999 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-258597d0-5de7-4b2b-bbba-cf53ccb344c0 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:56:32.669883 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-258597d0-5de7-4b2b-bbba-cf53ccb344c0 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:56:32.670352 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-258597d0-5de7-4b2b-bbba-cf53ccb344c0 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:56:32.815722 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-258597d0-5de7-4b2b-bbba-cf53ccb344c0 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:56:32.825228 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-258597d0-5de7-4b2b-bbba-cf53ccb344c0 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:56:32.826726 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-258597d0-5de7-4b2b-bbba-cf53ccb344c0 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:56:32.827882 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-258597d0-5de7-4b2b-bbba-cf53ccb344c0 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] 10.222.0.31 "GET /compute/v2.1/servers/406b5ad6-698e-457f-93f4-cdfd45fb3e8e" status: 200 len: 1811 microversion: 2.20 time: 0.171107 Apr 29 08:56:32.828473 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 316/635] 10.222.0.31 () {60 vars in 1276 bytes} [Fri Apr 29 08:56:32 2022] GET /compute/v2.1/servers/406b5ad6-698e-457f-93f4-cdfd45fb3e8e => generated 1811 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 29 08:56:33.358816 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-4331713e-4bd1-4adc-bf12-c746f39c4996 tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] Calling method '>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:56:33.359423 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-4331713e-4bd1-4adc-bf12-c746f39c4996 tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] [instance: c3ad1103-185b-4f84-beb9-e1d0e546b2ed] Fetching instance by UUID {{(pid=123459) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:56:33.366312 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-4331713e-4bd1-4adc-bf12-c746f39c4996 tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:56:33.366758 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-4331713e-4bd1-4adc-bf12-c746f39c4996 tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:56:33.367535 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-4331713e-4bd1-4adc-bf12-c746f39c4996 tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:56:33.367969 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-4331713e-4bd1-4adc-bf12-c746f39c4996 tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:56:33.514713 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-4331713e-4bd1-4adc-bf12-c746f39c4996 tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5571352a755f45efa76b6720eb81c9c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6abb4912c175406ca0cefd03e327b7f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:56:33.522975 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-4331713e-4bd1-4adc-bf12-c746f39c4996 tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] 10.222.0.31 "GET /compute/v2.1/servers/c3ad1103-185b-4f84-beb9-e1d0e546b2ed" status: 200 len: 1358 microversion: 2.1 time: 0.167907 Apr 29 08:56:33.523563 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 320/636] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 08:56:33 2022] GET /compute/v2.1/servers/c3ad1103-185b-4f84-beb9-e1d0e546b2ed => generated 1358 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 08:56:33.845675 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-07f58908-a287-417e-ae61-a2660a08959f tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Calling method '>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:56:33.846287 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-07f58908-a287-417e-ae61-a2660a08959f tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] [instance: 406b5ad6-698e-457f-93f4-cdfd45fb3e8e] Fetching instance by UUID {{(pid=123458) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:56:33.852492 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-07f58908-a287-417e-ae61-a2660a08959f tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:56:33.852946 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-07f58908-a287-417e-ae61-a2660a08959f tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:56:33.853732 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-07f58908-a287-417e-ae61-a2660a08959f tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:56:33.854172 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-07f58908-a287-417e-ae61-a2660a08959f tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:56:33.995843 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-07f58908-a287-417e-ae61-a2660a08959f tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:56:34.005126 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-07f58908-a287-417e-ae61-a2660a08959f tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:56:34.006905 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-07f58908-a287-417e-ae61-a2660a08959f tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:56:34.008069 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-07f58908-a287-417e-ae61-a2660a08959f tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] 10.222.0.31 "GET /compute/v2.1/servers/406b5ad6-698e-457f-93f4-cdfd45fb3e8e" status: 200 len: 1811 microversion: 2.20 time: 0.166504 Apr 29 08:56:34.008674 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 317/637] 10.222.0.31 () {60 vars in 1276 bytes} [Fri Apr 29 08:56:33 2022] GET /compute/v2.1/servers/406b5ad6-698e-457f-93f4-cdfd45fb3e8e => generated 1811 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 29 08:56:34.539414 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-7f288a06-9a93-48e8-9891-98c56b54e1dc tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] Calling method '>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:56:34.540147 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-7f288a06-9a93-48e8-9891-98c56b54e1dc tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] [instance: c3ad1103-185b-4f84-beb9-e1d0e546b2ed] Fetching instance by UUID {{(pid=123459) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:56:34.546483 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-7f288a06-9a93-48e8-9891-98c56b54e1dc tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:56:34.546930 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-7f288a06-9a93-48e8-9891-98c56b54e1dc tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:56:34.547711 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-7f288a06-9a93-48e8-9891-98c56b54e1dc tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:56:34.548170 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-7f288a06-9a93-48e8-9891-98c56b54e1dc tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:56:34.923586 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-7f288a06-9a93-48e8-9891-98c56b54e1dc tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5571352a755f45efa76b6720eb81c9c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6abb4912c175406ca0cefd03e327b7f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:56:34.935662 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-7f288a06-9a93-48e8-9891-98c56b54e1dc tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] 10.222.0.31 "GET /compute/v2.1/servers/c3ad1103-185b-4f84-beb9-e1d0e546b2ed" status: 200 len: 1358 microversion: 2.1 time: 0.400217 Apr 29 08:56:34.936210 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 321/638] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 08:56:34 2022] GET /compute/v2.1/servers/c3ad1103-185b-4f84-beb9-e1d0e546b2ed => generated 1358 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 08:56:35.027424 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-bbce2511-89a7-49dc-823a-d2aee0450a97 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Calling method '>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:56:35.028040 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-bbce2511-89a7-49dc-823a-d2aee0450a97 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] [instance: 406b5ad6-698e-457f-93f4-cdfd45fb3e8e] Fetching instance by UUID {{(pid=123458) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:56:35.034841 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-bbce2511-89a7-49dc-823a-d2aee0450a97 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:56:35.035284 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-bbce2511-89a7-49dc-823a-d2aee0450a97 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:56:35.036888 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-bbce2511-89a7-49dc-823a-d2aee0450a97 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:56:35.037335 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-bbce2511-89a7-49dc-823a-d2aee0450a97 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:56:35.179812 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-bbce2511-89a7-49dc-823a-d2aee0450a97 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:56:35.188810 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-bbce2511-89a7-49dc-823a-d2aee0450a97 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:56:35.190324 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-bbce2511-89a7-49dc-823a-d2aee0450a97 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:56:35.191494 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-bbce2511-89a7-49dc-823a-d2aee0450a97 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] 10.222.0.31 "GET /compute/v2.1/servers/406b5ad6-698e-457f-93f4-cdfd45fb3e8e" status: 200 len: 1811 microversion: 2.20 time: 0.167994 Apr 29 08:56:35.192588 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 318/639] 10.222.0.31 () {60 vars in 1276 bytes} [Fri Apr 29 08:56:35 2022] GET /compute/v2.1/servers/406b5ad6-698e-457f-93f4-cdfd45fb3e8e => generated 1811 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 29 08:56:35.953286 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-ba3456a6-d031-466d-834d-83c0df9aaf04 tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] Calling method '>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:56:35.953906 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-ba3456a6-d031-466d-834d-83c0df9aaf04 tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] [instance: c3ad1103-185b-4f84-beb9-e1d0e546b2ed] Fetching instance by UUID {{(pid=123459) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:56:35.960737 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-ba3456a6-d031-466d-834d-83c0df9aaf04 tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:56:35.961189 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-ba3456a6-d031-466d-834d-83c0df9aaf04 tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:56:35.962039 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-ba3456a6-d031-466d-834d-83c0df9aaf04 tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:56:35.962521 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-ba3456a6-d031-466d-834d-83c0df9aaf04 tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:56:36.094419 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-ba3456a6-d031-466d-834d-83c0df9aaf04 tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5571352a755f45efa76b6720eb81c9c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6abb4912c175406ca0cefd03e327b7f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:56:36.102387 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-ba3456a6-d031-466d-834d-83c0df9aaf04 tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] 10.222.0.31 "GET /compute/v2.1/servers/c3ad1103-185b-4f84-beb9-e1d0e546b2ed" status: 200 len: 1358 microversion: 2.1 time: 0.153064 Apr 29 08:56:36.102950 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 322/640] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 08:56:35 2022] GET /compute/v2.1/servers/c3ad1103-185b-4f84-beb9-e1d0e546b2ed => generated 1358 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 08:56:36.211134 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-17723b8c-d53b-40ab-a8f4-a260e246f51a tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Calling method '>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:56:36.211746 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-17723b8c-d53b-40ab-a8f4-a260e246f51a tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] [instance: 406b5ad6-698e-457f-93f4-cdfd45fb3e8e] Fetching instance by UUID {{(pid=123458) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:56:36.218595 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-17723b8c-d53b-40ab-a8f4-a260e246f51a tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:56:36.219047 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-17723b8c-d53b-40ab-a8f4-a260e246f51a tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:56:36.219817 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-17723b8c-d53b-40ab-a8f4-a260e246f51a tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:56:36.220293 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-17723b8c-d53b-40ab-a8f4-a260e246f51a tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:56:36.499112 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-17723b8c-d53b-40ab-a8f4-a260e246f51a tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:56:36.509254 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-17723b8c-d53b-40ab-a8f4-a260e246f51a tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:56:36.510865 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-17723b8c-d53b-40ab-a8f4-a260e246f51a tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:56:36.512041 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-17723b8c-d53b-40ab-a8f4-a260e246f51a tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] 10.222.0.31 "GET /compute/v2.1/servers/406b5ad6-698e-457f-93f4-cdfd45fb3e8e" status: 200 len: 1811 microversion: 2.20 time: 0.305634 Apr 29 08:56:36.513289 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 319/641] 10.222.0.31 () {60 vars in 1276 bytes} [Fri Apr 29 08:56:36 2022] GET /compute/v2.1/servers/406b5ad6-698e-457f-93f4-cdfd45fb3e8e => generated 1811 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 29 08:56:37.120858 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-0324cbe5-44fd-4995-98d9-e0592454bbc5 tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] Calling method '>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:56:37.121822 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-0324cbe5-44fd-4995-98d9-e0592454bbc5 tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] [instance: c3ad1103-185b-4f84-beb9-e1d0e546b2ed] Fetching instance by UUID {{(pid=123458) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:56:37.135470 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-0324cbe5-44fd-4995-98d9-e0592454bbc5 tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:56:37.137210 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-0324cbe5-44fd-4995-98d9-e0592454bbc5 tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:56:37.140442 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-0324cbe5-44fd-4995-98d9-e0592454bbc5 tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:56:37.142704 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-0324cbe5-44fd-4995-98d9-e0592454bbc5 tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:56:37.170320 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [req-8147e6ef-1c01-4bba-8156-65cd9ae3f129 req-662cb2ca-dfac-407e-b4ad-6354e2ea52df service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c3ad1103-185b-4f84-beb9-e1d0e546b2ed", "tag": "69230ee3-728d-4825-9b39-4cb903b621cf"}]} {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 29 08:56:37.218752 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [req-8147e6ef-1c01-4bba-8156-65cd9ae3f129 req-662cb2ca-dfac-407e-b4ad-6354e2ea52df service nova] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:56:37.220768 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [req-8147e6ef-1c01-4bba-8156-65cd9ae3f129 req-662cb2ca-dfac-407e-b4ad-6354e2ea52df service nova] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:56:37.263957 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.compute.server_external_events [req-8147e6ef-1c01-4bba-8156-65cd9ae3f129 req-662cb2ca-dfac-407e-b4ad-6354e2ea52df service nova] Creating event network-changed:69230ee3-728d-4825-9b39-4cb903b621cf for instance c3ad1103-185b-4f84-beb9-e1d0e546b2ed on hv-cinder-83987 Apr 29 08:56:37.279298 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [req-8147e6ef-1c01-4bba-8156-65cd9ae3f129 req-662cb2ca-dfac-407e-b4ad-6354e2ea52df service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.218956 Apr 29 08:56:37.290560 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 323/642] 10.222.0.31 () {64 vars in 1317 bytes} [Fri Apr 29 08:56:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 29 08:56:37.469404 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-0324cbe5-44fd-4995-98d9-e0592454bbc5 tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5571352a755f45efa76b6720eb81c9c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6abb4912c175406ca0cefd03e327b7f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:56:37.479388 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-0324cbe5-44fd-4995-98d9-e0592454bbc5 tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] 10.222.0.31 "GET /compute/v2.1/servers/c3ad1103-185b-4f84-beb9-e1d0e546b2ed" status: 200 len: 1358 microversion: 2.1 time: 0.362503 Apr 29 08:56:37.492695 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 320/643] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 08:56:37 2022] GET /compute/v2.1/servers/c3ad1103-185b-4f84-beb9-e1d0e546b2ed => generated 1358 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 08:56:37.533040 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-ec3d1b7e-f030-4851-ac95-4bb632a014b8 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Calling method '>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:56:37.533745 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-ec3d1b7e-f030-4851-ac95-4bb632a014b8 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] [instance: 406b5ad6-698e-457f-93f4-cdfd45fb3e8e] Fetching instance by UUID {{(pid=123459) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:56:37.545618 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-ec3d1b7e-f030-4851-ac95-4bb632a014b8 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:56:37.546071 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-ec3d1b7e-f030-4851-ac95-4bb632a014b8 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:56:37.546870 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-ec3d1b7e-f030-4851-ac95-4bb632a014b8 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:56:37.547304 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-ec3d1b7e-f030-4851-ac95-4bb632a014b8 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:56:37.723390 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-ec3d1b7e-f030-4851-ac95-4bb632a014b8 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:56:37.733250 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-ec3d1b7e-f030-4851-ac95-4bb632a014b8 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:56:37.738519 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-ec3d1b7e-f030-4851-ac95-4bb632a014b8 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:56:37.750111 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-ec3d1b7e-f030-4851-ac95-4bb632a014b8 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] 10.222.0.31 "GET /compute/v2.1/servers/406b5ad6-698e-457f-93f4-cdfd45fb3e8e" status: 200 len: 1811 microversion: 2.20 time: 0.222066 Apr 29 08:56:37.751406 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 324/644] 10.222.0.31 () {60 vars in 1276 bytes} [Fri Apr 29 08:56:37 2022] GET /compute/v2.1/servers/406b5ad6-698e-457f-93f4-cdfd45fb3e8e => generated 1811 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 29 08:56:38.510606 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-fb4ab76f-0a03-447d-9a28-b7d55181efe1 tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] Calling method '>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:56:38.512298 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-fb4ab76f-0a03-447d-9a28-b7d55181efe1 tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] [instance: c3ad1103-185b-4f84-beb9-e1d0e546b2ed] Fetching instance by UUID {{(pid=123458) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:56:38.519511 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-fb4ab76f-0a03-447d-9a28-b7d55181efe1 tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:56:38.519955 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-fb4ab76f-0a03-447d-9a28-b7d55181efe1 tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:56:38.520819 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-fb4ab76f-0a03-447d-9a28-b7d55181efe1 tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:56:38.521251 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-fb4ab76f-0a03-447d-9a28-b7d55181efe1 tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:56:38.770635 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-eeeefbe8-18d1-4e9a-85f6-422b1a206012 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Calling method '>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:56:38.773489 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-eeeefbe8-18d1-4e9a-85f6-422b1a206012 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] [instance: 406b5ad6-698e-457f-93f4-cdfd45fb3e8e] Fetching instance by UUID {{(pid=123459) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:56:38.780596 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-eeeefbe8-18d1-4e9a-85f6-422b1a206012 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:56:38.780813 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-eeeefbe8-18d1-4e9a-85f6-422b1a206012 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:56:38.781507 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-eeeefbe8-18d1-4e9a-85f6-422b1a206012 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:56:38.781948 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-eeeefbe8-18d1-4e9a-85f6-422b1a206012 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:56:38.951096 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-fb4ab76f-0a03-447d-9a28-b7d55181efe1 tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5571352a755f45efa76b6720eb81c9c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6abb4912c175406ca0cefd03e327b7f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:56:38.960350 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-fb4ab76f-0a03-447d-9a28-b7d55181efe1 tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] 10.222.0.31 "GET /compute/v2.1/servers/c3ad1103-185b-4f84-beb9-e1d0e546b2ed" status: 200 len: 1358 microversion: 2.1 time: 0.454280 Apr 29 08:56:38.961252 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 321/645] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 08:56:38 2022] GET /compute/v2.1/servers/c3ad1103-185b-4f84-beb9-e1d0e546b2ed => generated 1358 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 29 08:56:38.987151 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-eeeefbe8-18d1-4e9a-85f6-422b1a206012 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:56:38.996171 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-eeeefbe8-18d1-4e9a-85f6-422b1a206012 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:56:38.997675 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-eeeefbe8-18d1-4e9a-85f6-422b1a206012 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:56:38.998838 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-eeeefbe8-18d1-4e9a-85f6-422b1a206012 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] 10.222.0.31 "GET /compute/v2.1/servers/406b5ad6-698e-457f-93f4-cdfd45fb3e8e" status: 200 len: 1811 microversion: 2.20 time: 0.233477 Apr 29 08:56:38.999393 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 325/646] 10.222.0.31 () {60 vars in 1276 bytes} [Fri Apr 29 08:56:38 2022] GET /compute/v2.1/servers/406b5ad6-698e-457f-93f4-cdfd45fb3e8e => generated 1811 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 29 08:56:39.979883 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-c5334555-312d-40a7-9cd7-3c09d7b0c791 tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] Calling method '>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:56:39.980536 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-c5334555-312d-40a7-9cd7-3c09d7b0c791 tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] [instance: c3ad1103-185b-4f84-beb9-e1d0e546b2ed] Fetching instance by UUID {{(pid=123458) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:56:39.987369 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-c5334555-312d-40a7-9cd7-3c09d7b0c791 tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:56:39.987817 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-c5334555-312d-40a7-9cd7-3c09d7b0c791 tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:56:39.988633 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-c5334555-312d-40a7-9cd7-3c09d7b0c791 tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:56:39.989456 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-c5334555-312d-40a7-9cd7-3c09d7b0c791 tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:56:40.018659 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-7ed34207-4edd-4f30-a81a-88ad9d209f61 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Calling method '>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:56:40.019266 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-7ed34207-4edd-4f30-a81a-88ad9d209f61 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] [instance: 406b5ad6-698e-457f-93f4-cdfd45fb3e8e] Fetching instance by UUID {{(pid=123459) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:56:40.026470 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-7ed34207-4edd-4f30-a81a-88ad9d209f61 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:56:40.026922 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-7ed34207-4edd-4f30-a81a-88ad9d209f61 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:56:40.027717 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-7ed34207-4edd-4f30-a81a-88ad9d209f61 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:56:40.028169 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-7ed34207-4edd-4f30-a81a-88ad9d209f61 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:56:40.137186 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-c5334555-312d-40a7-9cd7-3c09d7b0c791 tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5571352a755f45efa76b6720eb81c9c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6abb4912c175406ca0cefd03e327b7f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:56:40.151742 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-c5334555-312d-40a7-9cd7-3c09d7b0c791 tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] 10.222.0.31 "GET /compute/v2.1/servers/c3ad1103-185b-4f84-beb9-e1d0e546b2ed" status: 200 len: 1358 microversion: 2.1 time: 0.176410 Apr 29 08:56:40.163455 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 322/647] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 08:56:39 2022] GET /compute/v2.1/servers/c3ad1103-185b-4f84-beb9-e1d0e546b2ed => generated 1358 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 29 08:56:40.205498 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-7ed34207-4edd-4f30-a81a-88ad9d209f61 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:56:40.215492 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-7ed34207-4edd-4f30-a81a-88ad9d209f61 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:56:40.217219 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-7ed34207-4edd-4f30-a81a-88ad9d209f61 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:56:40.218518 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-7ed34207-4edd-4f30-a81a-88ad9d209f61 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] 10.222.0.31 "GET /compute/v2.1/servers/406b5ad6-698e-457f-93f4-cdfd45fb3e8e" status: 200 len: 1811 microversion: 2.20 time: 0.204197 Apr 29 08:56:40.219290 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 326/648] 10.222.0.31 () {60 vars in 1276 bytes} [Fri Apr 29 08:56:40 2022] GET /compute/v2.1/servers/406b5ad6-698e-457f-93f4-cdfd45fb3e8e => generated 1811 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 29 08:56:41.175866 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-515dc350-f93c-4904-b536-b1ad9bae1ff4 tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] Calling method '>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:56:41.177221 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-515dc350-f93c-4904-b536-b1ad9bae1ff4 tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] [instance: c3ad1103-185b-4f84-beb9-e1d0e546b2ed] Fetching instance by UUID {{(pid=123458) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:56:41.183822 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-515dc350-f93c-4904-b536-b1ad9bae1ff4 tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:56:41.184305 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-515dc350-f93c-4904-b536-b1ad9bae1ff4 tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:56:41.185104 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-515dc350-f93c-4904-b536-b1ad9bae1ff4 tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:56:41.185536 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-515dc350-f93c-4904-b536-b1ad9bae1ff4 tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:56:41.238432 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-b7ccf099-222a-48e4-ac12-39a9eb752f9f tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Calling method '>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:56:41.240120 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-b7ccf099-222a-48e4-ac12-39a9eb752f9f tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] [instance: 406b5ad6-698e-457f-93f4-cdfd45fb3e8e] Fetching instance by UUID {{(pid=123459) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:56:41.246670 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-b7ccf099-222a-48e4-ac12-39a9eb752f9f tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:56:41.247117 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-b7ccf099-222a-48e4-ac12-39a9eb752f9f tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:56:41.248100 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-b7ccf099-222a-48e4-ac12-39a9eb752f9f tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:56:41.248563 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-b7ccf099-222a-48e4-ac12-39a9eb752f9f tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:56:41.327740 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-515dc350-f93c-4904-b536-b1ad9bae1ff4 tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5571352a755f45efa76b6720eb81c9c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6abb4912c175406ca0cefd03e327b7f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:56:41.337018 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-515dc350-f93c-4904-b536-b1ad9bae1ff4 tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] 10.222.0.31 "GET /compute/v2.1/servers/c3ad1103-185b-4f84-beb9-e1d0e546b2ed" status: 200 len: 1358 microversion: 2.1 time: 0.164711 Apr 29 08:56:41.337543 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 323/649] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 08:56:41 2022] GET /compute/v2.1/servers/c3ad1103-185b-4f84-beb9-e1d0e546b2ed => generated 1358 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 08:56:41.443416 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-b7ccf099-222a-48e4-ac12-39a9eb752f9f tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:56:41.452849 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-b7ccf099-222a-48e4-ac12-39a9eb752f9f tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:56:41.454348 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-b7ccf099-222a-48e4-ac12-39a9eb752f9f tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:56:41.455543 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-b7ccf099-222a-48e4-ac12-39a9eb752f9f tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] 10.222.0.31 "GET /compute/v2.1/servers/406b5ad6-698e-457f-93f4-cdfd45fb3e8e" status: 200 len: 1811 microversion: 2.20 time: 0.221125 Apr 29 08:56:41.456097 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 327/650] 10.222.0.31 () {60 vars in 1276 bytes} [Fri Apr 29 08:56:41 2022] GET /compute/v2.1/servers/406b5ad6-698e-457f-93f4-cdfd45fb3e8e => generated 1811 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 29 08:56:42.353720 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-f7a4a451-f098-4cab-beaf-28b0f66bbfc5 tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] Calling method '>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:56:42.354339 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-f7a4a451-f098-4cab-beaf-28b0f66bbfc5 tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] [instance: c3ad1103-185b-4f84-beb9-e1d0e546b2ed] Fetching instance by UUID {{(pid=123458) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:56:42.360721 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-f7a4a451-f098-4cab-beaf-28b0f66bbfc5 tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:56:42.361179 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-f7a4a451-f098-4cab-beaf-28b0f66bbfc5 tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:56:42.362231 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-f7a4a451-f098-4cab-beaf-28b0f66bbfc5 tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:56:42.362429 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-f7a4a451-f098-4cab-beaf-28b0f66bbfc5 tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:56:42.474888 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-b4766040-eeab-4a15-acf7-f8e2ca9fe762 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Calling method '>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:56:42.476235 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-b4766040-eeab-4a15-acf7-f8e2ca9fe762 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] [instance: 406b5ad6-698e-457f-93f4-cdfd45fb3e8e] Fetching instance by UUID {{(pid=123459) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:56:42.485975 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-b4766040-eeab-4a15-acf7-f8e2ca9fe762 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:56:42.486559 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-b4766040-eeab-4a15-acf7-f8e2ca9fe762 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:56:42.487524 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-b4766040-eeab-4a15-acf7-f8e2ca9fe762 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:56:42.488055 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-b4766040-eeab-4a15-acf7-f8e2ca9fe762 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:56:42.505390 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-f7a4a451-f098-4cab-beaf-28b0f66bbfc5 tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5571352a755f45efa76b6720eb81c9c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6abb4912c175406ca0cefd03e327b7f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:56:42.514856 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-f7a4a451-f098-4cab-beaf-28b0f66bbfc5 tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] 10.222.0.31 "GET /compute/v2.1/servers/c3ad1103-185b-4f84-beb9-e1d0e546b2ed" status: 200 len: 1358 microversion: 2.1 time: 0.164989 Apr 29 08:56:42.515950 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 324/651] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 08:56:42 2022] GET /compute/v2.1/servers/c3ad1103-185b-4f84-beb9-e1d0e546b2ed => generated 1358 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 29 08:56:42.636008 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-b4766040-eeab-4a15-acf7-f8e2ca9fe762 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:56:42.644596 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-b4766040-eeab-4a15-acf7-f8e2ca9fe762 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:56:42.646223 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-b4766040-eeab-4a15-acf7-f8e2ca9fe762 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:56:42.647375 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-b4766040-eeab-4a15-acf7-f8e2ca9fe762 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] 10.222.0.31 "GET /compute/v2.1/servers/406b5ad6-698e-457f-93f4-cdfd45fb3e8e" status: 200 len: 1811 microversion: 2.20 time: 0.176403 Apr 29 08:56:42.647937 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 328/652] 10.222.0.31 () {60 vars in 1276 bytes} [Fri Apr 29 08:56:42 2022] GET /compute/v2.1/servers/406b5ad6-698e-457f-93f4-cdfd45fb3e8e => generated 1811 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 29 08:56:43.532096 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-325b809e-0f6c-4881-a558-1f12ad682d6c tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] Calling method '>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:56:43.532847 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-325b809e-0f6c-4881-a558-1f12ad682d6c tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] [instance: c3ad1103-185b-4f84-beb9-e1d0e546b2ed] Fetching instance by UUID {{(pid=123458) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:56:43.539547 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-325b809e-0f6c-4881-a558-1f12ad682d6c tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:56:43.539993 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-325b809e-0f6c-4881-a558-1f12ad682d6c tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:56:43.540824 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-325b809e-0f6c-4881-a558-1f12ad682d6c tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:56:43.541292 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-325b809e-0f6c-4881-a558-1f12ad682d6c tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:56:43.666836 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-2d67bd9a-60ff-48c3-ab64-3d60058a3edd tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Calling method '>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:56:43.668363 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-2d67bd9a-60ff-48c3-ab64-3d60058a3edd tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] [instance: 406b5ad6-698e-457f-93f4-cdfd45fb3e8e] Fetching instance by UUID {{(pid=123459) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:56:43.675886 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-2d67bd9a-60ff-48c3-ab64-3d60058a3edd tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:56:43.676776 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-2d67bd9a-60ff-48c3-ab64-3d60058a3edd tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:56:43.677599 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-2d67bd9a-60ff-48c3-ab64-3d60058a3edd tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:56:43.678258 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-2d67bd9a-60ff-48c3-ab64-3d60058a3edd tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:56:43.696408 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-325b809e-0f6c-4881-a558-1f12ad682d6c tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5571352a755f45efa76b6720eb81c9c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6abb4912c175406ca0cefd03e327b7f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:56:43.710619 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-325b809e-0f6c-4881-a558-1f12ad682d6c tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] 10.222.0.31 "GET /compute/v2.1/servers/c3ad1103-185b-4f84-beb9-e1d0e546b2ed" status: 200 len: 1358 microversion: 2.1 time: 0.182472 Apr 29 08:56:43.721823 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 325/653] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 08:56:43 2022] GET /compute/v2.1/servers/c3ad1103-185b-4f84-beb9-e1d0e546b2ed => generated 1358 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 08:56:43.836371 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-2d67bd9a-60ff-48c3-ab64-3d60058a3edd tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:56:43.847640 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-2d67bd9a-60ff-48c3-ab64-3d60058a3edd tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:56:43.850140 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-2d67bd9a-60ff-48c3-ab64-3d60058a3edd tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:56:43.851418 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-2d67bd9a-60ff-48c3-ab64-3d60058a3edd tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] 10.222.0.31 "GET /compute/v2.1/servers/406b5ad6-698e-457f-93f4-cdfd45fb3e8e" status: 200 len: 1811 microversion: 2.20 time: 0.189281 Apr 29 08:56:43.852062 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 329/654] 10.222.0.31 () {60 vars in 1276 bytes} [Fri Apr 29 08:56:43 2022] GET /compute/v2.1/servers/406b5ad6-698e-457f-93f4-cdfd45fb3e8e => generated 1811 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 29 08:56:44.731880 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-7b235321-1257-46f6-80f4-a815ec436a23 tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] Calling method '>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:56:44.732964 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-7b235321-1257-46f6-80f4-a815ec436a23 tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] [instance: c3ad1103-185b-4f84-beb9-e1d0e546b2ed] Fetching instance by UUID {{(pid=123458) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:56:44.740384 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-7b235321-1257-46f6-80f4-a815ec436a23 tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:56:44.741084 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-7b235321-1257-46f6-80f4-a815ec436a23 tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:56:44.741882 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-7b235321-1257-46f6-80f4-a815ec436a23 tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:56:44.742313 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-7b235321-1257-46f6-80f4-a815ec436a23 tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:56:44.874481 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-5d354be9-b152-498d-8131-78f06d888d23 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Calling method '>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:56:44.885820 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-5d354be9-b152-498d-8131-78f06d888d23 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] [instance: 406b5ad6-698e-457f-93f4-cdfd45fb3e8e] Fetching instance by UUID {{(pid=123459) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:56:44.916409 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-5d354be9-b152-498d-8131-78f06d888d23 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:56:44.916949 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-5d354be9-b152-498d-8131-78f06d888d23 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:56:44.918018 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-5d354be9-b152-498d-8131-78f06d888d23 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:56:44.918449 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-5d354be9-b152-498d-8131-78f06d888d23 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:56:44.999707 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-7b235321-1257-46f6-80f4-a815ec436a23 tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5571352a755f45efa76b6720eb81c9c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6abb4912c175406ca0cefd03e327b7f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:56:45.019444 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-7b235321-1257-46f6-80f4-a815ec436a23 tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] 10.222.0.31 "GET /compute/v2.1/servers/c3ad1103-185b-4f84-beb9-e1d0e546b2ed" status: 200 len: 1358 microversion: 2.1 time: 0.290370 Apr 29 08:56:45.031715 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 326/655] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 08:56:44 2022] GET /compute/v2.1/servers/c3ad1103-185b-4f84-beb9-e1d0e546b2ed => generated 1358 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 08:56:45.158218 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-5d354be9-b152-498d-8131-78f06d888d23 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:56:45.179740 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-5d354be9-b152-498d-8131-78f06d888d23 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:56:45.181578 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-5d354be9-b152-498d-8131-78f06d888d23 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:56:45.182993 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-5d354be9-b152-498d-8131-78f06d888d23 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] 10.222.0.31 "GET /compute/v2.1/servers/406b5ad6-698e-457f-93f4-cdfd45fb3e8e" status: 200 len: 1811 microversion: 2.20 time: 0.315412 Apr 29 08:56:45.183846 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 330/656] 10.222.0.31 () {60 vars in 1276 bytes} [Fri Apr 29 08:56:44 2022] GET /compute/v2.1/servers/406b5ad6-698e-457f-93f4-cdfd45fb3e8e => generated 1811 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 29 08:56:46.049385 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-a70b2a7e-4c4b-4c84-a94e-ccace066814f tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] Calling method '>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:56:46.050310 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-a70b2a7e-4c4b-4c84-a94e-ccace066814f tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] [instance: c3ad1103-185b-4f84-beb9-e1d0e546b2ed] Fetching instance by UUID {{(pid=123458) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:56:46.057676 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-a70b2a7e-4c4b-4c84-a94e-ccace066814f tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:56:46.058128 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-a70b2a7e-4c4b-4c84-a94e-ccace066814f tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:56:46.058913 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-a70b2a7e-4c4b-4c84-a94e-ccace066814f tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:56:46.059350 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-a70b2a7e-4c4b-4c84-a94e-ccace066814f tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:56:46.201575 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-a70b2a7e-4c4b-4c84-a94e-ccace066814f tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5571352a755f45efa76b6720eb81c9c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6abb4912c175406ca0cefd03e327b7f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:56:46.202966 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-de8ddbf9-c949-4163-aae0-195ce4100505 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Calling method '>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:56:46.203693 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-de8ddbf9-c949-4163-aae0-195ce4100505 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] [instance: 406b5ad6-698e-457f-93f4-cdfd45fb3e8e] Fetching instance by UUID {{(pid=123459) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:56:46.209374 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-a70b2a7e-4c4b-4c84-a94e-ccace066814f tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] 10.222.0.31 "GET /compute/v2.1/servers/c3ad1103-185b-4f84-beb9-e1d0e546b2ed" status: 200 len: 1358 microversion: 2.1 time: 0.163869 Apr 29 08:56:46.210124 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-de8ddbf9-c949-4163-aae0-195ce4100505 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:56:46.210342 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 327/657] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 08:56:46 2022] GET /compute/v2.1/servers/c3ad1103-185b-4f84-beb9-e1d0e546b2ed => generated 1358 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 08:56:46.211086 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-de8ddbf9-c949-4163-aae0-195ce4100505 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:56:46.211878 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-de8ddbf9-c949-4163-aae0-195ce4100505 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:56:46.212352 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-de8ddbf9-c949-4163-aae0-195ce4100505 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:56:46.432013 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-de8ddbf9-c949-4163-aae0-195ce4100505 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:56:46.446015 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-de8ddbf9-c949-4163-aae0-195ce4100505 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:56:46.447504 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-de8ddbf9-c949-4163-aae0-195ce4100505 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:56:46.448713 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-de8ddbf9-c949-4163-aae0-195ce4100505 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] 10.222.0.31 "GET /compute/v2.1/servers/406b5ad6-698e-457f-93f4-cdfd45fb3e8e" status: 200 len: 1811 microversion: 2.20 time: 0.250438 Apr 29 08:56:46.449269 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 331/658] 10.222.0.31 () {60 vars in 1276 bytes} [Fri Apr 29 08:56:46 2022] GET /compute/v2.1/servers/406b5ad6-698e-457f-93f4-cdfd45fb3e8e => generated 1811 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 29 08:56:47.234639 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-dd4d9b98-71dd-4faa-8e13-b459e28c3e3f tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] Calling method '>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:56:47.235285 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-dd4d9b98-71dd-4faa-8e13-b459e28c3e3f tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] [instance: c3ad1103-185b-4f84-beb9-e1d0e546b2ed] Fetching instance by UUID {{(pid=123458) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:56:47.242479 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-dd4d9b98-71dd-4faa-8e13-b459e28c3e3f tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:56:47.242933 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-dd4d9b98-71dd-4faa-8e13-b459e28c3e3f tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:56:47.243712 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-dd4d9b98-71dd-4faa-8e13-b459e28c3e3f tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:56:47.244158 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-dd4d9b98-71dd-4faa-8e13-b459e28c3e3f tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:56:47.384588 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-dd4d9b98-71dd-4faa-8e13-b459e28c3e3f tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5571352a755f45efa76b6720eb81c9c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6abb4912c175406ca0cefd03e327b7f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:56:47.392495 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-dd4d9b98-71dd-4faa-8e13-b459e28c3e3f tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] 10.222.0.31 "GET /compute/v2.1/servers/c3ad1103-185b-4f84-beb9-e1d0e546b2ed" status: 200 len: 1358 microversion: 2.1 time: 0.161514 Apr 29 08:56:47.393095 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 328/659] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 08:56:47 2022] GET /compute/v2.1/servers/c3ad1103-185b-4f84-beb9-e1d0e546b2ed => generated 1358 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 08:56:47.466952 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-44da2ce9-38ce-4a88-be46-feacca8b9b61 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Calling method '>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:56:47.467587 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-44da2ce9-38ce-4a88-be46-feacca8b9b61 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] [instance: 406b5ad6-698e-457f-93f4-cdfd45fb3e8e] Fetching instance by UUID {{(pid=123459) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:56:47.474727 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-44da2ce9-38ce-4a88-be46-feacca8b9b61 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:56:47.475193 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-44da2ce9-38ce-4a88-be46-feacca8b9b61 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:56:47.475994 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-44da2ce9-38ce-4a88-be46-feacca8b9b61 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:56:47.476461 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-44da2ce9-38ce-4a88-be46-feacca8b9b61 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:56:47.691328 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-44da2ce9-38ce-4a88-be46-feacca8b9b61 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:56:47.701552 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-44da2ce9-38ce-4a88-be46-feacca8b9b61 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:56:47.703627 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-44da2ce9-38ce-4a88-be46-feacca8b9b61 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:56:47.705063 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-44da2ce9-38ce-4a88-be46-feacca8b9b61 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] 10.222.0.31 "GET /compute/v2.1/servers/406b5ad6-698e-457f-93f4-cdfd45fb3e8e" status: 200 len: 1811 microversion: 2.20 time: 0.242062 Apr 29 08:56:47.706153 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 332/660] 10.222.0.31 () {60 vars in 1276 bytes} [Fri Apr 29 08:56:47 2022] GET /compute/v2.1/servers/406b5ad6-698e-457f-93f4-cdfd45fb3e8e => generated 1811 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 29 08:56:48.409222 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-9c6ed5fc-bd89-4574-a664-f2da384c3a9e tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] Calling method '>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:56:48.409997 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-9c6ed5fc-bd89-4574-a664-f2da384c3a9e tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] [instance: c3ad1103-185b-4f84-beb9-e1d0e546b2ed] Fetching instance by UUID {{(pid=123458) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:56:48.417750 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-9c6ed5fc-bd89-4574-a664-f2da384c3a9e tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:56:48.418347 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-9c6ed5fc-bd89-4574-a664-f2da384c3a9e tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:56:48.419237 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-9c6ed5fc-bd89-4574-a664-f2da384c3a9e tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:56:48.419901 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-9c6ed5fc-bd89-4574-a664-f2da384c3a9e tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:56:48.656107 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-9c6ed5fc-bd89-4574-a664-f2da384c3a9e tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5571352a755f45efa76b6720eb81c9c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6abb4912c175406ca0cefd03e327b7f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:56:48.667228 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-9c6ed5fc-bd89-4574-a664-f2da384c3a9e tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] 10.222.0.31 "GET /compute/v2.1/servers/c3ad1103-185b-4f84-beb9-e1d0e546b2ed" status: 200 len: 1358 microversion: 2.1 time: 0.261657 Apr 29 08:56:48.677290 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 329/661] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 08:56:48 2022] GET /compute/v2.1/servers/c3ad1103-185b-4f84-beb9-e1d0e546b2ed => generated 1358 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 08:56:48.724922 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-ff1f6056-552b-46cc-ba5c-2f2f8e123a6d tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Calling method '>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:56:48.725654 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-ff1f6056-552b-46cc-ba5c-2f2f8e123a6d tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] [instance: 406b5ad6-698e-457f-93f4-cdfd45fb3e8e] Fetching instance by UUID {{(pid=123459) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:56:48.732934 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-ff1f6056-552b-46cc-ba5c-2f2f8e123a6d tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:56:48.733609 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-ff1f6056-552b-46cc-ba5c-2f2f8e123a6d tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:56:48.734433 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-ff1f6056-552b-46cc-ba5c-2f2f8e123a6d tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:56:48.735027 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-ff1f6056-552b-46cc-ba5c-2f2f8e123a6d tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:56:48.882566 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-ff1f6056-552b-46cc-ba5c-2f2f8e123a6d tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:56:48.893206 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-ff1f6056-552b-46cc-ba5c-2f2f8e123a6d tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:56:48.895365 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-ff1f6056-552b-46cc-ba5c-2f2f8e123a6d tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:56:48.897283 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-ff1f6056-552b-46cc-ba5c-2f2f8e123a6d tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] 10.222.0.31 "GET /compute/v2.1/servers/406b5ad6-698e-457f-93f4-cdfd45fb3e8e" status: 200 len: 1811 microversion: 2.20 time: 0.177283 Apr 29 08:56:48.897967 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 333/662] 10.222.0.31 () {60 vars in 1276 bytes} [Fri Apr 29 08:56:48 2022] GET /compute/v2.1/servers/406b5ad6-698e-457f-93f4-cdfd45fb3e8e => generated 1811 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 29 08:56:49.683849 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-840816bf-6df5-4d92-8a2e-b8bac49a94e9 tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] Calling method '>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:56:49.684639 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-840816bf-6df5-4d92-8a2e-b8bac49a94e9 tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] [instance: c3ad1103-185b-4f84-beb9-e1d0e546b2ed] Fetching instance by UUID {{(pid=123458) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:56:49.700231 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-840816bf-6df5-4d92-8a2e-b8bac49a94e9 tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:56:49.701114 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-840816bf-6df5-4d92-8a2e-b8bac49a94e9 tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:56:49.702581 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-840816bf-6df5-4d92-8a2e-b8bac49a94e9 tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:56:49.703411 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-840816bf-6df5-4d92-8a2e-b8bac49a94e9 tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:56:49.858291 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-840816bf-6df5-4d92-8a2e-b8bac49a94e9 tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5571352a755f45efa76b6720eb81c9c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6abb4912c175406ca0cefd03e327b7f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:56:49.867245 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-840816bf-6df5-4d92-8a2e-b8bac49a94e9 tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] 10.222.0.31 "GET /compute/v2.1/servers/c3ad1103-185b-4f84-beb9-e1d0e546b2ed" status: 200 len: 1358 microversion: 2.1 time: 0.187499 Apr 29 08:56:49.867854 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 330/663] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 08:56:49 2022] GET /compute/v2.1/servers/c3ad1103-185b-4f84-beb9-e1d0e546b2ed => generated 1358 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 08:56:49.914886 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-a6629317-afb9-4f29-a8d6-1bd4d2cc2cb0 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Calling method '>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:56:49.916307 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-a6629317-afb9-4f29-a8d6-1bd4d2cc2cb0 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] [instance: 406b5ad6-698e-457f-93f4-cdfd45fb3e8e] Fetching instance by UUID {{(pid=123459) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:56:49.923231 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-a6629317-afb9-4f29-a8d6-1bd4d2cc2cb0 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:56:49.923674 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-a6629317-afb9-4f29-a8d6-1bd4d2cc2cb0 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:56:49.924744 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-a6629317-afb9-4f29-a8d6-1bd4d2cc2cb0 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:56:49.925384 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-a6629317-afb9-4f29-a8d6-1bd4d2cc2cb0 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:56:50.114820 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-a6629317-afb9-4f29-a8d6-1bd4d2cc2cb0 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:56:50.124709 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-a6629317-afb9-4f29-a8d6-1bd4d2cc2cb0 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:56:50.126586 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-a6629317-afb9-4f29-a8d6-1bd4d2cc2cb0 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:56:50.127569 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-a6629317-afb9-4f29-a8d6-1bd4d2cc2cb0 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] 10.222.0.31 "GET /compute/v2.1/servers/406b5ad6-698e-457f-93f4-cdfd45fb3e8e" status: 200 len: 1811 microversion: 2.20 time: 0.216458 Apr 29 08:56:50.139862 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 334/664] 10.222.0.31 () {60 vars in 1276 bytes} [Fri Apr 29 08:56:49 2022] GET /compute/v2.1/servers/406b5ad6-698e-457f-93f4-cdfd45fb3e8e => generated 1811 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 29 08:56:50.885037 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-cdf60348-363b-4552-bd23-4fc4906ffe75 tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] Calling method '>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:56:50.885798 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-cdf60348-363b-4552-bd23-4fc4906ffe75 tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] [instance: c3ad1103-185b-4f84-beb9-e1d0e546b2ed] Fetching instance by UUID {{(pid=123458) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:56:50.892170 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-cdf60348-363b-4552-bd23-4fc4906ffe75 tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:56:50.892907 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-cdf60348-363b-4552-bd23-4fc4906ffe75 tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:56:50.893891 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-cdf60348-363b-4552-bd23-4fc4906ffe75 tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:56:50.894492 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-cdf60348-363b-4552-bd23-4fc4906ffe75 tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:56:51.112550 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-cdf60348-363b-4552-bd23-4fc4906ffe75 tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5571352a755f45efa76b6720eb81c9c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6abb4912c175406ca0cefd03e327b7f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:56:51.133045 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-cdf60348-363b-4552-bd23-4fc4906ffe75 tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] 10.222.0.31 "GET /compute/v2.1/servers/c3ad1103-185b-4f84-beb9-e1d0e546b2ed" status: 200 len: 1358 microversion: 2.1 time: 0.251206 Apr 29 08:56:51.135044 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 331/665] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 08:56:50 2022] GET /compute/v2.1/servers/c3ad1103-185b-4f84-beb9-e1d0e546b2ed => generated 1358 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 08:56:51.152925 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-82889411-66e6-49ef-b921-fd1c2d19e462 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Calling method '>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:56:51.154149 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-82889411-66e6-49ef-b921-fd1c2d19e462 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] [instance: 406b5ad6-698e-457f-93f4-cdfd45fb3e8e] Fetching instance by UUID {{(pid=123459) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:56:51.175823 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-82889411-66e6-49ef-b921-fd1c2d19e462 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:56:51.183446 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-82889411-66e6-49ef-b921-fd1c2d19e462 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:56:51.185216 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-82889411-66e6-49ef-b921-fd1c2d19e462 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:56:51.185885 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-82889411-66e6-49ef-b921-fd1c2d19e462 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:56:51.359121 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-82889411-66e6-49ef-b921-fd1c2d19e462 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:56:51.369898 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-82889411-66e6-49ef-b921-fd1c2d19e462 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:56:51.371390 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-82889411-66e6-49ef-b921-fd1c2d19e462 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:56:51.372693 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-82889411-66e6-49ef-b921-fd1c2d19e462 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] 10.222.0.31 "GET /compute/v2.1/servers/406b5ad6-698e-457f-93f4-cdfd45fb3e8e" status: 200 len: 1811 microversion: 2.20 time: 0.229000 Apr 29 08:56:51.373263 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 335/666] 10.222.0.31 () {60 vars in 1276 bytes} [Fri Apr 29 08:56:51 2022] GET /compute/v2.1/servers/406b5ad6-698e-457f-93f4-cdfd45fb3e8e => generated 1811 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 29 08:56:52.151225 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-cd7b6f3d-479f-4937-b4d4-03c62196979e tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] Calling method '>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:56:52.152812 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-cd7b6f3d-479f-4937-b4d4-03c62196979e tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] [instance: c3ad1103-185b-4f84-beb9-e1d0e546b2ed] Fetching instance by UUID {{(pid=123458) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:56:52.159456 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-cd7b6f3d-479f-4937-b4d4-03c62196979e tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:56:52.160227 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-cd7b6f3d-479f-4937-b4d4-03c62196979e tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:56:52.161782 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-cd7b6f3d-479f-4937-b4d4-03c62196979e tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:56:52.162528 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-cd7b6f3d-479f-4937-b4d4-03c62196979e tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:56:52.345732 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-cd7b6f3d-479f-4937-b4d4-03c62196979e tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5571352a755f45efa76b6720eb81c9c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6abb4912c175406ca0cefd03e327b7f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:56:52.355879 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-cd7b6f3d-479f-4937-b4d4-03c62196979e tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] 10.222.0.31 "GET /compute/v2.1/servers/c3ad1103-185b-4f84-beb9-e1d0e546b2ed" status: 200 len: 1358 microversion: 2.1 time: 0.208030 Apr 29 08:56:52.357224 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 332/667] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 08:56:52 2022] GET /compute/v2.1/servers/c3ad1103-185b-4f84-beb9-e1d0e546b2ed => generated 1358 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 08:56:52.390866 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-7ab31a6a-5909-44eb-a515-29cf7a5ba7df tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Calling method '>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:56:52.392125 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-7ab31a6a-5909-44eb-a515-29cf7a5ba7df tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] [instance: 406b5ad6-698e-457f-93f4-cdfd45fb3e8e] Fetching instance by UUID {{(pid=123459) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:56:52.401629 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-7ab31a6a-5909-44eb-a515-29cf7a5ba7df tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:56:52.402511 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-7ab31a6a-5909-44eb-a515-29cf7a5ba7df tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:56:52.403520 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-7ab31a6a-5909-44eb-a515-29cf7a5ba7df tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:56:52.403963 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-7ab31a6a-5909-44eb-a515-29cf7a5ba7df tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:56:52.658026 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-7ab31a6a-5909-44eb-a515-29cf7a5ba7df tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:56:52.666822 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-7ab31a6a-5909-44eb-a515-29cf7a5ba7df tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:56:52.668420 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-7ab31a6a-5909-44eb-a515-29cf7a5ba7df tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:56:52.669606 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-7ab31a6a-5909-44eb-a515-29cf7a5ba7df tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] 10.222.0.31 "GET /compute/v2.1/servers/406b5ad6-698e-457f-93f4-cdfd45fb3e8e" status: 200 len: 1811 microversion: 2.20 time: 0.282632 Apr 29 08:56:52.670166 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 336/668] 10.222.0.31 () {60 vars in 1276 bytes} [Fri Apr 29 08:56:52 2022] GET /compute/v2.1/servers/406b5ad6-698e-457f-93f4-cdfd45fb3e8e => generated 1811 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 29 08:56:53.374040 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-bec45161-9373-407d-8732-8674b46770ec tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] Calling method '>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:56:53.375955 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-bec45161-9373-407d-8732-8674b46770ec tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] [instance: c3ad1103-185b-4f84-beb9-e1d0e546b2ed] Fetching instance by UUID {{(pid=123458) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:56:53.383346 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-bec45161-9373-407d-8732-8674b46770ec tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:56:53.383693 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-bec45161-9373-407d-8732-8674b46770ec tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:56:53.384691 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-bec45161-9373-407d-8732-8674b46770ec tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:56:53.385291 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-bec45161-9373-407d-8732-8674b46770ec tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:56:53.547746 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-bec45161-9373-407d-8732-8674b46770ec tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5571352a755f45efa76b6720eb81c9c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6abb4912c175406ca0cefd03e327b7f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:56:53.555629 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-bec45161-9373-407d-8732-8674b46770ec tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] 10.222.0.31 "GET /compute/v2.1/servers/c3ad1103-185b-4f84-beb9-e1d0e546b2ed" status: 200 len: 1358 microversion: 2.1 time: 0.185535 Apr 29 08:56:53.556217 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 333/669] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 08:56:53 2022] GET /compute/v2.1/servers/c3ad1103-185b-4f84-beb9-e1d0e546b2ed => generated 1358 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 08:56:53.688804 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-d2baeceb-8593-4c77-8f63-ee249d3fc529 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Calling method '>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:56:53.689407 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-d2baeceb-8593-4c77-8f63-ee249d3fc529 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] [instance: 406b5ad6-698e-457f-93f4-cdfd45fb3e8e] Fetching instance by UUID {{(pid=123459) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:56:53.706869 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-d2baeceb-8593-4c77-8f63-ee249d3fc529 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:56:53.708032 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-d2baeceb-8593-4c77-8f63-ee249d3fc529 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:56:53.709011 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-d2baeceb-8593-4c77-8f63-ee249d3fc529 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:56:53.709518 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-d2baeceb-8593-4c77-8f63-ee249d3fc529 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:56:53.947260 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-d2baeceb-8593-4c77-8f63-ee249d3fc529 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:56:53.956959 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-d2baeceb-8593-4c77-8f63-ee249d3fc529 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:56:53.958745 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-d2baeceb-8593-4c77-8f63-ee249d3fc529 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:56:53.960457 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-d2baeceb-8593-4c77-8f63-ee249d3fc529 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] 10.222.0.31 "GET /compute/v2.1/servers/406b5ad6-698e-457f-93f4-cdfd45fb3e8e" status: 200 len: 1811 microversion: 2.20 time: 0.275525 Apr 29 08:56:53.961578 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 337/670] 10.222.0.31 () {60 vars in 1276 bytes} [Fri Apr 29 08:56:53 2022] GET /compute/v2.1/servers/406b5ad6-698e-457f-93f4-cdfd45fb3e8e => generated 1811 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 29 08:56:54.573035 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-b0533cfe-1e5e-4986-bd68-afee354f702b tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] Calling method '>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:56:54.574289 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-b0533cfe-1e5e-4986-bd68-afee354f702b tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] [instance: c3ad1103-185b-4f84-beb9-e1d0e546b2ed] Fetching instance by UUID {{(pid=123458) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:56:54.581205 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-b0533cfe-1e5e-4986-bd68-afee354f702b tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:56:54.581646 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-b0533cfe-1e5e-4986-bd68-afee354f702b tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:56:54.582508 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-b0533cfe-1e5e-4986-bd68-afee354f702b tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:56:54.583045 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-b0533cfe-1e5e-4986-bd68-afee354f702b tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:56:54.770353 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-b0533cfe-1e5e-4986-bd68-afee354f702b tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5571352a755f45efa76b6720eb81c9c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6abb4912c175406ca0cefd03e327b7f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:56:54.780728 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-b0533cfe-1e5e-4986-bd68-afee354f702b tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] 10.222.0.31 "GET /compute/v2.1/servers/c3ad1103-185b-4f84-beb9-e1d0e546b2ed" status: 200 len: 1358 microversion: 2.1 time: 0.211608 Apr 29 08:56:54.781321 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 334/671] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 08:56:54 2022] GET /compute/v2.1/servers/c3ad1103-185b-4f84-beb9-e1d0e546b2ed => generated 1358 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 08:56:54.981540 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-f3814979-b811-4552-bca8-201ee5ff151a tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Calling method '>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:56:54.982305 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-f3814979-b811-4552-bca8-201ee5ff151a tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] [instance: 406b5ad6-698e-457f-93f4-cdfd45fb3e8e] Fetching instance by UUID {{(pid=123459) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:56:54.995869 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-f3814979-b811-4552-bca8-201ee5ff151a tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:56:54.996493 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-f3814979-b811-4552-bca8-201ee5ff151a tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:56:54.997691 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-f3814979-b811-4552-bca8-201ee5ff151a tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:56:54.998835 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-f3814979-b811-4552-bca8-201ee5ff151a tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:56:55.151815 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-f3814979-b811-4552-bca8-201ee5ff151a tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:56:55.163505 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-f3814979-b811-4552-bca8-201ee5ff151a tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:56:55.165047 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-f3814979-b811-4552-bca8-201ee5ff151a tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:56:55.166233 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-f3814979-b811-4552-bca8-201ee5ff151a tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] 10.222.0.31 "GET /compute/v2.1/servers/406b5ad6-698e-457f-93f4-cdfd45fb3e8e" status: 200 len: 1811 microversion: 2.20 time: 0.188640 Apr 29 08:56:55.166787 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 338/672] 10.222.0.31 () {60 vars in 1276 bytes} [Fri Apr 29 08:56:54 2022] GET /compute/v2.1/servers/406b5ad6-698e-457f-93f4-cdfd45fb3e8e => generated 1811 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 29 08:56:55.799317 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-efbd4bf9-19af-4460-80e7-6f3c6b201ca9 tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] Calling method '>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:56:55.799935 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-efbd4bf9-19af-4460-80e7-6f3c6b201ca9 tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] [instance: c3ad1103-185b-4f84-beb9-e1d0e546b2ed] Fetching instance by UUID {{(pid=123458) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:56:55.807258 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-efbd4bf9-19af-4460-80e7-6f3c6b201ca9 tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:56:55.807769 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-efbd4bf9-19af-4460-80e7-6f3c6b201ca9 tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:56:55.808839 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-efbd4bf9-19af-4460-80e7-6f3c6b201ca9 tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:56:55.809535 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-efbd4bf9-19af-4460-80e7-6f3c6b201ca9 tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:56:56.058685 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-efbd4bf9-19af-4460-80e7-6f3c6b201ca9 tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5571352a755f45efa76b6720eb81c9c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6abb4912c175406ca0cefd03e327b7f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:56:56.066568 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-efbd4bf9-19af-4460-80e7-6f3c6b201ca9 tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] 10.222.0.31 "GET /compute/v2.1/servers/c3ad1103-185b-4f84-beb9-e1d0e546b2ed" status: 200 len: 1358 microversion: 2.1 time: 0.271316 Apr 29 08:56:56.067403 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 335/673] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 08:56:55 2022] GET /compute/v2.1/servers/c3ad1103-185b-4f84-beb9-e1d0e546b2ed => generated 1358 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 08:56:56.185372 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-d4fbeda5-13a5-4a32-bd56-cfc1c9bd9c44 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Calling method '>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:56:56.185981 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-d4fbeda5-13a5-4a32-bd56-cfc1c9bd9c44 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] [instance: 406b5ad6-698e-457f-93f4-cdfd45fb3e8e] Fetching instance by UUID {{(pid=123459) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:56:56.193350 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-d4fbeda5-13a5-4a32-bd56-cfc1c9bd9c44 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:56:56.193802 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-d4fbeda5-13a5-4a32-bd56-cfc1c9bd9c44 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:56:56.194586 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-d4fbeda5-13a5-4a32-bd56-cfc1c9bd9c44 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:56:56.195021 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-d4fbeda5-13a5-4a32-bd56-cfc1c9bd9c44 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:56:56.604403 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-d4fbeda5-13a5-4a32-bd56-cfc1c9bd9c44 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:56:56.621809 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-d4fbeda5-13a5-4a32-bd56-cfc1c9bd9c44 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:56:56.625648 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-d4fbeda5-13a5-4a32-bd56-cfc1c9bd9c44 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:56:56.632099 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-d4fbeda5-13a5-4a32-bd56-cfc1c9bd9c44 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] 10.222.0.31 "GET /compute/v2.1/servers/406b5ad6-698e-457f-93f4-cdfd45fb3e8e" status: 200 len: 1811 microversion: 2.20 time: 0.445553 Apr 29 08:56:56.633021 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 339/674] 10.222.0.31 () {60 vars in 1276 bytes} [Fri Apr 29 08:56:56 2022] GET /compute/v2.1/servers/406b5ad6-698e-457f-93f4-cdfd45fb3e8e => generated 1811 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 29 08:56:57.085484 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-746821e2-c83d-4952-8b8c-29be35b907c9 tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] Calling method '>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:56:57.086879 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-746821e2-c83d-4952-8b8c-29be35b907c9 tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] [instance: c3ad1103-185b-4f84-beb9-e1d0e546b2ed] Fetching instance by UUID {{(pid=123458) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:56:57.096577 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-746821e2-c83d-4952-8b8c-29be35b907c9 tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:56:57.097655 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-746821e2-c83d-4952-8b8c-29be35b907c9 tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:56:57.102111 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-746821e2-c83d-4952-8b8c-29be35b907c9 tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:56:57.102835 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-746821e2-c83d-4952-8b8c-29be35b907c9 tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:56:57.380462 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-746821e2-c83d-4952-8b8c-29be35b907c9 tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5571352a755f45efa76b6720eb81c9c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6abb4912c175406ca0cefd03e327b7f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:56:57.393759 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-746821e2-c83d-4952-8b8c-29be35b907c9 tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] 10.222.0.31 "GET /compute/v2.1/servers/c3ad1103-185b-4f84-beb9-e1d0e546b2ed" status: 200 len: 1358 microversion: 2.1 time: 0.313308 Apr 29 08:56:57.395694 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 336/675] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 08:56:57 2022] GET /compute/v2.1/servers/c3ad1103-185b-4f84-beb9-e1d0e546b2ed => generated 1358 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 08:56:57.652949 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-31a9eca4-59a8-4ffb-a063-2710276058e0 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Calling method '>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:56:57.653740 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-31a9eca4-59a8-4ffb-a063-2710276058e0 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] [instance: 406b5ad6-698e-457f-93f4-cdfd45fb3e8e] Fetching instance by UUID {{(pid=123459) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:56:57.664909 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-31a9eca4-59a8-4ffb-a063-2710276058e0 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:56:57.665773 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-31a9eca4-59a8-4ffb-a063-2710276058e0 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:56:57.670131 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-31a9eca4-59a8-4ffb-a063-2710276058e0 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:56:57.670974 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-31a9eca4-59a8-4ffb-a063-2710276058e0 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:56:58.061888 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-31a9eca4-59a8-4ffb-a063-2710276058e0 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:56:58.076005 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-31a9eca4-59a8-4ffb-a063-2710276058e0 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:56:58.086524 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-31a9eca4-59a8-4ffb-a063-2710276058e0 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:56:58.087803 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-31a9eca4-59a8-4ffb-a063-2710276058e0 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] 10.222.0.31 "GET /compute/v2.1/servers/406b5ad6-698e-457f-93f4-cdfd45fb3e8e" status: 200 len: 1811 microversion: 2.20 time: 0.439386 Apr 29 08:56:58.088748 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 340/676] 10.222.0.31 () {60 vars in 1276 bytes} [Fri Apr 29 08:56:57 2022] GET /compute/v2.1/servers/406b5ad6-698e-457f-93f4-cdfd45fb3e8e => generated 1811 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 29 08:56:58.414077 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-3fb9a84e-1ca7-45f4-b81d-5ff194b3be5c tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] Calling method '>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:56:58.415326 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-3fb9a84e-1ca7-45f4-b81d-5ff194b3be5c tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] [instance: c3ad1103-185b-4f84-beb9-e1d0e546b2ed] Fetching instance by UUID {{(pid=123458) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:56:58.427988 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-3fb9a84e-1ca7-45f4-b81d-5ff194b3be5c tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:56:58.428452 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-3fb9a84e-1ca7-45f4-b81d-5ff194b3be5c tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:56:58.429248 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-3fb9a84e-1ca7-45f4-b81d-5ff194b3be5c tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:56:58.435019 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-3fb9a84e-1ca7-45f4-b81d-5ff194b3be5c tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:56:58.668825 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-3fb9a84e-1ca7-45f4-b81d-5ff194b3be5c tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5571352a755f45efa76b6720eb81c9c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6abb4912c175406ca0cefd03e327b7f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:56:58.676954 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-3fb9a84e-1ca7-45f4-b81d-5ff194b3be5c tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] 10.222.0.31 "GET /compute/v2.1/servers/c3ad1103-185b-4f84-beb9-e1d0e546b2ed" status: 200 len: 1358 microversion: 2.1 time: 0.266809 Apr 29 08:56:58.677651 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 337/677] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 08:56:58 2022] GET /compute/v2.1/servers/c3ad1103-185b-4f84-beb9-e1d0e546b2ed => generated 1358 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 08:56:59.106801 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-4b368ad4-2396-4ea7-9af8-6654f5816e01 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Calling method '>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:56:59.107408 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-4b368ad4-2396-4ea7-9af8-6654f5816e01 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] [instance: 406b5ad6-698e-457f-93f4-cdfd45fb3e8e] Fetching instance by UUID {{(pid=123459) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:56:59.122174 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-4b368ad4-2396-4ea7-9af8-6654f5816e01 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:56:59.122808 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-4b368ad4-2396-4ea7-9af8-6654f5816e01 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:56:59.123752 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-4b368ad4-2396-4ea7-9af8-6654f5816e01 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:56:59.124384 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-4b368ad4-2396-4ea7-9af8-6654f5816e01 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:56:59.441231 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-4b368ad4-2396-4ea7-9af8-6654f5816e01 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:56:59.456432 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-4b368ad4-2396-4ea7-9af8-6654f5816e01 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:56:59.458066 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-4b368ad4-2396-4ea7-9af8-6654f5816e01 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:56:59.473390 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-4b368ad4-2396-4ea7-9af8-6654f5816e01 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] 10.222.0.31 "GET /compute/v2.1/servers/406b5ad6-698e-457f-93f4-cdfd45fb3e8e" status: 200 len: 1811 microversion: 2.20 time: 0.369849 Apr 29 08:56:59.475049 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 341/678] 10.222.0.31 () {60 vars in 1276 bytes} [Fri Apr 29 08:56:59 2022] GET /compute/v2.1/servers/406b5ad6-698e-457f-93f4-cdfd45fb3e8e => generated 1811 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 29 08:56:59.694840 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-e54e4a44-39f2-40f5-94c2-692460caa3e3 tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] Calling method '>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:56:59.695435 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-e54e4a44-39f2-40f5-94c2-692460caa3e3 tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] [instance: c3ad1103-185b-4f84-beb9-e1d0e546b2ed] Fetching instance by UUID {{(pid=123458) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:56:59.703546 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-e54e4a44-39f2-40f5-94c2-692460caa3e3 tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:56:59.704236 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-e54e4a44-39f2-40f5-94c2-692460caa3e3 tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:56:59.705959 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-e54e4a44-39f2-40f5-94c2-692460caa3e3 tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:56:59.706409 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-e54e4a44-39f2-40f5-94c2-692460caa3e3 tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:56:59.903208 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-e54e4a44-39f2-40f5-94c2-692460caa3e3 tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5571352a755f45efa76b6720eb81c9c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6abb4912c175406ca0cefd03e327b7f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:56:59.911460 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-e54e4a44-39f2-40f5-94c2-692460caa3e3 tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] 10.222.0.31 "GET /compute/v2.1/servers/c3ad1103-185b-4f84-beb9-e1d0e546b2ed" status: 200 len: 1358 microversion: 2.1 time: 0.221009 Apr 29 08:56:59.912999 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 338/679] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 08:56:59 2022] GET /compute/v2.1/servers/c3ad1103-185b-4f84-beb9-e1d0e546b2ed => generated 1358 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 08:57:00.164478 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-e44582aa-adf0-4917-83c0-d166112f0f32 tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] Action: 'create', calling method: .version_select at 0x7f623cc75d30>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1636555824"}} {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 29 08:57:00.179076 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.quota [None req-e44582aa-adf0-4917-83c0-d166112f0f32 tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] Getting quotas for project d8dd37ae188e415e86f551e3f760319e. Resources: {'key_pairs'} {{(pid=123459) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 29 08:57:00.183220 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.quota [None req-e44582aa-adf0-4917-83c0-d166112f0f32 tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] Getting quotas for user 3a82490fb17d42bf8c19f676fb687033 and project d8dd37ae188e415e86f551e3f760319e. Resources: {'key_pairs'} {{(pid=123459) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 29 08:57:00.498649 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-9bb8c698-e2bc-434e-bcd0-52663592c86d tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Calling method '>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:57:00.499213 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-9bb8c698-e2bc-434e-bcd0-52663592c86d tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] [instance: 406b5ad6-698e-457f-93f4-cdfd45fb3e8e] Fetching instance by UUID {{(pid=123458) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:57:00.505805 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-9bb8c698-e2bc-434e-bcd0-52663592c86d tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:57:00.506483 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-9bb8c698-e2bc-434e-bcd0-52663592c86d tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:57:00.507468 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-9bb8c698-e2bc-434e-bcd0-52663592c86d tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:57:00.508070 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-9bb8c698-e2bc-434e-bcd0-52663592c86d tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:57:00.546876 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.quota [None req-e44582aa-adf0-4917-83c0-d166112f0f32 tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] Getting quotas for project d8dd37ae188e415e86f551e3f760319e. Resources: {'key_pairs'} {{(pid=123459) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 29 08:57:00.551888 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.quota [None req-e44582aa-adf0-4917-83c0-d166112f0f32 tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] Getting quotas for user 3a82490fb17d42bf8c19f676fb687033 and project d8dd37ae188e415e86f551e3f760319e. Resources: {'key_pairs'} {{(pid=123459) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 29 08:57:00.565541 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-e44582aa-adf0-4917-83c0-d166112f0f32 tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] 10.222.0.31 "POST /compute/v2.1/os-keypairs" status: 200 len: 2315 microversion: 2.1 time: 0.583257 Apr 29 08:57:00.566153 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 342/680] 10.222.0.31 () {60 vars in 1157 bytes} [Fri Apr 29 08:56:59 2022] POST /compute/v2.1/os-keypairs => generated 2315 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 08:57:00.735985 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-9bb8c698-e2bc-434e-bcd0-52663592c86d tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:57:00.750434 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-9bb8c698-e2bc-434e-bcd0-52663592c86d tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:57:00.752384 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-9bb8c698-e2bc-434e-bcd0-52663592c86d tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:57:00.753782 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-9bb8c698-e2bc-434e-bcd0-52663592c86d tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] 10.222.0.31 "GET /compute/v2.1/servers/406b5ad6-698e-457f-93f4-cdfd45fb3e8e" status: 200 len: 1811 microversion: 2.20 time: 0.260410 Apr 29 08:57:00.756458 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 339/681] 10.222.0.31 () {60 vars in 1276 bytes} [Fri Apr 29 08:57:00 2022] GET /compute/v2.1/servers/406b5ad6-698e-457f-93f4-cdfd45fb3e8e => generated 1811 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 29 08:57:00.929029 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-30633220-38f6-402c-9a0e-3a52a1ea5e0d tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] Calling method '>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:57:00.933710 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-30633220-38f6-402c-9a0e-3a52a1ea5e0d tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] [instance: c3ad1103-185b-4f84-beb9-e1d0e546b2ed] Fetching instance by UUID {{(pid=123459) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:57:00.938014 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-30633220-38f6-402c-9a0e-3a52a1ea5e0d tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:57:00.939469 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-30633220-38f6-402c-9a0e-3a52a1ea5e0d tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:57:00.940784 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-30633220-38f6-402c-9a0e-3a52a1ea5e0d tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:57:00.941342 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-30633220-38f6-402c-9a0e-3a52a1ea5e0d tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:57:01.153442 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-30633220-38f6-402c-9a0e-3a52a1ea5e0d tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5571352a755f45efa76b6720eb81c9c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6abb4912c175406ca0cefd03e327b7f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:57:01.162178 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-30633220-38f6-402c-9a0e-3a52a1ea5e0d tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] 10.222.0.31 "GET /compute/v2.1/servers/c3ad1103-185b-4f84-beb9-e1d0e546b2ed" status: 200 len: 1358 microversion: 2.1 time: 0.237139 Apr 29 08:57:01.167196 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 343/682] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 08:57:00 2022] GET /compute/v2.1/servers/c3ad1103-185b-4f84-beb9-e1d0e546b2ed => generated 1358 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 08:57:01.773784 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-188b9bb6-c3c7-4c39-b1e6-40218786092d tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Calling method '>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:57:01.774414 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-188b9bb6-c3c7-4c39-b1e6-40218786092d tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] [instance: 406b5ad6-698e-457f-93f4-cdfd45fb3e8e] Fetching instance by UUID {{(pid=123458) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:57:01.786909 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-188b9bb6-c3c7-4c39-b1e6-40218786092d tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:57:01.787368 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-188b9bb6-c3c7-4c39-b1e6-40218786092d tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:57:01.788279 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-188b9bb6-c3c7-4c39-b1e6-40218786092d tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:57:01.788750 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-188b9bb6-c3c7-4c39-b1e6-40218786092d tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:57:01.936947 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-188b9bb6-c3c7-4c39-b1e6-40218786092d tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:57:01.945528 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-188b9bb6-c3c7-4c39-b1e6-40218786092d tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:57:01.947039 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-188b9bb6-c3c7-4c39-b1e6-40218786092d tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:57:01.948439 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-188b9bb6-c3c7-4c39-b1e6-40218786092d tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] 10.222.0.31 "GET /compute/v2.1/servers/406b5ad6-698e-457f-93f4-cdfd45fb3e8e" status: 200 len: 1811 microversion: 2.20 time: 0.178683 Apr 29 08:57:01.949362 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 340/683] 10.222.0.31 () {60 vars in 1276 bytes} [Fri Apr 29 08:57:01 2022] GET /compute/v2.1/servers/406b5ad6-698e-457f-93f4-cdfd45fb3e8e => generated 1811 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 29 08:57:02.186070 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-653e23e6-7821-4ad2-a0ec-961036973592 tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] Calling method '>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:57:02.187042 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-653e23e6-7821-4ad2-a0ec-961036973592 tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] [instance: c3ad1103-185b-4f84-beb9-e1d0e546b2ed] Fetching instance by UUID {{(pid=123459) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:57:02.195912 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-653e23e6-7821-4ad2-a0ec-961036973592 tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:57:02.196463 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-653e23e6-7821-4ad2-a0ec-961036973592 tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:57:02.198388 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-653e23e6-7821-4ad2-a0ec-961036973592 tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:57:02.199045 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-653e23e6-7821-4ad2-a0ec-961036973592 tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:57:02.355889 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-653e23e6-7821-4ad2-a0ec-961036973592 tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5571352a755f45efa76b6720eb81c9c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6abb4912c175406ca0cefd03e327b7f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:57:02.364196 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-653e23e6-7821-4ad2-a0ec-961036973592 tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] 10.222.0.31 "GET /compute/v2.1/servers/c3ad1103-185b-4f84-beb9-e1d0e546b2ed" status: 200 len: 1358 microversion: 2.1 time: 0.182670 Apr 29 08:57:02.364985 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 344/684] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 08:57:02 2022] GET /compute/v2.1/servers/c3ad1103-185b-4f84-beb9-e1d0e546b2ed => generated 1358 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 08:57:02.968935 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-a91cf34a-1f1f-48fa-a93b-96b3ed499ad8 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Calling method '>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:57:02.970891 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-a91cf34a-1f1f-48fa-a93b-96b3ed499ad8 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] [instance: 406b5ad6-698e-457f-93f4-cdfd45fb3e8e] Fetching instance by UUID {{(pid=123458) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:57:02.980530 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-a91cf34a-1f1f-48fa-a93b-96b3ed499ad8 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:57:02.981163 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-a91cf34a-1f1f-48fa-a93b-96b3ed499ad8 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:57:02.982335 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-a91cf34a-1f1f-48fa-a93b-96b3ed499ad8 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:57:02.982864 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-a91cf34a-1f1f-48fa-a93b-96b3ed499ad8 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:57:03.156899 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-a91cf34a-1f1f-48fa-a93b-96b3ed499ad8 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:57:03.166734 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-a91cf34a-1f1f-48fa-a93b-96b3ed499ad8 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:57:03.168755 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-a91cf34a-1f1f-48fa-a93b-96b3ed499ad8 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:57:03.170025 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-a91cf34a-1f1f-48fa-a93b-96b3ed499ad8 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] 10.222.0.31 "GET /compute/v2.1/servers/406b5ad6-698e-457f-93f4-cdfd45fb3e8e" status: 200 len: 1811 microversion: 2.20 time: 0.206614 Apr 29 08:57:03.170675 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 341/685] 10.222.0.31 () {60 vars in 1276 bytes} [Fri Apr 29 08:57:02 2022] GET /compute/v2.1/servers/406b5ad6-698e-457f-93f4-cdfd45fb3e8e => generated 1811 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 29 08:57:03.387892 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-b2d9731e-4ed7-47c1-9aa3-48d13f987e6b tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] Calling method '>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:57:03.417848 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-b2d9731e-4ed7-47c1-9aa3-48d13f987e6b tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] [instance: c3ad1103-185b-4f84-beb9-e1d0e546b2ed] Fetching instance by UUID {{(pid=123459) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:57:03.432117 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-b2d9731e-4ed7-47c1-9aa3-48d13f987e6b tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:57:03.432881 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-b2d9731e-4ed7-47c1-9aa3-48d13f987e6b tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:57:03.433884 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-b2d9731e-4ed7-47c1-9aa3-48d13f987e6b tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:57:03.434474 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-b2d9731e-4ed7-47c1-9aa3-48d13f987e6b tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:57:03.615979 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-b2d9731e-4ed7-47c1-9aa3-48d13f987e6b tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5571352a755f45efa76b6720eb81c9c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6abb4912c175406ca0cefd03e327b7f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:57:03.624515 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-b2d9731e-4ed7-47c1-9aa3-48d13f987e6b tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] 10.222.0.31 "GET /compute/v2.1/servers/c3ad1103-185b-4f84-beb9-e1d0e546b2ed" status: 200 len: 1358 microversion: 2.1 time: 0.245967 Apr 29 08:57:03.632181 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 345/686] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 08:57:03 2022] GET /compute/v2.1/servers/c3ad1103-185b-4f84-beb9-e1d0e546b2ed => generated 1358 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 08:57:04.188028 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-18a61a9c-0779-4f43-91af-6bcff9444be3 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Calling method '>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:57:04.188666 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-18a61a9c-0779-4f43-91af-6bcff9444be3 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] [instance: 406b5ad6-698e-457f-93f4-cdfd45fb3e8e] Fetching instance by UUID {{(pid=123458) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:57:04.196711 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-18a61a9c-0779-4f43-91af-6bcff9444be3 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:57:04.197164 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-18a61a9c-0779-4f43-91af-6bcff9444be3 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:57:04.197984 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-18a61a9c-0779-4f43-91af-6bcff9444be3 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:57:04.198411 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-18a61a9c-0779-4f43-91af-6bcff9444be3 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:57:04.365852 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-18a61a9c-0779-4f43-91af-6bcff9444be3 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:57:04.374984 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-18a61a9c-0779-4f43-91af-6bcff9444be3 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:57:04.376518 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-18a61a9c-0779-4f43-91af-6bcff9444be3 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:57:04.377708 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-18a61a9c-0779-4f43-91af-6bcff9444be3 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] 10.222.0.31 "GET /compute/v2.1/servers/406b5ad6-698e-457f-93f4-cdfd45fb3e8e" status: 200 len: 1811 microversion: 2.20 time: 0.193690 Apr 29 08:57:04.378280 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 342/687] 10.222.0.31 () {60 vars in 1276 bytes} [Fri Apr 29 08:57:04 2022] GET /compute/v2.1/servers/406b5ad6-698e-457f-93f4-cdfd45fb3e8e => generated 1811 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 29 08:57:04.643452 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-758190dd-a259-44b0-822f-a380a0dfbd33 tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] Calling method '>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:57:04.643452 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-758190dd-a259-44b0-822f-a380a0dfbd33 tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] [instance: c3ad1103-185b-4f84-beb9-e1d0e546b2ed] Fetching instance by UUID {{(pid=123459) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:57:04.650165 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-758190dd-a259-44b0-822f-a380a0dfbd33 tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:57:04.650617 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-758190dd-a259-44b0-822f-a380a0dfbd33 tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:57:04.651398 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-758190dd-a259-44b0-822f-a380a0dfbd33 tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:57:04.651829 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-758190dd-a259-44b0-822f-a380a0dfbd33 tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:57:04.810574 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-758190dd-a259-44b0-822f-a380a0dfbd33 tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5571352a755f45efa76b6720eb81c9c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6abb4912c175406ca0cefd03e327b7f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:57:04.819799 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-758190dd-a259-44b0-822f-a380a0dfbd33 tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] 10.222.0.31 "GET /compute/v2.1/servers/c3ad1103-185b-4f84-beb9-e1d0e546b2ed" status: 200 len: 1358 microversion: 2.1 time: 0.180945 Apr 29 08:57:04.820466 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 346/688] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 08:57:04 2022] GET /compute/v2.1/servers/c3ad1103-185b-4f84-beb9-e1d0e546b2ed => generated 1358 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 08:57:05.397990 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-4ba5756e-857d-4777-ba23-4a7e8bee705e tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Calling method '>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:57:05.400858 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-4ba5756e-857d-4777-ba23-4a7e8bee705e tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] [instance: 406b5ad6-698e-457f-93f4-cdfd45fb3e8e] Fetching instance by UUID {{(pid=123458) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:57:05.409351 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-4ba5756e-857d-4777-ba23-4a7e8bee705e tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:57:05.409800 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-4ba5756e-857d-4777-ba23-4a7e8bee705e tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:57:05.410663 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-4ba5756e-857d-4777-ba23-4a7e8bee705e tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:57:05.411097 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-4ba5756e-857d-4777-ba23-4a7e8bee705e tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:57:05.568364 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-4ba5756e-857d-4777-ba23-4a7e8bee705e tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:57:05.584881 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-4ba5756e-857d-4777-ba23-4a7e8bee705e tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:57:05.586577 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-4ba5756e-857d-4777-ba23-4a7e8bee705e tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:57:05.587924 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-4ba5756e-857d-4777-ba23-4a7e8bee705e tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] 10.222.0.31 "GET /compute/v2.1/servers/406b5ad6-698e-457f-93f4-cdfd45fb3e8e" status: 200 len: 1811 microversion: 2.20 time: 0.194700 Apr 29 08:57:05.588592 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 343/689] 10.222.0.31 () {60 vars in 1276 bytes} [Fri Apr 29 08:57:05 2022] GET /compute/v2.1/servers/406b5ad6-698e-457f-93f4-cdfd45fb3e8e => generated 1811 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 29 08:57:05.649852 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [req-f2262370-bd68-4b12-bf26-7ccd007c6edb req-2c30f704-1e87-47db-b4f1-ec138e037d19 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c3ad1103-185b-4f84-beb9-e1d0e546b2ed", "name": "network-vif-plugged", "status": "completed", "tag": "69230ee3-728d-4825-9b39-4cb903b621cf"}]} {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 29 08:57:05.658706 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [req-f2262370-bd68-4b12-bf26-7ccd007c6edb req-2c30f704-1e87-47db-b4f1-ec138e037d19 service nova] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:57:05.659511 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [req-f2262370-bd68-4b12-bf26-7ccd007c6edb req-2c30f704-1e87-47db-b4f1-ec138e037d19 service nova] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:57:05.672840 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.compute.server_external_events [req-f2262370-bd68-4b12-bf26-7ccd007c6edb req-2c30f704-1e87-47db-b4f1-ec138e037d19 service nova] Creating event network-vif-plugged:69230ee3-728d-4825-9b39-4cb903b621cf for instance c3ad1103-185b-4f84-beb9-e1d0e546b2ed on hv-cinder-83987 Apr 29 08:57:05.679699 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [req-f2262370-bd68-4b12-bf26-7ccd007c6edb req-2c30f704-1e87-47db-b4f1-ec138e037d19 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.099554 Apr 29 08:57:05.680413 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 347/690] 10.222.0.31 () {64 vars in 1317 bytes} [Fri Apr 29 08:57:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 29 08:57:05.836657 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-f5844edd-04bd-4ee6-89f4-829a3d589fbb tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] Calling method '>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:57:05.837704 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-f5844edd-04bd-4ee6-89f4-829a3d589fbb tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] [instance: c3ad1103-185b-4f84-beb9-e1d0e546b2ed] Fetching instance by UUID {{(pid=123458) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:57:05.844210 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-f5844edd-04bd-4ee6-89f4-829a3d589fbb tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:57:05.844746 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-f5844edd-04bd-4ee6-89f4-829a3d589fbb tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:57:05.845662 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-f5844edd-04bd-4ee6-89f4-829a3d589fbb tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:57:05.846246 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-f5844edd-04bd-4ee6-89f4-829a3d589fbb tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:57:06.048797 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-f5844edd-04bd-4ee6-89f4-829a3d589fbb tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5571352a755f45efa76b6720eb81c9c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6abb4912c175406ca0cefd03e327b7f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:57:06.060679 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-f5844edd-04bd-4ee6-89f4-829a3d589fbb tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] 10.222.0.31 "GET /compute/v2.1/servers/c3ad1103-185b-4f84-beb9-e1d0e546b2ed" status: 200 len: 1358 microversion: 2.1 time: 0.228267 Apr 29 08:57:06.061272 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 344/691] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 08:57:05 2022] GET /compute/v2.1/servers/c3ad1103-185b-4f84-beb9-e1d0e546b2ed => generated 1358 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 08:57:06.608832 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-7538fcd9-274c-447f-91f3-89762bfd8234 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Calling method '>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:57:06.609469 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-7538fcd9-274c-447f-91f3-89762bfd8234 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] [instance: 406b5ad6-698e-457f-93f4-cdfd45fb3e8e] Fetching instance by UUID {{(pid=123459) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:57:06.617322 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-7538fcd9-274c-447f-91f3-89762bfd8234 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:57:06.617771 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-7538fcd9-274c-447f-91f3-89762bfd8234 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:57:06.618590 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-7538fcd9-274c-447f-91f3-89762bfd8234 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:57:06.619023 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-7538fcd9-274c-447f-91f3-89762bfd8234 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:57:06.757226 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-7538fcd9-274c-447f-91f3-89762bfd8234 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:57:06.765502 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-7538fcd9-274c-447f-91f3-89762bfd8234 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:57:06.766973 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-7538fcd9-274c-447f-91f3-89762bfd8234 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:57:06.768111 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-7538fcd9-274c-447f-91f3-89762bfd8234 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] 10.222.0.31 "GET /compute/v2.1/servers/406b5ad6-698e-457f-93f4-cdfd45fb3e8e" status: 200 len: 1811 microversion: 2.20 time: 0.163696 Apr 29 08:57:06.768690 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 348/692] 10.222.0.31 () {60 vars in 1276 bytes} [Fri Apr 29 08:57:06 2022] GET /compute/v2.1/servers/406b5ad6-698e-457f-93f4-cdfd45fb3e8e => generated 1811 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 29 08:57:07.078249 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-1137cc11-db16-45a4-9d35-6c5d0e6f18f5 tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] Calling method '>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:57:07.078904 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-1137cc11-db16-45a4-9d35-6c5d0e6f18f5 tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] [instance: c3ad1103-185b-4f84-beb9-e1d0e546b2ed] Fetching instance by UUID {{(pid=123458) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:57:07.085720 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-1137cc11-db16-45a4-9d35-6c5d0e6f18f5 tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:57:07.086160 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-1137cc11-db16-45a4-9d35-6c5d0e6f18f5 tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:57:07.086947 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-1137cc11-db16-45a4-9d35-6c5d0e6f18f5 tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:57:07.087373 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-1137cc11-db16-45a4-9d35-6c5d0e6f18f5 tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:57:07.215735 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-1137cc11-db16-45a4-9d35-6c5d0e6f18f5 tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5571352a755f45efa76b6720eb81c9c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6abb4912c175406ca0cefd03e327b7f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:57:07.224096 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-1137cc11-db16-45a4-9d35-6c5d0e6f18f5 tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] 10.222.0.31 "GET /compute/v2.1/servers/c3ad1103-185b-4f84-beb9-e1d0e546b2ed" status: 200 len: 1358 microversion: 2.1 time: 0.149607 Apr 29 08:57:07.224708 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 345/693] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 08:57:07 2022] GET /compute/v2.1/servers/c3ad1103-185b-4f84-beb9-e1d0e546b2ed => generated 1358 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 08:57:07.787472 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-351d3d9a-3b6d-4080-9a98-321024fd57f0 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Calling method '>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:57:07.789092 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-351d3d9a-3b6d-4080-9a98-321024fd57f0 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] [instance: 406b5ad6-698e-457f-93f4-cdfd45fb3e8e] Fetching instance by UUID {{(pid=123459) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:57:07.795803 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-351d3d9a-3b6d-4080-9a98-321024fd57f0 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:57:07.796380 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-351d3d9a-3b6d-4080-9a98-321024fd57f0 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:57:07.797331 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-351d3d9a-3b6d-4080-9a98-321024fd57f0 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:57:07.797770 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-351d3d9a-3b6d-4080-9a98-321024fd57f0 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:57:07.815995 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [req-3594df5c-8710-45fc-a7be-8de13107d4a8 req-d2feb49a-2a3a-4f3f-a71f-30a306cdcb7a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "406b5ad6-698e-457f-93f4-cdfd45fb3e8e", "name": "network-vif-plugged", "status": "completed", "tag": "afdeb60c-c7b1-441b-90f4-293273965fad"}]} {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 29 08:57:07.831979 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [req-3594df5c-8710-45fc-a7be-8de13107d4a8 req-d2feb49a-2a3a-4f3f-a71f-30a306cdcb7a service nova] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:57:07.845333 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [req-3594df5c-8710-45fc-a7be-8de13107d4a8 req-d2feb49a-2a3a-4f3f-a71f-30a306cdcb7a service nova] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:57:07.860683 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.compute.server_external_events [req-3594df5c-8710-45fc-a7be-8de13107d4a8 req-d2feb49a-2a3a-4f3f-a71f-30a306cdcb7a service nova] Creating event network-vif-plugged:afdeb60c-c7b1-441b-90f4-293273965fad for instance 406b5ad6-698e-457f-93f4-cdfd45fb3e8e on hv-cinder-83987 Apr 29 08:57:07.867551 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [req-3594df5c-8710-45fc-a7be-8de13107d4a8 req-d2feb49a-2a3a-4f3f-a71f-30a306cdcb7a service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058941 Apr 29 08:57:07.868342 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 346/694] 10.222.0.31 () {64 vars in 1317 bytes} [Fri Apr 29 08:57:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 29 08:57:07.974699 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-351d3d9a-3b6d-4080-9a98-321024fd57f0 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:57:07.983605 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-351d3d9a-3b6d-4080-9a98-321024fd57f0 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:57:07.985143 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-351d3d9a-3b6d-4080-9a98-321024fd57f0 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:57:07.986318 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-351d3d9a-3b6d-4080-9a98-321024fd57f0 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] 10.222.0.31 "GET /compute/v2.1/servers/406b5ad6-698e-457f-93f4-cdfd45fb3e8e" status: 200 len: 1811 microversion: 2.20 time: 0.204256 Apr 29 08:57:07.986885 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 349/695] 10.222.0.31 () {60 vars in 1276 bytes} [Fri Apr 29 08:57:07 2022] GET /compute/v2.1/servers/406b5ad6-698e-457f-93f4-cdfd45fb3e8e => generated 1811 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 29 08:57:08.242584 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-f2f70903-6741-4948-bdb7-936a8caeb379 tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] Calling method '>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:57:08.243757 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-f2f70903-6741-4948-bdb7-936a8caeb379 tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] [instance: c3ad1103-185b-4f84-beb9-e1d0e546b2ed] Fetching instance by UUID {{(pid=123458) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:57:08.251556 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-f2f70903-6741-4948-bdb7-936a8caeb379 tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:57:08.252447 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-f2f70903-6741-4948-bdb7-936a8caeb379 tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:57:08.253557 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-f2f70903-6741-4948-bdb7-936a8caeb379 tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:57:08.254096 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-f2f70903-6741-4948-bdb7-936a8caeb379 tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:57:08.405099 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-f2f70903-6741-4948-bdb7-936a8caeb379 tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5571352a755f45efa76b6720eb81c9c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6abb4912c175406ca0cefd03e327b7f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:57:08.413755 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-f2f70903-6741-4948-bdb7-936a8caeb379 tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] 10.222.0.31 "GET /compute/v2.1/servers/c3ad1103-185b-4f84-beb9-e1d0e546b2ed" status: 200 len: 1549 microversion: 2.1 time: 0.176744 Apr 29 08:57:08.413755 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 347/696] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 08:57:08 2022] GET /compute/v2.1/servers/c3ad1103-185b-4f84-beb9-e1d0e546b2ed => generated 1549 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 08:57:08.430702 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-e03981f5-ce18-4f1a-acbf-029b45dc61c4 tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] Calling method '>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:57:08.431354 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-e03981f5-ce18-4f1a-acbf-029b45dc61c4 tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] [instance: c3ad1103-185b-4f84-beb9-e1d0e546b2ed] Fetching instance by UUID {{(pid=123459) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:57:08.437840 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-e03981f5-ce18-4f1a-acbf-029b45dc61c4 tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:57:08.438297 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-e03981f5-ce18-4f1a-acbf-029b45dc61c4 tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:57:08.439099 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-e03981f5-ce18-4f1a-acbf-029b45dc61c4 tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:57:08.439546 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-e03981f5-ce18-4f1a-acbf-029b45dc61c4 tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:57:08.585766 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-e03981f5-ce18-4f1a-acbf-029b45dc61c4 tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5571352a755f45efa76b6720eb81c9c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6abb4912c175406ca0cefd03e327b7f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:57:08.593484 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-e03981f5-ce18-4f1a-acbf-029b45dc61c4 tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] 10.222.0.31 "GET /compute/v2.1/servers/c3ad1103-185b-4f84-beb9-e1d0e546b2ed" status: 200 len: 1549 microversion: 2.1 time: 0.167585 Apr 29 08:57:08.594050 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 350/697] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 08:57:08 2022] GET /compute/v2.1/servers/c3ad1103-185b-4f84-beb9-e1d0e546b2ed => generated 1549 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 08:57:08.609940 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-3ff9f9b1-c65c-40a5-b928-2c998790635e tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] Calling method '>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:57:08.614600 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-3ff9f9b1-c65c-40a5-b928-2c998790635e tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '5571352a755f45efa76b6720eb81c9c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6abb4912c175406ca0cefd03e327b7f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:57:08.615772 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-3ff9f9b1-c65c-40a5-b928-2c998790635e tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] Searching by: {'deleted': False, 'project_id': '6abb4912c175406ca0cefd03e327b7f5'} {{(pid=123458) get_all /opt/stack/nova/nova/compute/api.py:2960}} Apr 29 08:57:08.624603 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-3ff9f9b1-c65c-40a5-b928-2c998790635e tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:57:08.624935 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-3ff9f9b1-c65c-40a5-b928-2c998790635e tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:57:08.625815 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-3ff9f9b1-c65c-40a5-b928-2c998790635e tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:57:08.626274 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-3ff9f9b1-c65c-40a5-b928-2c998790635e tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:57:08.723230 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.multi_cell_list [None req-3ff9f9b1-c65c-40a5-b928-2c998790635e tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=123458) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Apr 29 08:57:08.831251 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-3ff9f9b1-c65c-40a5-b928-2c998790635e tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] 10.222.0.31 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.225186 Apr 29 08:57:08.831834 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 348/698] 10.222.0.31 () {58 vars in 1124 bytes} [Fri Apr 29 08:57:08 2022] GET /compute/v2.1/servers => generated 342 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 29 08:57:08.842152 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-79ace0f5-dace-43f4-afee-6a902b9426fe tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] Calling method '>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:57:08.842767 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-79ace0f5-dace-43f4-afee-6a902b9426fe tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] [instance: c3ad1103-185b-4f84-beb9-e1d0e546b2ed] Fetching instance by UUID {{(pid=123459) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:57:08.849673 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-79ace0f5-dace-43f4-afee-6a902b9426fe tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:57:08.850113 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-79ace0f5-dace-43f4-afee-6a902b9426fe tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:57:08.850879 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-79ace0f5-dace-43f4-afee-6a902b9426fe tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:57:08.851314 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-79ace0f5-dace-43f4-afee-6a902b9426fe tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:57:08.982696 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-79ace0f5-dace-43f4-afee-6a902b9426fe tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5571352a755f45efa76b6720eb81c9c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6abb4912c175406ca0cefd03e327b7f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:57:08.990992 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-79ace0f5-dace-43f4-afee-6a902b9426fe tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] 10.222.0.31 "GET /compute/v2.1/servers/c3ad1103-185b-4f84-beb9-e1d0e546b2ed" status: 200 len: 1549 microversion: 2.1 time: 0.152570 Apr 29 08:57:08.991839 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 351/699] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 08:57:08 2022] GET /compute/v2.1/servers/c3ad1103-185b-4f84-beb9-e1d0e546b2ed => generated 1549 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 08:57:09.004756 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-2f910930-28d7-43bf-8296-bd3e2dafa0c4 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Calling method '>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:57:09.005361 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-2f910930-28d7-43bf-8296-bd3e2dafa0c4 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] [instance: 406b5ad6-698e-457f-93f4-cdfd45fb3e8e] Fetching instance by UUID {{(pid=123458) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:57:09.011326 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-2f910930-28d7-43bf-8296-bd3e2dafa0c4 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:57:09.011772 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-2f910930-28d7-43bf-8296-bd3e2dafa0c4 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:57:09.012577 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-2f910930-28d7-43bf-8296-bd3e2dafa0c4 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:57:09.013009 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-2f910930-28d7-43bf-8296-bd3e2dafa0c4 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:57:09.158769 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-2f910930-28d7-43bf-8296-bd3e2dafa0c4 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:57:09.173194 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-2f910930-28d7-43bf-8296-bd3e2dafa0c4 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:57:09.174978 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-2f910930-28d7-43bf-8296-bd3e2dafa0c4 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:57:09.176747 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-2f910930-28d7-43bf-8296-bd3e2dafa0c4 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] 10.222.0.31 "GET /compute/v2.1/servers/406b5ad6-698e-457f-93f4-cdfd45fb3e8e" status: 200 len: 1811 microversion: 2.20 time: 0.175576 Apr 29 08:57:09.177398 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 349/700] 10.222.0.31 () {60 vars in 1276 bytes} [Fri Apr 29 08:57:08 2022] GET /compute/v2.1/servers/406b5ad6-698e-457f-93f4-cdfd45fb3e8e => generated 1811 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 29 08:57:10.197302 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-dc348490-cdfc-458e-8bef-abe9906b86c4 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Calling method '>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:57:10.197873 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-dc348490-cdfc-458e-8bef-abe9906b86c4 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] [instance: 406b5ad6-698e-457f-93f4-cdfd45fb3e8e] Fetching instance by UUID {{(pid=123459) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:57:10.206443 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-dc348490-cdfc-458e-8bef-abe9906b86c4 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:57:10.206914 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-dc348490-cdfc-458e-8bef-abe9906b86c4 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:57:10.208029 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-dc348490-cdfc-458e-8bef-abe9906b86c4 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:57:10.208629 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-dc348490-cdfc-458e-8bef-abe9906b86c4 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:57:10.349665 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-dc348490-cdfc-458e-8bef-abe9906b86c4 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:57:10.358651 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-dc348490-cdfc-458e-8bef-abe9906b86c4 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:57:10.360170 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-dc348490-cdfc-458e-8bef-abe9906b86c4 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:57:10.361349 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-dc348490-cdfc-458e-8bef-abe9906b86c4 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] 10.222.0.31 "GET /compute/v2.1/servers/406b5ad6-698e-457f-93f4-cdfd45fb3e8e" status: 200 len: 1811 microversion: 2.20 time: 0.169736 Apr 29 08:57:10.361910 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 352/701] 10.222.0.31 () {60 vars in 1276 bytes} [Fri Apr 29 08:57:10 2022] GET /compute/v2.1/servers/406b5ad6-698e-457f-93f4-cdfd45fb3e8e => generated 1811 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 29 08:57:11.383349 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-7e1ef5ea-c7d8-4590-b81d-b88902e609eb tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Calling method '>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:57:11.383971 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-7e1ef5ea-c7d8-4590-b81d-b88902e609eb tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] [instance: 406b5ad6-698e-457f-93f4-cdfd45fb3e8e] Fetching instance by UUID {{(pid=123458) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:57:11.390648 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-7e1ef5ea-c7d8-4590-b81d-b88902e609eb tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:57:11.391624 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-7e1ef5ea-c7d8-4590-b81d-b88902e609eb tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:57:11.391909 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-7e1ef5ea-c7d8-4590-b81d-b88902e609eb tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:57:11.392379 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-7e1ef5ea-c7d8-4590-b81d-b88902e609eb tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:57:11.553011 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-7e1ef5ea-c7d8-4590-b81d-b88902e609eb tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:57:11.565477 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-7e1ef5ea-c7d8-4590-b81d-b88902e609eb tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:57:11.567232 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-7e1ef5ea-c7d8-4590-b81d-b88902e609eb tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:57:11.568602 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-7e1ef5ea-c7d8-4590-b81d-b88902e609eb tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] 10.222.0.31 "GET /compute/v2.1/servers/406b5ad6-698e-457f-93f4-cdfd45fb3e8e" status: 200 len: 1811 microversion: 2.20 time: 0.191413 Apr 29 08:57:11.569295 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 350/702] 10.222.0.31 () {60 vars in 1276 bytes} [Fri Apr 29 08:57:11 2022] GET /compute/v2.1/servers/406b5ad6-698e-457f-93f4-cdfd45fb3e8e => generated 1811 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 29 08:57:11.684581 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-323c43da-096e-4a18-811f-c79d27557b9c tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e76a9153-da86-43ab-83b5-66b453741034"}} {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 29 08:57:11.685997 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-323c43da-096e-4a18-811f-c79d27557b9c tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] [instance: c3ad1103-185b-4f84-beb9-e1d0e546b2ed] Fetching instance by UUID {{(pid=123459) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:57:11.694218 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-323c43da-096e-4a18-811f-c79d27557b9c tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:57:11.694672 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-323c43da-096e-4a18-811f-c79d27557b9c tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:57:11.695508 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-323c43da-096e-4a18-811f-c79d27557b9c tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:57:11.695948 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-323c43da-096e-4a18-811f-c79d27557b9c tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:57:12.262654 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-323c43da-096e-4a18-811f-c79d27557b9c tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] 10.222.0.31 "POST /compute/v2.1/servers/c3ad1103-185b-4f84-beb9-e1d0e546b2ed/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.582693 Apr 29 08:57:12.263935 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 353/703] 10.222.0.31 () {60 vars in 1322 bytes} [Fri Apr 29 08:57:11 2022] POST /compute/v2.1/servers/c3ad1103-185b-4f84-beb9-e1d0e546b2ed/os-volume_attachments => generated 194 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 29 08:57:12.587608 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-d8b96a08-bf61-44a1-bf45-989bcfddcf63 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Calling method '>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:57:12.588378 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-d8b96a08-bf61-44a1-bf45-989bcfddcf63 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] [instance: 406b5ad6-698e-457f-93f4-cdfd45fb3e8e] Fetching instance by UUID {{(pid=123458) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:57:12.594778 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-d8b96a08-bf61-44a1-bf45-989bcfddcf63 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:57:12.595220 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-d8b96a08-bf61-44a1-bf45-989bcfddcf63 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:57:12.596024 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-d8b96a08-bf61-44a1-bf45-989bcfddcf63 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:57:12.596486 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-d8b96a08-bf61-44a1-bf45-989bcfddcf63 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:57:12.744504 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-d8b96a08-bf61-44a1-bf45-989bcfddcf63 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:57:12.754390 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-d8b96a08-bf61-44a1-bf45-989bcfddcf63 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:57:12.756474 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-d8b96a08-bf61-44a1-bf45-989bcfddcf63 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:57:12.757876 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-d8b96a08-bf61-44a1-bf45-989bcfddcf63 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] 10.222.0.31 "GET /compute/v2.1/servers/406b5ad6-698e-457f-93f4-cdfd45fb3e8e" status: 200 len: 1811 microversion: 2.20 time: 0.174615 Apr 29 08:57:12.758438 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 351/704] 10.222.0.31 () {60 vars in 1276 bytes} [Fri Apr 29 08:57:12 2022] GET /compute/v2.1/servers/406b5ad6-698e-457f-93f4-cdfd45fb3e8e => generated 1811 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 29 08:57:13.776844 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-f1321007-e079-400f-bc94-a2359968db69 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Calling method '>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:57:13.777533 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-f1321007-e079-400f-bc94-a2359968db69 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] [instance: 406b5ad6-698e-457f-93f4-cdfd45fb3e8e] Fetching instance by UUID {{(pid=123459) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:57:13.784044 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-f1321007-e079-400f-bc94-a2359968db69 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:57:13.784521 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-f1321007-e079-400f-bc94-a2359968db69 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:57:13.785792 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-f1321007-e079-400f-bc94-a2359968db69 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:57:13.786218 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-f1321007-e079-400f-bc94-a2359968db69 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:57:13.914834 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-f1321007-e079-400f-bc94-a2359968db69 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:57:13.923226 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-f1321007-e079-400f-bc94-a2359968db69 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:57:13.924746 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-f1321007-e079-400f-bc94-a2359968db69 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:57:13.926545 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-f1321007-e079-400f-bc94-a2359968db69 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] 10.222.0.31 "GET /compute/v2.1/servers/406b5ad6-698e-457f-93f4-cdfd45fb3e8e" status: 200 len: 1798 microversion: 2.20 time: 0.153311 Apr 29 08:57:13.927109 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 354/705] 10.222.0.31 () {60 vars in 1276 bytes} [Fri Apr 29 08:57:13 2022] GET /compute/v2.1/servers/406b5ad6-698e-457f-93f4-cdfd45fb3e8e => generated 1798 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 29 08:57:20.867251 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-f52abcd3-16da-4b39-9a98-ceb199806666 tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] Calling method '>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:57:20.867852 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-f52abcd3-16da-4b39-9a98-ceb199806666 tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] [instance: c3ad1103-185b-4f84-beb9-e1d0e546b2ed] Fetching instance by UUID {{(pid=123458) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:57:20.875809 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-f52abcd3-16da-4b39-9a98-ceb199806666 tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:57:20.876293 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-f52abcd3-16da-4b39-9a98-ceb199806666 tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:57:20.877903 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-f52abcd3-16da-4b39-9a98-ceb199806666 tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:57:20.878334 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-f52abcd3-16da-4b39-9a98-ceb199806666 tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:57:21.014628 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-f52abcd3-16da-4b39-9a98-ceb199806666 tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5571352a755f45efa76b6720eb81c9c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6abb4912c175406ca0cefd03e327b7f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:57:21.023707 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-f52abcd3-16da-4b39-9a98-ceb199806666 tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] 10.222.0.31 "GET /compute/v2.1/servers/c3ad1103-185b-4f84-beb9-e1d0e546b2ed" status: 200 len: 1595 microversion: 2.1 time: 0.161278 Apr 29 08:57:21.024322 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 352/706] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 08:57:20 2022] GET /compute/v2.1/servers/c3ad1103-185b-4f84-beb9-e1d0e546b2ed => generated 1595 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 08:57:23.451315 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [req-0a7dace4-fd8e-4a0c-8449-0adb89adf325 req-bf0f8d6e-e96f-4d8c-8a8c-e1e686247f76 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c3ad1103-185b-4f84-beb9-e1d0e546b2ed", "tag": "69230ee3-728d-4825-9b39-4cb903b621cf"}]} {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 29 08:57:23.460789 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [req-0a7dace4-fd8e-4a0c-8449-0adb89adf325 req-bf0f8d6e-e96f-4d8c-8a8c-e1e686247f76 service nova] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:57:23.461214 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [req-0a7dace4-fd8e-4a0c-8449-0adb89adf325 req-bf0f8d6e-e96f-4d8c-8a8c-e1e686247f76 service nova] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:57:23.474795 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.compute.server_external_events [req-0a7dace4-fd8e-4a0c-8449-0adb89adf325 req-bf0f8d6e-e96f-4d8c-8a8c-e1e686247f76 service nova] Creating event network-changed:69230ee3-728d-4825-9b39-4cb903b621cf for instance c3ad1103-185b-4f84-beb9-e1d0e546b2ed on hv-cinder-83987 Apr 29 08:57:23.481458 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [req-0a7dace4-fd8e-4a0c-8449-0adb89adf325 req-bf0f8d6e-e96f-4d8c-8a8c-e1e686247f76 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.123381 Apr 29 08:57:23.482415 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 355/707] 10.222.0.31 () {64 vars in 1317 bytes} [Fri Apr 29 08:57:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 29 08:57:24.612755 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-bb2f40c3-5c13-4ce1-b30d-45e76b8495fe tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1005192867"}} {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 29 08:57:24.614053 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-bb2f40c3-5c13-4ce1-b30d-45e76b8495fe tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] [instance: c3ad1103-185b-4f84-beb9-e1d0e546b2ed] Fetching instance by UUID {{(pid=123458) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:57:24.623613 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-bb2f40c3-5c13-4ce1-b30d-45e76b8495fe tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:57:24.624066 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-bb2f40c3-5c13-4ce1-b30d-45e76b8495fe tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:57:24.625260 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-bb2f40c3-5c13-4ce1-b30d-45e76b8495fe tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:57:24.625894 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-bb2f40c3-5c13-4ce1-b30d-45e76b8495fe tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:57:24.772473 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.network.security_group_api [None req-bb2f40c3-5c13-4ce1-b30d-45e76b8495fe tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] Adding security group 62934bc3-0993-49cd-9bf9-c9f808b359f6 to port 69230ee3-728d-4825-9b39-4cb903b621cf Apr 29 08:57:25.125763 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-bb2f40c3-5c13-4ce1-b30d-45e76b8495fe tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] 10.222.0.31 "POST /compute/v2.1/servers/c3ad1103-185b-4f84-beb9-e1d0e546b2ed/action" status: 202 len: 0 microversion: 2.1 time: 0.517009 Apr 29 08:57:25.131026 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 353/708] 10.222.0.31 () {60 vars in 1277 bytes} [Fri Apr 29 08:57:24 2022] POST /compute/v2.1/servers/c3ad1103-185b-4f84-beb9-e1d0e546b2ed/action => generated 0 bytes in 520 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 29 08:57:25.137493 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [req-e6d1d48e-3dd5-4cc9-bbea-791f6f66f667 req-18a820df-00d3-4445-988f-1aca4cdd04a9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c3ad1103-185b-4f84-beb9-e1d0e546b2ed", "tag": "69230ee3-728d-4825-9b39-4cb903b621cf"}]} {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 29 08:57:25.138331 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-3a95d34c-f191-4985-bd71-514912ed6aef tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] Calling method '>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:57:25.138954 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-3a95d34c-f191-4985-bd71-514912ed6aef tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] [instance: c3ad1103-185b-4f84-beb9-e1d0e546b2ed] Fetching instance by UUID {{(pid=123458) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:57:25.148245 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [req-e6d1d48e-3dd5-4cc9-bbea-791f6f66f667 req-18a820df-00d3-4445-988f-1aca4cdd04a9 service nova] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:57:25.148706 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [req-e6d1d48e-3dd5-4cc9-bbea-791f6f66f667 req-18a820df-00d3-4445-988f-1aca4cdd04a9 service nova] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:57:25.155089 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-3a95d34c-f191-4985-bd71-514912ed6aef tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:57:25.155546 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-3a95d34c-f191-4985-bd71-514912ed6aef tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:57:25.156781 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-3a95d34c-f191-4985-bd71-514912ed6aef tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:57:25.157373 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-3a95d34c-f191-4985-bd71-514912ed6aef tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:57:25.170283 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.compute.server_external_events [req-e6d1d48e-3dd5-4cc9-bbea-791f6f66f667 req-18a820df-00d3-4445-988f-1aca4cdd04a9 service nova] Creating event network-changed:69230ee3-728d-4825-9b39-4cb903b621cf for instance c3ad1103-185b-4f84-beb9-e1d0e546b2ed on hv-cinder-83987 Apr 29 08:57:25.186075 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [req-e6d1d48e-3dd5-4cc9-bbea-791f6f66f667 req-18a820df-00d3-4445-988f-1aca4cdd04a9 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052368 Apr 29 08:57:25.188165 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 356/709] 10.222.0.31 () {64 vars in 1317 bytes} [Fri Apr 29 08:57:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 29 08:57:25.380507 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-3a95d34c-f191-4985-bd71-514912ed6aef tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5571352a755f45efa76b6720eb81c9c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6abb4912c175406ca0cefd03e327b7f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:57:25.390109 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-3a95d34c-f191-4985-bd71-514912ed6aef tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] 10.222.0.31 "GET /compute/v2.1/servers/c3ad1103-185b-4f84-beb9-e1d0e546b2ed" status: 200 len: 1761 microversion: 2.1 time: 0.257221 Apr 29 08:57:25.390634 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 354/710] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 08:57:25 2022] GET /compute/v2.1/servers/c3ad1103-185b-4f84-beb9-e1d0e546b2ed => generated 1761 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 08:57:27.548620 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-8fd41cd7-7993-4a1d-958c-0adb9b2bce35 tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-531069967", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1636555824", "security_groups": [{"name": "tempest-secgroup-smoke-1667238243"}], "block_device_mapping_v2": [{"uuid": "3ee20dee-5eb4-46a4-9534-200a878651d8", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "1a8d7fea-92bf-4f68-8779-641df4ec3db8"}]}} {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 29 08:57:27.663612 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.network.neutron [None req-8fd41cd7-7993-4a1d-958c-0adb9b2bce35 tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] validate_networks() for [('1a8d7fea-92bf-4f68-8779-641df4ec3db8', None, None, None, None, None)] {{(pid=123459) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 29 08:57:28.024298 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.virt.hardware [None req-8fd41cd7-7993-4a1d-958c-0adb9b2bce35 tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] Flavor limits 0:0:0 {{(pid=123459) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 29 08:57:28.024725 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.virt.hardware [None req-8fd41cd7-7993-4a1d-958c-0adb9b2bce35 tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] Image limits 0:0:0 {{(pid=123459) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 29 08:57:28.025201 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.virt.hardware [None req-8fd41cd7-7993-4a1d-958c-0adb9b2bce35 tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] Flavor pref 0:0:0 {{(pid=123459) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 29 08:57:28.025616 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.virt.hardware [None req-8fd41cd7-7993-4a1d-958c-0adb9b2bce35 tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] Image pref 0:0:0 {{(pid=123459) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 29 08:57:28.026033 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.virt.hardware [None req-8fd41cd7-7993-4a1d-958c-0adb9b2bce35 tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123459) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 29 08:57:28.034667 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-8fd41cd7-7993-4a1d-958c-0adb9b2bce35 tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:57:28.035614 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-8fd41cd7-7993-4a1d-958c-0adb9b2bce35 tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:57:28.036450 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-8fd41cd7-7993-4a1d-958c-0adb9b2bce35 tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:57:28.036892 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-8fd41cd7-7993-4a1d-958c-0adb9b2bce35 tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:57:28.054671 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.quota [None req-8fd41cd7-7993-4a1d-958c-0adb9b2bce35 tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] Getting quotas for project d8dd37ae188e415e86f551e3f760319e. Resources: {'instances', 'cores', 'ram'} {{(pid=123459) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 29 08:57:28.059142 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.quota [None req-8fd41cd7-7993-4a1d-958c-0adb9b2bce35 tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] Getting quotas for user 3a82490fb17d42bf8c19f676fb687033 and project d8dd37ae188e415e86f551e3f760319e. Resources: {'instances', 'cores', 'ram'} {{(pid=123459) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 29 08:57:28.115908 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-8fd41cd7-7993-4a1d-958c-0adb9b2bce35 tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] Going to run 1 instances... {{(pid=123459) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 29 08:57:28.118391 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-8fd41cd7-7993-4a1d-958c-0adb9b2bce35 tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] [instance: 8d96abf8-36ee-48bc-a692-27682f8c1c2e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='3ee20dee-5eb4-46a4-9534-200a878651d8',volume_size=None,volume_type=None)] {{(pid=123459) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 29 08:57:28.253741 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-8fd41cd7-7993-4a1d-958c-0adb9b2bce35 tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] 10.222.0.31 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.709712 Apr 29 08:57:28.255101 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 357/711] 10.222.0.31 () {60 vars in 1146 bytes} [Fri Apr 29 08:57:27 2022] POST /compute/v2.1/servers => generated 406 bytes in 712 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 29 08:57:28.267052 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-18dc22d3-d735-4e81-b411-1488992c9917 tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] Calling method '>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:57:28.267931 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-18dc22d3-d735-4e81-b411-1488992c9917 tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] [instance: 8d96abf8-36ee-48bc-a692-27682f8c1c2e] Fetching instance by UUID {{(pid=123458) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:57:28.327423 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-18dc22d3-d735-4e81-b411-1488992c9917 tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a82490fb17d42bf8c19f676fb687033', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8dd37ae188e415e86f551e3f760319e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:57:28.335162 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-18dc22d3-d735-4e81-b411-1488992c9917 tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] 10.222.0.31 "GET /compute/v2.1/servers/8d96abf8-36ee-48bc-a692-27682f8c1c2e" status: 200 len: 1094 microversion: 2.1 time: 0.073539 Apr 29 08:57:28.335747 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 355/712] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 08:57:28 2022] GET /compute/v2.1/servers/8d96abf8-36ee-48bc-a692-27682f8c1c2e => generated 1094 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 29 08:57:29.353561 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-a3fb28ed-0fa9-40cc-b683-24f81670d5da tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] Calling method '>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:57:29.354159 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-a3fb28ed-0fa9-40cc-b683-24f81670d5da tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] [instance: 8d96abf8-36ee-48bc-a692-27682f8c1c2e] Fetching instance by UUID {{(pid=123459) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:57:29.361111 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-a3fb28ed-0fa9-40cc-b683-24f81670d5da tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:57:29.361560 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-a3fb28ed-0fa9-40cc-b683-24f81670d5da tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:57:29.362350 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-a3fb28ed-0fa9-40cc-b683-24f81670d5da tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:57:29.362783 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-a3fb28ed-0fa9-40cc-b683-24f81670d5da tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:57:29.427587 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-a3fb28ed-0fa9-40cc-b683-24f81670d5da tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a82490fb17d42bf8c19f676fb687033', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8dd37ae188e415e86f551e3f760319e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:57:29.437100 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-a3fb28ed-0fa9-40cc-b683-24f81670d5da tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] 10.222.0.31 "GET /compute/v2.1/servers/8d96abf8-36ee-48bc-a692-27682f8c1c2e" status: 200 len: 1200 microversion: 2.1 time: 0.089050 Apr 29 08:57:29.438093 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 358/713] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 08:57:29 2022] GET /compute/v2.1/servers/8d96abf8-36ee-48bc-a692-27682f8c1c2e => generated 1200 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 08:57:30.461996 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-0aa643b1-db84-484a-88ef-42de4864598d tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] Calling method '>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:57:30.462696 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-0aa643b1-db84-484a-88ef-42de4864598d tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] [instance: 8d96abf8-36ee-48bc-a692-27682f8c1c2e] Fetching instance by UUID {{(pid=123458) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:57:30.470303 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-0aa643b1-db84-484a-88ef-42de4864598d tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:57:30.470756 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-0aa643b1-db84-484a-88ef-42de4864598d tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:57:30.471860 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-0aa643b1-db84-484a-88ef-42de4864598d tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:57:30.472336 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-0aa643b1-db84-484a-88ef-42de4864598d tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:57:30.709690 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-0aa643b1-db84-484a-88ef-42de4864598d tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a82490fb17d42bf8c19f676fb687033', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8dd37ae188e415e86f551e3f760319e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:57:30.720245 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-0aa643b1-db84-484a-88ef-42de4864598d tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] 10.222.0.31 "GET /compute/v2.1/servers/8d96abf8-36ee-48bc-a692-27682f8c1c2e" status: 200 len: 1266 microversion: 2.1 time: 0.261948 Apr 29 08:57:30.721043 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 356/714] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 08:57:30 2022] GET /compute/v2.1/servers/8d96abf8-36ee-48bc-a692-27682f8c1c2e => generated 1266 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 08:57:31.016532 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [req-ac5b6426-1a02-4146-b4d2-2e3c5b938317 req-120fd32b-7bd1-455a-b805-0bfd96e86b33 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8d96abf8-36ee-48bc-a692-27682f8c1c2e", "tag": "7fcb9366-b893-4162-8459-0a266ed77525"}]} {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 29 08:57:31.028150 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [req-ac5b6426-1a02-4146-b4d2-2e3c5b938317 req-120fd32b-7bd1-455a-b805-0bfd96e86b33 service nova] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:57:31.028932 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [req-ac5b6426-1a02-4146-b4d2-2e3c5b938317 req-120fd32b-7bd1-455a-b805-0bfd96e86b33 service nova] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:57:31.043855 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.compute.server_external_events [req-ac5b6426-1a02-4146-b4d2-2e3c5b938317 req-120fd32b-7bd1-455a-b805-0bfd96e86b33 service nova] Creating event network-changed:7fcb9366-b893-4162-8459-0a266ed77525 for instance 8d96abf8-36ee-48bc-a692-27682f8c1c2e on hv-cinder-83987 Apr 29 08:57:31.050570 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [req-ac5b6426-1a02-4146-b4d2-2e3c5b938317 req-120fd32b-7bd1-455a-b805-0bfd96e86b33 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038160 Apr 29 08:57:31.051401 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 359/715] 10.222.0.31 () {64 vars in 1317 bytes} [Fri Apr 29 08:57:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 29 08:57:31.746783 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-0774fa6d-f5a9-4614-86a9-093e08ab5a31 tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] Calling method '>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:57:31.747421 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-0774fa6d-f5a9-4614-86a9-093e08ab5a31 tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] [instance: 8d96abf8-36ee-48bc-a692-27682f8c1c2e] Fetching instance by UUID {{(pid=123458) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:57:31.754277 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-0774fa6d-f5a9-4614-86a9-093e08ab5a31 tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:57:31.755677 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-0774fa6d-f5a9-4614-86a9-093e08ab5a31 tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:57:31.756256 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-0774fa6d-f5a9-4614-86a9-093e08ab5a31 tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:57:31.756705 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-0774fa6d-f5a9-4614-86a9-093e08ab5a31 tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:57:31.892016 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-0774fa6d-f5a9-4614-86a9-093e08ab5a31 tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a82490fb17d42bf8c19f676fb687033', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8dd37ae188e415e86f551e3f760319e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:57:31.900413 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-0774fa6d-f5a9-4614-86a9-093e08ab5a31 tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] 10.222.0.31 "GET /compute/v2.1/servers/8d96abf8-36ee-48bc-a692-27682f8c1c2e" status: 200 len: 1266 microversion: 2.1 time: 0.157360 Apr 29 08:57:31.900998 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 357/716] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 08:57:31 2022] GET /compute/v2.1/servers/8d96abf8-36ee-48bc-a692-27682f8c1c2e => generated 1266 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 29 08:57:32.918823 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-38367c44-2b87-42ac-9631-b603e445a884 tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] Calling method '>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:57:32.919560 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-38367c44-2b87-42ac-9631-b603e445a884 tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] [instance: 8d96abf8-36ee-48bc-a692-27682f8c1c2e] Fetching instance by UUID {{(pid=123459) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:57:32.927141 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-38367c44-2b87-42ac-9631-b603e445a884 tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:57:32.927700 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-38367c44-2b87-42ac-9631-b603e445a884 tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:57:32.928518 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-38367c44-2b87-42ac-9631-b603e445a884 tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:57:32.929018 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-38367c44-2b87-42ac-9631-b603e445a884 tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:57:33.064905 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-38367c44-2b87-42ac-9631-b603e445a884 tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a82490fb17d42bf8c19f676fb687033', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8dd37ae188e415e86f551e3f760319e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:57:33.073405 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-38367c44-2b87-42ac-9631-b603e445a884 tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] 10.222.0.31 "GET /compute/v2.1/servers/8d96abf8-36ee-48bc-a692-27682f8c1c2e" status: 200 len: 1266 microversion: 2.1 time: 0.159643 Apr 29 08:57:33.074094 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 360/717] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 08:57:32 2022] GET /compute/v2.1/servers/8d96abf8-36ee-48bc-a692-27682f8c1c2e => generated 1266 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 08:57:34.091218 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-671b8ef1-9fdc-4c6a-825c-bc3f156d6385 tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] Calling method '>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:57:34.091823 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-671b8ef1-9fdc-4c6a-825c-bc3f156d6385 tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] [instance: 8d96abf8-36ee-48bc-a692-27682f8c1c2e] Fetching instance by UUID {{(pid=123458) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:57:34.098453 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-671b8ef1-9fdc-4c6a-825c-bc3f156d6385 tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:57:34.098900 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-671b8ef1-9fdc-4c6a-825c-bc3f156d6385 tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:57:34.099669 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-671b8ef1-9fdc-4c6a-825c-bc3f156d6385 tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:57:34.100100 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-671b8ef1-9fdc-4c6a-825c-bc3f156d6385 tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:57:34.230678 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-671b8ef1-9fdc-4c6a-825c-bc3f156d6385 tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a82490fb17d42bf8c19f676fb687033', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8dd37ae188e415e86f551e3f760319e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:57:34.238254 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-671b8ef1-9fdc-4c6a-825c-bc3f156d6385 tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] 10.222.0.31 "GET /compute/v2.1/servers/8d96abf8-36ee-48bc-a692-27682f8c1c2e" status: 200 len: 1266 microversion: 2.1 time: 0.150883 Apr 29 08:57:34.239438 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 358/718] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 08:57:34 2022] GET /compute/v2.1/servers/8d96abf8-36ee-48bc-a692-27682f8c1c2e => generated 1266 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 08:57:35.258306 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-6fd5bf4f-2bb0-4984-b180-0e671ecaee87 tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] Calling method '>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:57:35.259066 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-6fd5bf4f-2bb0-4984-b180-0e671ecaee87 tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] [instance: 8d96abf8-36ee-48bc-a692-27682f8c1c2e] Fetching instance by UUID {{(pid=123459) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:57:35.266157 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-6fd5bf4f-2bb0-4984-b180-0e671ecaee87 tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:57:35.266607 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-6fd5bf4f-2bb0-4984-b180-0e671ecaee87 tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:57:35.267407 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-6fd5bf4f-2bb0-4984-b180-0e671ecaee87 tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:57:35.267845 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-6fd5bf4f-2bb0-4984-b180-0e671ecaee87 tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:57:35.414206 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-6fd5bf4f-2bb0-4984-b180-0e671ecaee87 tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a82490fb17d42bf8c19f676fb687033', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8dd37ae188e415e86f551e3f760319e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:57:35.421874 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-6fd5bf4f-2bb0-4984-b180-0e671ecaee87 tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] 10.222.0.31 "GET /compute/v2.1/servers/8d96abf8-36ee-48bc-a692-27682f8c1c2e" status: 200 len: 1266 microversion: 2.1 time: 0.168782 Apr 29 08:57:35.422823 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 361/719] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 08:57:35 2022] GET /compute/v2.1/servers/8d96abf8-36ee-48bc-a692-27682f8c1c2e => generated 1266 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 08:57:36.440918 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-18ea074d-58f6-4f60-b9f3-1f5ddcdd411d tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] Calling method '>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:57:36.441579 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-18ea074d-58f6-4f60-b9f3-1f5ddcdd411d tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] [instance: 8d96abf8-36ee-48bc-a692-27682f8c1c2e] Fetching instance by UUID {{(pid=123458) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:57:36.449053 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-18ea074d-58f6-4f60-b9f3-1f5ddcdd411d tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:57:36.449053 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-18ea074d-58f6-4f60-b9f3-1f5ddcdd411d tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:57:36.449681 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-18ea074d-58f6-4f60-b9f3-1f5ddcdd411d tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:57:36.450114 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-18ea074d-58f6-4f60-b9f3-1f5ddcdd411d tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:57:36.595545 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-18ea074d-58f6-4f60-b9f3-1f5ddcdd411d tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a82490fb17d42bf8c19f676fb687033', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8dd37ae188e415e86f551e3f760319e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:57:36.604006 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-18ea074d-58f6-4f60-b9f3-1f5ddcdd411d tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] 10.222.0.31 "GET /compute/v2.1/servers/8d96abf8-36ee-48bc-a692-27682f8c1c2e" status: 200 len: 1266 microversion: 2.1 time: 0.167914 Apr 29 08:57:36.604640 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 359/720] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 08:57:36 2022] GET /compute/v2.1/servers/8d96abf8-36ee-48bc-a692-27682f8c1c2e => generated 1266 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 08:57:37.624066 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-63acc237-6084-430f-aea6-4ba206f2f7a4 tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] Calling method '>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:57:37.625269 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-63acc237-6084-430f-aea6-4ba206f2f7a4 tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] [instance: 8d96abf8-36ee-48bc-a692-27682f8c1c2e] Fetching instance by UUID {{(pid=123459) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:57:37.635695 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-63acc237-6084-430f-aea6-4ba206f2f7a4 tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:57:37.636156 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-63acc237-6084-430f-aea6-4ba206f2f7a4 tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:57:37.637039 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-63acc237-6084-430f-aea6-4ba206f2f7a4 tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:57:37.637491 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-63acc237-6084-430f-aea6-4ba206f2f7a4 tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:57:37.771506 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-63acc237-6084-430f-aea6-4ba206f2f7a4 tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a82490fb17d42bf8c19f676fb687033', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8dd37ae188e415e86f551e3f760319e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:57:37.779357 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-63acc237-6084-430f-aea6-4ba206f2f7a4 tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] 10.222.0.31 "GET /compute/v2.1/servers/8d96abf8-36ee-48bc-a692-27682f8c1c2e" status: 200 len: 1266 microversion: 2.1 time: 0.161468 Apr 29 08:57:37.779924 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 362/721] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 08:57:37 2022] GET /compute/v2.1/servers/8d96abf8-36ee-48bc-a692-27682f8c1c2e => generated 1266 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 08:57:38.795999 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-4f2e7e9e-0cca-4370-abd1-fe62b655197b tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] Calling method '>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:57:38.796643 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-4f2e7e9e-0cca-4370-abd1-fe62b655197b tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] [instance: 8d96abf8-36ee-48bc-a692-27682f8c1c2e] Fetching instance by UUID {{(pid=123458) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:57:38.803793 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-4f2e7e9e-0cca-4370-abd1-fe62b655197b tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:57:38.804274 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-4f2e7e9e-0cca-4370-abd1-fe62b655197b tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:57:38.805068 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-4f2e7e9e-0cca-4370-abd1-fe62b655197b tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:57:38.805506 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-4f2e7e9e-0cca-4370-abd1-fe62b655197b tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:57:38.940957 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-4f2e7e9e-0cca-4370-abd1-fe62b655197b tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a82490fb17d42bf8c19f676fb687033', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8dd37ae188e415e86f551e3f760319e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:57:38.949259 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-4f2e7e9e-0cca-4370-abd1-fe62b655197b tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] 10.222.0.31 "GET /compute/v2.1/servers/8d96abf8-36ee-48bc-a692-27682f8c1c2e" status: 200 len: 1266 microversion: 2.1 time: 0.157099 Apr 29 08:57:38.949825 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 360/722] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 08:57:38 2022] GET /compute/v2.1/servers/8d96abf8-36ee-48bc-a692-27682f8c1c2e => generated 1266 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 08:57:39.968558 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-d2043b8e-efa7-4eb4-b46d-a71f6b0a3d90 tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] Calling method '>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:57:39.969559 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-d2043b8e-efa7-4eb4-b46d-a71f6b0a3d90 tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] [instance: 8d96abf8-36ee-48bc-a692-27682f8c1c2e] Fetching instance by UUID {{(pid=123459) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:57:39.978662 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-d2043b8e-efa7-4eb4-b46d-a71f6b0a3d90 tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:57:39.979316 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-d2043b8e-efa7-4eb4-b46d-a71f6b0a3d90 tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:57:39.980525 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-d2043b8e-efa7-4eb4-b46d-a71f6b0a3d90 tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:57:39.981185 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-d2043b8e-efa7-4eb4-b46d-a71f6b0a3d90 tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:57:40.126545 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-d2043b8e-efa7-4eb4-b46d-a71f6b0a3d90 tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a82490fb17d42bf8c19f676fb687033', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8dd37ae188e415e86f551e3f760319e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:57:40.133902 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-d2043b8e-efa7-4eb4-b46d-a71f6b0a3d90 tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] 10.222.0.31 "GET /compute/v2.1/servers/8d96abf8-36ee-48bc-a692-27682f8c1c2e" status: 200 len: 1266 microversion: 2.1 time: 0.170754 Apr 29 08:57:40.134474 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 363/723] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 08:57:39 2022] GET /compute/v2.1/servers/8d96abf8-36ee-48bc-a692-27682f8c1c2e => generated 1266 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 08:57:41.150856 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-031128a2-0dda-4b52-af1b-089c12d835e8 tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] Calling method '>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:57:41.151482 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-031128a2-0dda-4b52-af1b-089c12d835e8 tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] [instance: 8d96abf8-36ee-48bc-a692-27682f8c1c2e] Fetching instance by UUID {{(pid=123458) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:57:41.157991 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-031128a2-0dda-4b52-af1b-089c12d835e8 tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:57:41.158435 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-031128a2-0dda-4b52-af1b-089c12d835e8 tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:57:41.159214 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-031128a2-0dda-4b52-af1b-089c12d835e8 tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:57:41.159660 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-031128a2-0dda-4b52-af1b-089c12d835e8 tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:57:41.291162 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-031128a2-0dda-4b52-af1b-089c12d835e8 tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a82490fb17d42bf8c19f676fb687033', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8dd37ae188e415e86f551e3f760319e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:57:41.298751 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-031128a2-0dda-4b52-af1b-089c12d835e8 tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] 10.222.0.31 "GET /compute/v2.1/servers/8d96abf8-36ee-48bc-a692-27682f8c1c2e" status: 200 len: 1266 microversion: 2.1 time: 0.151697 Apr 29 08:57:41.299327 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 361/724] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 08:57:41 2022] GET /compute/v2.1/servers/8d96abf8-36ee-48bc-a692-27682f8c1c2e => generated 1266 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 08:57:42.074778 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [req-940f531d-8d57-42d2-a9a2-ee8b5e84eade req-715dc55e-9533-4da5-af60-d0ebb3ed13e8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8d96abf8-36ee-48bc-a692-27682f8c1c2e", "name": "network-vif-plugged", "status": "completed", "tag": "7fcb9366-b893-4162-8459-0a266ed77525"}]} {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 29 08:57:42.085400 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [req-940f531d-8d57-42d2-a9a2-ee8b5e84eade req-715dc55e-9533-4da5-af60-d0ebb3ed13e8 service nova] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:57:42.085858 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [req-940f531d-8d57-42d2-a9a2-ee8b5e84eade req-715dc55e-9533-4da5-af60-d0ebb3ed13e8 service nova] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:57:42.098661 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.compute.server_external_events [req-940f531d-8d57-42d2-a9a2-ee8b5e84eade req-715dc55e-9533-4da5-af60-d0ebb3ed13e8 service nova] Creating event network-vif-plugged:7fcb9366-b893-4162-8459-0a266ed77525 for instance 8d96abf8-36ee-48bc-a692-27682f8c1c2e on hv-cinder-83987 Apr 29 08:57:42.104830 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [req-940f531d-8d57-42d2-a9a2-ee8b5e84eade req-715dc55e-9533-4da5-af60-d0ebb3ed13e8 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033649 Apr 29 08:57:42.105620 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 364/725] 10.222.0.31 () {64 vars in 1317 bytes} [Fri Apr 29 08:57:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 29 08:57:42.317193 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-5d034787-7200-449e-8197-b595d51ed433 tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] Calling method '>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:57:42.317955 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-5d034787-7200-449e-8197-b595d51ed433 tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] [instance: 8d96abf8-36ee-48bc-a692-27682f8c1c2e] Fetching instance by UUID {{(pid=123458) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:57:42.325158 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-5d034787-7200-449e-8197-b595d51ed433 tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:57:42.325549 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-5d034787-7200-449e-8197-b595d51ed433 tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:57:42.326312 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-5d034787-7200-449e-8197-b595d51ed433 tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:57:42.326744 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-5d034787-7200-449e-8197-b595d51ed433 tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:57:42.521962 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-5d034787-7200-449e-8197-b595d51ed433 tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a82490fb17d42bf8c19f676fb687033', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8dd37ae188e415e86f551e3f760319e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:57:42.529438 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-5d034787-7200-449e-8197-b595d51ed433 tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] 10.222.0.31 "GET /compute/v2.1/servers/8d96abf8-36ee-48bc-a692-27682f8c1c2e" status: 200 len: 1266 microversion: 2.1 time: 0.216687 Apr 29 08:57:42.530107 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 362/726] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 08:57:42 2022] GET /compute/v2.1/servers/8d96abf8-36ee-48bc-a692-27682f8c1c2e => generated 1266 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 08:57:43.547580 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-b55c93d5-5fc8-4f61-b8b2-bbebb5d53228 tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] Calling method '>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:57:43.548391 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-b55c93d5-5fc8-4f61-b8b2-bbebb5d53228 tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] [instance: 8d96abf8-36ee-48bc-a692-27682f8c1c2e] Fetching instance by UUID {{(pid=123459) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:57:43.554738 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-b55c93d5-5fc8-4f61-b8b2-bbebb5d53228 tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:57:43.555184 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-b55c93d5-5fc8-4f61-b8b2-bbebb5d53228 tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:57:43.555950 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-b55c93d5-5fc8-4f61-b8b2-bbebb5d53228 tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:57:43.556421 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-b55c93d5-5fc8-4f61-b8b2-bbebb5d53228 tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:57:43.694598 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-b55c93d5-5fc8-4f61-b8b2-bbebb5d53228 tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a82490fb17d42bf8c19f676fb687033', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8dd37ae188e415e86f551e3f760319e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:57:43.702432 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-b55c93d5-5fc8-4f61-b8b2-bbebb5d53228 tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] 10.222.0.31 "GET /compute/v2.1/servers/8d96abf8-36ee-48bc-a692-27682f8c1c2e" status: 200 len: 1266 microversion: 2.1 time: 0.159388 Apr 29 08:57:43.703046 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 365/727] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 08:57:43 2022] GET /compute/v2.1/servers/8d96abf8-36ee-48bc-a692-27682f8c1c2e => generated 1266 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 08:57:44.720732 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-1e8e6b09-892b-468d-8a04-42c0c2903193 tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] Calling method '>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:57:44.721428 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-1e8e6b09-892b-468d-8a04-42c0c2903193 tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] [instance: 8d96abf8-36ee-48bc-a692-27682f8c1c2e] Fetching instance by UUID {{(pid=123458) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:57:44.728218 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-1e8e6b09-892b-468d-8a04-42c0c2903193 tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:57:44.728677 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-1e8e6b09-892b-468d-8a04-42c0c2903193 tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:57:44.729459 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-1e8e6b09-892b-468d-8a04-42c0c2903193 tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:57:44.729897 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-1e8e6b09-892b-468d-8a04-42c0c2903193 tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:57:44.871598 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-1e8e6b09-892b-468d-8a04-42c0c2903193 tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a82490fb17d42bf8c19f676fb687033', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8dd37ae188e415e86f551e3f760319e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:57:44.879744 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-1e8e6b09-892b-468d-8a04-42c0c2903193 tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] 10.222.0.31 "GET /compute/v2.1/servers/8d96abf8-36ee-48bc-a692-27682f8c1c2e" status: 200 len: 1453 microversion: 2.1 time: 0.162147 Apr 29 08:57:44.880424 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 363/728] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 08:57:44 2022] GET /compute/v2.1/servers/8d96abf8-36ee-48bc-a692-27682f8c1c2e => generated 1453 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 08:57:44.896583 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-bf4d46a0-0c5b-4de5-a344-c5491ac60977 tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] Calling method '>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:57:44.897217 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-bf4d46a0-0c5b-4de5-a344-c5491ac60977 tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] [instance: 8d96abf8-36ee-48bc-a692-27682f8c1c2e] Fetching instance by UUID {{(pid=123459) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:57:44.903561 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-bf4d46a0-0c5b-4de5-a344-c5491ac60977 tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:57:44.904011 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-bf4d46a0-0c5b-4de5-a344-c5491ac60977 tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:57:44.904811 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-bf4d46a0-0c5b-4de5-a344-c5491ac60977 tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:57:44.905378 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-bf4d46a0-0c5b-4de5-a344-c5491ac60977 tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:57:45.040341 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-bf4d46a0-0c5b-4de5-a344-c5491ac60977 tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a82490fb17d42bf8c19f676fb687033', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8dd37ae188e415e86f551e3f760319e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:57:45.047924 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-bf4d46a0-0c5b-4de5-a344-c5491ac60977 tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] 10.222.0.31 "GET /compute/v2.1/servers/8d96abf8-36ee-48bc-a692-27682f8c1c2e" status: 200 len: 1453 microversion: 2.1 time: 0.156038 Apr 29 08:57:45.048525 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 366/729] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 08:57:44 2022] GET /compute/v2.1/servers/8d96abf8-36ee-48bc-a692-27682f8c1c2e => generated 1453 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 08:57:47.002367 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [req-03ba97e2-b35b-4f5c-9384-2544878f0f7a req-e294ac28-7905-43c3-83bd-da16b4626ac9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8d96abf8-36ee-48bc-a692-27682f8c1c2e", "tag": "7fcb9366-b893-4162-8459-0a266ed77525"}]} {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 29 08:57:47.011653 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [req-03ba97e2-b35b-4f5c-9384-2544878f0f7a req-e294ac28-7905-43c3-83bd-da16b4626ac9 service nova] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:57:47.012091 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [req-03ba97e2-b35b-4f5c-9384-2544878f0f7a req-e294ac28-7905-43c3-83bd-da16b4626ac9 service nova] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:57:47.023748 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.compute.server_external_events [req-03ba97e2-b35b-4f5c-9384-2544878f0f7a req-e294ac28-7905-43c3-83bd-da16b4626ac9 service nova] Creating event network-changed:7fcb9366-b893-4162-8459-0a266ed77525 for instance 8d96abf8-36ee-48bc-a692-27682f8c1c2e on hv-cinder-83987 Apr 29 08:57:47.028878 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [req-03ba97e2-b35b-4f5c-9384-2544878f0f7a req-e294ac28-7905-43c3-83bd-da16b4626ac9 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030176 Apr 29 08:57:47.029468 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 364/730] 10.222.0.31 () {64 vars in 1317 bytes} [Fri Apr 29 08:57:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 29 08:57:55.114344 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 29 08:57:55.115087 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: Fri Apr 29 08:57:55 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 29 08:58:00.549300 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-85941bc5-d67f-4295-b1cc-0cfefee7005c tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Calling method '>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:58:00.549894 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-85941bc5-d67f-4295-b1cc-0cfefee7005c tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] [instance: 21ab666e-c39f-4202-9e7a-aa431a96a130] Fetching instance by UUID {{(pid=123459) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:58:00.557257 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-85941bc5-d67f-4295-b1cc-0cfefee7005c tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:58:00.557705 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-85941bc5-d67f-4295-b1cc-0cfefee7005c tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:58:00.558492 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-85941bc5-d67f-4295-b1cc-0cfefee7005c tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:58:00.558922 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-85941bc5-d67f-4295-b1cc-0cfefee7005c tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:58:00.581706 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-85941bc5-d67f-4295-b1cc-0cfefee7005c tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] 10.222.0.31 "GET /compute/v2.1/servers/21ab666e-c39f-4202-9e7a-aa431a96a130/ips" status: 200 len: 150 microversion: 2.1 time: 0.138034 Apr 29 08:58:00.582254 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 367/731] 10.222.0.31 () {58 vars in 1247 bytes} [Fri Apr 29 08:58:00 2022] GET /compute/v2.1/servers/21ab666e-c39f-4202-9e7a-aa431a96a130/ips => generated 150 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 29 08:58:00.594182 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-f6a442a6-4cf5-4ca3-a073-92e270923706 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "af72dd7a-5864-4258-8196-4826f92aa0d4"}} {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 29 08:58:00.595375 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-f6a442a6-4cf5-4ca3-a073-92e270923706 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] [instance: 21ab666e-c39f-4202-9e7a-aa431a96a130] Fetching instance by UUID {{(pid=123458) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:58:00.602802 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-f6a442a6-4cf5-4ca3-a073-92e270923706 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:58:00.603250 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-f6a442a6-4cf5-4ca3-a073-92e270923706 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:58:00.604026 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-f6a442a6-4cf5-4ca3-a073-92e270923706 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:58:00.604573 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-f6a442a6-4cf5-4ca3-a073-92e270923706 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:58:00.682746 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.wsgi [None req-f6a442a6-4cf5-4ca3-a073-92e270923706 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] HTTP exception thrown: Invalid volume: volume af72dd7a-5864-4258-8196-4826f92aa0d4 is already attached to instances: 0f9c17b6-b1a2-4ec6-ba8c-2097a8c8ccb7 Apr 29 08:58:00.683349 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-f6a442a6-4cf5-4ca3-a073-92e270923706 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Returning 400 to user: Invalid volume: volume af72dd7a-5864-4258-8196-4826f92aa0d4 is already attached to instances: 0f9c17b6-b1a2-4ec6-ba8c-2097a8c8ccb7 {{(pid=123458) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 29 08:58:00.684219 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-f6a442a6-4cf5-4ca3-a073-92e270923706 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] 10.222.0.31 "POST /compute/v2.1/servers/21ab666e-c39f-4202-9e7a-aa431a96a130/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.094879 Apr 29 08:58:00.684772 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 365/732] 10.222.0.31 () {60 vars in 1322 bytes} [Fri Apr 29 08:58:00 2022] POST /compute/v2.1/servers/21ab666e-c39f-4202-9e7a-aa431a96a130/os-volume_attachments => generated 174 bytes in 96 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 29 08:58:00.693003 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-ec2de970-5ebc-4e44-8579-133c55fb2baa tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Calling method '>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:58:00.693507 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-ec2de970-5ebc-4e44-8579-133c55fb2baa tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] [instance: 21ab666e-c39f-4202-9e7a-aa431a96a130] Fetching instance by UUID {{(pid=123459) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:58:00.700295 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-ec2de970-5ebc-4e44-8579-133c55fb2baa tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:58:00.700675 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-ec2de970-5ebc-4e44-8579-133c55fb2baa tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:58:00.701464 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-ec2de970-5ebc-4e44-8579-133c55fb2baa tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:58:00.701903 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-ec2de970-5ebc-4e44-8579-133c55fb2baa tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:58:00.729418 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-ec2de970-5ebc-4e44-8579-133c55fb2baa tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] [instance: 21ab666e-c39f-4202-9e7a-aa431a96a130] Going to try to terminate instance {{(pid=123459) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 29 08:58:00.806318 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-ec2de970-5ebc-4e44-8579-133c55fb2baa tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] 10.222.0.31 "DELETE /compute/v2.1/servers/21ab666e-c39f-4202-9e7a-aa431a96a130" status: 204 len: 0 microversion: 2.1 time: 0.116811 Apr 29 08:58:00.807092 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 368/733] 10.222.0.31 () {58 vars in 1238 bytes} [Fri Apr 29 08:58:00 2022] DELETE /compute/v2.1/servers/21ab666e-c39f-4202-9e7a-aa431a96a130 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 29 08:58:00.815922 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-53953738-0886-4478-8d8c-63d16a481aa0 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Calling method '>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:58:00.817429 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-53953738-0886-4478-8d8c-63d16a481aa0 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] [instance: 21ab666e-c39f-4202-9e7a-aa431a96a130] Fetching instance by UUID {{(pid=123458) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:58:00.824328 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-53953738-0886-4478-8d8c-63d16a481aa0 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:58:00.824775 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-53953738-0886-4478-8d8c-63d16a481aa0 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:58:00.825540 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-53953738-0886-4478-8d8c-63d16a481aa0 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:58:00.825971 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-53953738-0886-4478-8d8c-63d16a481aa0 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:58:00.955770 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-53953738-0886-4478-8d8c-63d16a481aa0 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e47ecdfb01f447699275b13255c15d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578e6a35974d4e5c8a0cd4e5fa994259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:58:00.963865 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-53953738-0886-4478-8d8c-63d16a481aa0 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] 10.222.0.31 "GET /compute/v2.1/servers/21ab666e-c39f-4202-9e7a-aa431a96a130" status: 200 len: 1682 microversion: 2.1 time: 0.152673 Apr 29 08:58:00.964468 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 366/734] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 08:58:00 2022] GET /compute/v2.1/servers/21ab666e-c39f-4202-9e7a-aa431a96a130 => generated 1682 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 08:58:01.984059 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-bbe3c8ed-d89a-42ff-8db1-9960e7ce12d3 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Calling method '>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:58:01.984783 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-bbe3c8ed-d89a-42ff-8db1-9960e7ce12d3 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] [instance: 21ab666e-c39f-4202-9e7a-aa431a96a130] Fetching instance by UUID {{(pid=123459) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:58:01.992312 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-bbe3c8ed-d89a-42ff-8db1-9960e7ce12d3 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:58:01.992753 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-bbe3c8ed-d89a-42ff-8db1-9960e7ce12d3 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:58:01.993517 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-bbe3c8ed-d89a-42ff-8db1-9960e7ce12d3 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:58:01.993948 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-bbe3c8ed-d89a-42ff-8db1-9960e7ce12d3 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:58:02.142694 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-bbe3c8ed-d89a-42ff-8db1-9960e7ce12d3 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e47ecdfb01f447699275b13255c15d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578e6a35974d4e5c8a0cd4e5fa994259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:58:02.151638 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-bbe3c8ed-d89a-42ff-8db1-9960e7ce12d3 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] 10.222.0.31 "GET /compute/v2.1/servers/21ab666e-c39f-4202-9e7a-aa431a96a130" status: 200 len: 1682 microversion: 2.1 time: 0.172500 Apr 29 08:58:02.152473 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 369/735] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 08:58:01 2022] GET /compute/v2.1/servers/21ab666e-c39f-4202-9e7a-aa431a96a130 => generated 1682 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 08:58:03.170744 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-7d21e7d0-5b49-4529-b805-35cb7d624fa9 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Calling method '>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:58:03.171332 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-7d21e7d0-5b49-4529-b805-35cb7d624fa9 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] [instance: 21ab666e-c39f-4202-9e7a-aa431a96a130] Fetching instance by UUID {{(pid=123458) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:58:03.178748 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-7d21e7d0-5b49-4529-b805-35cb7d624fa9 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:58:03.179258 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-7d21e7d0-5b49-4529-b805-35cb7d624fa9 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:58:03.180092 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-7d21e7d0-5b49-4529-b805-35cb7d624fa9 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:58:03.180553 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-7d21e7d0-5b49-4529-b805-35cb7d624fa9 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:58:03.390589 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-7d21e7d0-5b49-4529-b805-35cb7d624fa9 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e47ecdfb01f447699275b13255c15d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578e6a35974d4e5c8a0cd4e5fa994259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:58:03.399063 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-7d21e7d0-5b49-4529-b805-35cb7d624fa9 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] 10.222.0.31 "GET /compute/v2.1/servers/21ab666e-c39f-4202-9e7a-aa431a96a130" status: 200 len: 1682 microversion: 2.1 time: 0.232263 Apr 29 08:58:03.399648 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 367/736] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 08:58:03 2022] GET /compute/v2.1/servers/21ab666e-c39f-4202-9e7a-aa431a96a130 => generated 1682 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 08:58:03.848889 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [req-a9bc96e2-8d2d-4474-a077-d7a714494df7 req-63fd6be1-6eab-4ba0-9af8-4a658c1e9a4e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "21ab666e-c39f-4202-9e7a-aa431a96a130", "name": "network-vif-deleted", "tag": "9e72371e-8d60-4d5c-8356-4c1a4228bf38"}]} {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 29 08:58:03.860572 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [req-a9bc96e2-8d2d-4474-a077-d7a714494df7 req-63fd6be1-6eab-4ba0-9af8-4a658c1e9a4e service nova] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:58:03.861135 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [req-a9bc96e2-8d2d-4474-a077-d7a714494df7 req-63fd6be1-6eab-4ba0-9af8-4a658c1e9a4e service nova] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:58:03.887865 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.compute.server_external_events [req-a9bc96e2-8d2d-4474-a077-d7a714494df7 req-63fd6be1-6eab-4ba0-9af8-4a658c1e9a4e service nova] Creating event network-vif-deleted:9e72371e-8d60-4d5c-8356-4c1a4228bf38 for instance 21ab666e-c39f-4202-9e7a-aa431a96a130 on hv-cinder-83987 Apr 29 08:58:03.897845 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [req-a9bc96e2-8d2d-4474-a077-d7a714494df7 req-63fd6be1-6eab-4ba0-9af8-4a658c1e9a4e service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053003 Apr 29 08:58:03.899134 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 370/737] 10.222.0.31 () {64 vars in 1317 bytes} [Fri Apr 29 08:58:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 29 08:58:04.418143 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-db185c5e-395c-4531-98be-47981d1a4e81 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Calling method '>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:58:04.419157 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-db185c5e-395c-4531-98be-47981d1a4e81 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] [instance: 21ab666e-c39f-4202-9e7a-aa431a96a130] Fetching instance by UUID {{(pid=123458) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:58:04.428148 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-db185c5e-395c-4531-98be-47981d1a4e81 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:58:04.429018 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-db185c5e-395c-4531-98be-47981d1a4e81 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:58:04.429925 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-db185c5e-395c-4531-98be-47981d1a4e81 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:58:04.431297 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-db185c5e-395c-4531-98be-47981d1a4e81 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:58:04.469669 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-db185c5e-395c-4531-98be-47981d1a4e81 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:58:04.471555 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-db185c5e-395c-4531-98be-47981d1a4e81 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:58:04.472560 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.objects.instance [None req-db185c5e-395c-4531-98be-47981d1a4e81 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lazy-loading 'fault' on Instance uuid 21ab666e-c39f-4202-9e7a-aa431a96a130 {{(pid=123458) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 29 08:58:04.529609 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-db185c5e-395c-4531-98be-47981d1a4e81 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e47ecdfb01f447699275b13255c15d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578e6a35974d4e5c8a0cd4e5fa994259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:58:04.536421 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-db185c5e-395c-4531-98be-47981d1a4e81 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] 10.222.0.31 "GET /compute/v2.1/servers/21ab666e-c39f-4202-9e7a-aa431a96a130" status: 200 len: 1332 microversion: 2.1 time: 0.122353 Apr 29 08:58:04.537818 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 368/738] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 08:58:04 2022] GET /compute/v2.1/servers/21ab666e-c39f-4202-9e7a-aa431a96a130 => generated 1332 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 08:58:05.555024 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-89d9eec9-f9a8-45bc-b512-73cac1f687b9 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Calling method '>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:58:05.555858 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-89d9eec9-f9a8-45bc-b512-73cac1f687b9 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] [instance: 21ab666e-c39f-4202-9e7a-aa431a96a130] Fetching instance by UUID {{(pid=123459) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:58:05.562672 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-89d9eec9-f9a8-45bc-b512-73cac1f687b9 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:58:05.563415 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-89d9eec9-f9a8-45bc-b512-73cac1f687b9 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:58:05.564227 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-89d9eec9-f9a8-45bc-b512-73cac1f687b9 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:58:05.564669 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-89d9eec9-f9a8-45bc-b512-73cac1f687b9 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:58:05.579401 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.wsgi [None req-89d9eec9-f9a8-45bc-b512-73cac1f687b9 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] HTTP exception thrown: Instance 21ab666e-c39f-4202-9e7a-aa431a96a130 could not be found. Apr 29 08:58:05.579995 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-89d9eec9-f9a8-45bc-b512-73cac1f687b9 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Returning 404 to user: Instance 21ab666e-c39f-4202-9e7a-aa431a96a130 could not be found. {{(pid=123459) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 29 08:58:05.580870 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-89d9eec9-f9a8-45bc-b512-73cac1f687b9 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] 10.222.0.31 "GET /compute/v2.1/servers/21ab666e-c39f-4202-9e7a-aa431a96a130" status: 404 len: 111 microversion: 2.1 time: 0.030332 Apr 29 08:58:05.581434 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 371/739] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 08:58:05 2022] GET /compute/v2.1/servers/21ab666e-c39f-4202-9e7a-aa431a96a130 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 29 08:58:05.590628 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-28589eef-9272-466b-b6df-6f7402eaa1eb tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Calling method '.version_select at 0x7f623824c5e0>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:58:05.612801 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-28589eef-9272-466b-b6df-6f7402eaa1eb tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] 10.222.0.31 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1502805126" status: 202 len: 0 microversion: 2.1 time: 0.025878 Apr 29 08:58:05.613389 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 369/740] 10.222.0.31 () {58 vars in 1220 bytes} [Fri Apr 29 08:58:05 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1502805126 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 29 08:58:06.352383 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-99b40bf1-1038-488b-9d3b-1cff6acc8416 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "71626bef-d479-4350-9a2d-9412aecca460"}} {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 29 08:58:06.353463 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-99b40bf1-1038-488b-9d3b-1cff6acc8416 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] [instance: f4be98bb-be88-421f-a448-f04a4f97702b] Fetching instance by UUID {{(pid=123459) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:58:06.359638 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-99b40bf1-1038-488b-9d3b-1cff6acc8416 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:58:06.360085 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-99b40bf1-1038-488b-9d3b-1cff6acc8416 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:58:06.361386 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-99b40bf1-1038-488b-9d3b-1cff6acc8416 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:58:06.361993 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-99b40bf1-1038-488b-9d3b-1cff6acc8416 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:58:06.635659 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-79abdce5-81e9-41de-8819-44f68740ec3f tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Calling method '>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:58:06.636305 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-79abdce5-81e9-41de-8819-44f68740ec3f tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] [instance: 0f9c17b6-b1a2-4ec6-ba8c-2097a8c8ccb7] Fetching instance by UUID {{(pid=123458) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:58:06.643323 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-79abdce5-81e9-41de-8819-44f68740ec3f tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:58:06.643812 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-79abdce5-81e9-41de-8819-44f68740ec3f tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:58:06.644726 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-79abdce5-81e9-41de-8819-44f68740ec3f tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:58:06.645071 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-79abdce5-81e9-41de-8819-44f68740ec3f tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:58:06.668341 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-99b40bf1-1038-488b-9d3b-1cff6acc8416 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] 10.222.0.31 "POST /compute/v2.1/servers/f4be98bb-be88-421f-a448-f04a4f97702b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.320706 Apr 29 08:58:06.672897 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 372/741] 10.222.0.31 () {60 vars in 1322 bytes} [Fri Apr 29 08:58:06 2022] POST /compute/v2.1/servers/f4be98bb-be88-421f-a448-f04a4f97702b/os-volume_attachments => generated 194 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 29 08:58:06.744009 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.objects.instance [None req-79abdce5-81e9-41de-8819-44f68740ec3f tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lazy-loading 'services' on Instance uuid 0f9c17b6-b1a2-4ec6-ba8c-2097a8c8ccb7 {{(pid=123458) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 29 08:58:06.815804 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-79abdce5-81e9-41de-8819-44f68740ec3f tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] 10.222.0.31 "DELETE /compute/v2.1/servers/0f9c17b6-b1a2-4ec6-ba8c-2097a8c8ccb7/os-volume_attachments/af72dd7a-5864-4258-8196-4826f92aa0d4" status: 202 len: 0 microversion: 2.1 time: 0.185571 Apr 29 08:58:06.816460 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 370/742] 10.222.0.31 () {58 vars in 1415 bytes} [Fri Apr 29 08:58:06 2022] DELETE /compute/v2.1/servers/0f9c17b6-b1a2-4ec6-ba8c-2097a8c8ccb7/os-volume_attachments/af72dd7a-5864-4258-8196-4826f92aa0d4 => generated 0 bytes in 187 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 29 08:58:06.828366 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-a04b1241-40b0-488b-a591-7988a31411d8 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Calling method '>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:58:06.829502 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-a04b1241-40b0-488b-a591-7988a31411d8 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] [instance: 0f9c17b6-b1a2-4ec6-ba8c-2097a8c8ccb7] Fetching instance by UUID {{(pid=123459) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:58:06.837018 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-a04b1241-40b0-488b-a591-7988a31411d8 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:58:06.837696 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-a04b1241-40b0-488b-a591-7988a31411d8 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:58:06.838732 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-a04b1241-40b0-488b-a591-7988a31411d8 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:58:06.839175 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-a04b1241-40b0-488b-a591-7988a31411d8 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:58:06.890072 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-a04b1241-40b0-488b-a591-7988a31411d8 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] 10.222.0.31 "GET /compute/v2.1/servers/0f9c17b6-b1a2-4ec6-ba8c-2097a8c8ccb7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.067580 Apr 29 08:58:06.890777 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 373/743] 10.222.0.31 () {58 vars in 1301 bytes} [Fri Apr 29 08:58:06 2022] GET /compute/v2.1/servers/0f9c17b6-b1a2-4ec6-ba8c-2097a8c8ccb7/os-volume_attachments => generated 197 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 29 08:58:07.903886 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-dd6fcecf-043c-446a-8809-8f8679398f0f tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Calling method '>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:58:07.904966 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-dd6fcecf-043c-446a-8809-8f8679398f0f tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] [instance: 0f9c17b6-b1a2-4ec6-ba8c-2097a8c8ccb7] Fetching instance by UUID {{(pid=123458) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:58:07.911323 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-dd6fcecf-043c-446a-8809-8f8679398f0f tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:58:07.911774 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-dd6fcecf-043c-446a-8809-8f8679398f0f tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:58:07.912617 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-dd6fcecf-043c-446a-8809-8f8679398f0f tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:58:07.913149 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-dd6fcecf-043c-446a-8809-8f8679398f0f tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:58:07.944041 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-dd6fcecf-043c-446a-8809-8f8679398f0f tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] 10.222.0.31 "GET /compute/v2.1/servers/0f9c17b6-b1a2-4ec6-ba8c-2097a8c8ccb7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044382 Apr 29 08:58:07.944661 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 371/744] 10.222.0.31 () {58 vars in 1301 bytes} [Fri Apr 29 08:58:07 2022] GET /compute/v2.1/servers/0f9c17b6-b1a2-4ec6-ba8c-2097a8c8ccb7/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 29 08:58:08.955017 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-cbe5afb7-9e12-462b-b8f8-4b273e68b808 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Calling method '>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:58:08.955980 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-cbe5afb7-9e12-462b-b8f8-4b273e68b808 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] [instance: 0f9c17b6-b1a2-4ec6-ba8c-2097a8c8ccb7] Fetching instance by UUID {{(pid=123459) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:58:08.962995 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-cbe5afb7-9e12-462b-b8f8-4b273e68b808 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:58:08.963438 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-cbe5afb7-9e12-462b-b8f8-4b273e68b808 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:58:08.964254 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-cbe5afb7-9e12-462b-b8f8-4b273e68b808 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:58:08.964690 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-cbe5afb7-9e12-462b-b8f8-4b273e68b808 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:58:08.995968 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-cbe5afb7-9e12-462b-b8f8-4b273e68b808 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] 10.222.0.31 "GET /compute/v2.1/servers/0f9c17b6-b1a2-4ec6-ba8c-2097a8c8ccb7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044827 Apr 29 08:58:08.996571 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 374/745] 10.222.0.31 () {58 vars in 1301 bytes} [Fri Apr 29 08:58:08 2022] GET /compute/v2.1/servers/0f9c17b6-b1a2-4ec6-ba8c-2097a8c8ccb7/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 29 08:58:10.009557 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-c6ff8612-2b6e-4c64-a7fa-5e43a34758a8 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Calling method '>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:58:10.010503 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-c6ff8612-2b6e-4c64-a7fa-5e43a34758a8 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] [instance: 0f9c17b6-b1a2-4ec6-ba8c-2097a8c8ccb7] Fetching instance by UUID {{(pid=123458) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:58:10.017245 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-c6ff8612-2b6e-4c64-a7fa-5e43a34758a8 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:58:10.017726 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-c6ff8612-2b6e-4c64-a7fa-5e43a34758a8 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:58:10.018517 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-c6ff8612-2b6e-4c64-a7fa-5e43a34758a8 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:58:10.018955 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-c6ff8612-2b6e-4c64-a7fa-5e43a34758a8 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:58:10.050041 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-c6ff8612-2b6e-4c64-a7fa-5e43a34758a8 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] 10.222.0.31 "GET /compute/v2.1/servers/0f9c17b6-b1a2-4ec6-ba8c-2097a8c8ccb7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045176 Apr 29 08:58:10.050607 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 372/746] 10.222.0.31 () {58 vars in 1301 bytes} [Fri Apr 29 08:58:10 2022] GET /compute/v2.1/servers/0f9c17b6-b1a2-4ec6-ba8c-2097a8c8ccb7/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 29 08:58:11.062629 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-9c560269-3739-4f2c-aa38-20c69a012b36 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Calling method '>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:58:11.063574 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-9c560269-3739-4f2c-aa38-20c69a012b36 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] [instance: 0f9c17b6-b1a2-4ec6-ba8c-2097a8c8ccb7] Fetching instance by UUID {{(pid=123459) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:58:11.071144 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-9c560269-3739-4f2c-aa38-20c69a012b36 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:58:11.071598 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-9c560269-3739-4f2c-aa38-20c69a012b36 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:58:11.072439 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-9c560269-3739-4f2c-aa38-20c69a012b36 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:58:11.072878 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-9c560269-3739-4f2c-aa38-20c69a012b36 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:58:11.105948 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-9c560269-3739-4f2c-aa38-20c69a012b36 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] 10.222.0.31 "GET /compute/v2.1/servers/0f9c17b6-b1a2-4ec6-ba8c-2097a8c8ccb7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047245 Apr 29 08:58:11.106550 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 375/747] 10.222.0.31 () {58 vars in 1301 bytes} [Fri Apr 29 08:58:11 2022] GET /compute/v2.1/servers/0f9c17b6-b1a2-4ec6-ba8c-2097a8c8ccb7/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 29 08:58:12.121067 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-5991c0be-05a0-4434-856f-191cc1985332 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Calling method '>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:58:12.122022 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-5991c0be-05a0-4434-856f-191cc1985332 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] [instance: 0f9c17b6-b1a2-4ec6-ba8c-2097a8c8ccb7] Fetching instance by UUID {{(pid=123458) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:58:12.128618 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-5991c0be-05a0-4434-856f-191cc1985332 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:58:12.129064 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-5991c0be-05a0-4434-856f-191cc1985332 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:58:12.129839 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-5991c0be-05a0-4434-856f-191cc1985332 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:58:12.130274 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-5991c0be-05a0-4434-856f-191cc1985332 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:58:12.161491 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-5991c0be-05a0-4434-856f-191cc1985332 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] 10.222.0.31 "GET /compute/v2.1/servers/0f9c17b6-b1a2-4ec6-ba8c-2097a8c8ccb7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044565 Apr 29 08:58:12.162120 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 373/748] 10.222.0.31 () {58 vars in 1301 bytes} [Fri Apr 29 08:58:12 2022] GET /compute/v2.1/servers/0f9c17b6-b1a2-4ec6-ba8c-2097a8c8ccb7/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 29 08:58:13.173850 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-bf7bf6fa-829b-44cf-8443-7f8ff9ee56fa tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Calling method '>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:58:13.174813 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-bf7bf6fa-829b-44cf-8443-7f8ff9ee56fa tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] [instance: 0f9c17b6-b1a2-4ec6-ba8c-2097a8c8ccb7] Fetching instance by UUID {{(pid=123459) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:58:13.181404 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-bf7bf6fa-829b-44cf-8443-7f8ff9ee56fa tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:58:13.181858 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-bf7bf6fa-829b-44cf-8443-7f8ff9ee56fa tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:58:13.182645 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-bf7bf6fa-829b-44cf-8443-7f8ff9ee56fa tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:58:13.183082 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-bf7bf6fa-829b-44cf-8443-7f8ff9ee56fa tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:58:13.214962 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-bf7bf6fa-829b-44cf-8443-7f8ff9ee56fa tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] 10.222.0.31 "GET /compute/v2.1/servers/0f9c17b6-b1a2-4ec6-ba8c-2097a8c8ccb7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045107 Apr 29 08:58:13.215536 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 376/749] 10.222.0.31 () {58 vars in 1301 bytes} [Fri Apr 29 08:58:13 2022] GET /compute/v2.1/servers/0f9c17b6-b1a2-4ec6-ba8c-2097a8c8ccb7/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 29 08:58:14.227410 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-3c6bcee8-766b-4d5d-a2b7-c5e951374e93 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Calling method '>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:58:14.228376 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-3c6bcee8-766b-4d5d-a2b7-c5e951374e93 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] [instance: 0f9c17b6-b1a2-4ec6-ba8c-2097a8c8ccb7] Fetching instance by UUID {{(pid=123458) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:58:14.234705 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-3c6bcee8-766b-4d5d-a2b7-c5e951374e93 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:58:14.235149 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-3c6bcee8-766b-4d5d-a2b7-c5e951374e93 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:58:14.235913 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-3c6bcee8-766b-4d5d-a2b7-c5e951374e93 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:58:14.236373 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-3c6bcee8-766b-4d5d-a2b7-c5e951374e93 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:58:14.267187 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-3c6bcee8-766b-4d5d-a2b7-c5e951374e93 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] 10.222.0.31 "GET /compute/v2.1/servers/0f9c17b6-b1a2-4ec6-ba8c-2097a8c8ccb7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044482 Apr 29 08:58:14.267764 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 374/750] 10.222.0.31 () {58 vars in 1301 bytes} [Fri Apr 29 08:58:14 2022] GET /compute/v2.1/servers/0f9c17b6-b1a2-4ec6-ba8c-2097a8c8ccb7/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 29 08:58:15.228245 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-afbe565f-6cbb-4adc-bfc2-412c30125a37 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 29 08:58:15.229196 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-afbe565f-6cbb-4adc-bfc2-412c30125a37 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] [instance: f4be98bb-be88-421f-a448-f04a4f97702b] Fetching instance by UUID {{(pid=123459) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:58:15.235533 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-afbe565f-6cbb-4adc-bfc2-412c30125a37 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:58:15.235981 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-afbe565f-6cbb-4adc-bfc2-412c30125a37 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:58:15.236786 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-afbe565f-6cbb-4adc-bfc2-412c30125a37 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:58:15.237225 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-afbe565f-6cbb-4adc-bfc2-412c30125a37 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:58:15.260308 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.objects.instance [None req-afbe565f-6cbb-4adc-bfc2-412c30125a37 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lazy-loading 'flavor' on Instance uuid f4be98bb-be88-421f-a448-f04a4f97702b {{(pid=123459) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 29 08:58:15.288846 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-84887840-7070-456e-9958-5df9be14e67f tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Calling method '>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:58:15.289980 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-84887840-7070-456e-9958-5df9be14e67f tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] [instance: 0f9c17b6-b1a2-4ec6-ba8c-2097a8c8ccb7] Fetching instance by UUID {{(pid=123458) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:58:15.296753 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-84887840-7070-456e-9958-5df9be14e67f tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:58:15.297207 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-84887840-7070-456e-9958-5df9be14e67f tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:58:15.297993 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-84887840-7070-456e-9958-5df9be14e67f tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:58:15.298433 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-84887840-7070-456e-9958-5df9be14e67f tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:58:15.329170 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-84887840-7070-456e-9958-5df9be14e67f tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] 10.222.0.31 "GET /compute/v2.1/servers/0f9c17b6-b1a2-4ec6-ba8c-2097a8c8ccb7/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044850 Apr 29 08:58:15.329756 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 375/751] 10.222.0.31 () {58 vars in 1301 bytes} [Fri Apr 29 08:58:15 2022] GET /compute/v2.1/servers/0f9c17b6-b1a2-4ec6-ba8c-2097a8c8ccb7/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Apr 29 08:58:15.389265 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-afbe565f-6cbb-4adc-bfc2-412c30125a37 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] 10.222.0.31 "POST /compute/v2.1/servers/f4be98bb-be88-421f-a448-f04a4f97702b/action" status: 200 len: 32 microversion: 2.1 time: 0.165579 Apr 29 08:58:15.389503 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-da238a9e-4354-446d-8ea4-c94b9c27cd57 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Calling method '>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:58:15.389869 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 377/752] 10.222.0.31 () {60 vars in 1277 bytes} [Fri Apr 29 08:58:15 2022] POST /compute/v2.1/servers/f4be98bb-be88-421f-a448-f04a4f97702b/action => generated 32 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 29 08:58:15.390152 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-da238a9e-4354-446d-8ea4-c94b9c27cd57 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] [instance: 0f9c17b6-b1a2-4ec6-ba8c-2097a8c8ccb7] Fetching instance by UUID {{(pid=123458) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:58:15.397200 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-da238a9e-4354-446d-8ea4-c94b9c27cd57 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:58:15.398004 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-da238a9e-4354-446d-8ea4-c94b9c27cd57 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:58:15.398788 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-da238a9e-4354-446d-8ea4-c94b9c27cd57 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:58:15.399218 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-da238a9e-4354-446d-8ea4-c94b9c27cd57 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:58:15.400225 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-25168864-d9d1-48c3-9e02-6fde5764682c tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Calling method '>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:58:15.401322 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-25168864-d9d1-48c3-9e02-6fde5764682c tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] [instance: f4be98bb-be88-421f-a448-f04a4f97702b] Fetching instance by UUID {{(pid=123459) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:58:15.408372 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-25168864-d9d1-48c3-9e02-6fde5764682c tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:58:15.408863 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-25168864-d9d1-48c3-9e02-6fde5764682c tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:58:15.409791 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-25168864-d9d1-48c3-9e02-6fde5764682c tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:58:15.410395 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-25168864-d9d1-48c3-9e02-6fde5764682c tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:58:15.432768 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-da238a9e-4354-446d-8ea4-c94b9c27cd57 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] [instance: 0f9c17b6-b1a2-4ec6-ba8c-2097a8c8ccb7] Going to try to terminate instance {{(pid=123458) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 29 08:58:15.521015 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-da238a9e-4354-446d-8ea4-c94b9c27cd57 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] 10.222.0.31 "DELETE /compute/v2.1/servers/0f9c17b6-b1a2-4ec6-ba8c-2097a8c8ccb7" status: 204 len: 0 microversion: 2.1 time: 0.134813 Apr 29 08:58:15.521824 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 376/753] 10.222.0.31 () {58 vars in 1238 bytes} [Fri Apr 29 08:58:15 2022] DELETE /compute/v2.1/servers/0f9c17b6-b1a2-4ec6-ba8c-2097a8c8ccb7 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Apr 29 08:58:15.531752 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-7e0a9cf4-0352-4fe7-bd71-dbf603fa666d tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Calling method '>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:58:15.532808 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-7e0a9cf4-0352-4fe7-bd71-dbf603fa666d tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] [instance: 0f9c17b6-b1a2-4ec6-ba8c-2097a8c8ccb7] Fetching instance by UUID {{(pid=123458) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:58:15.539905 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-7e0a9cf4-0352-4fe7-bd71-dbf603fa666d tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:58:15.540654 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-7e0a9cf4-0352-4fe7-bd71-dbf603fa666d tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:58:15.541636 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-7e0a9cf4-0352-4fe7-bd71-dbf603fa666d tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:58:15.542077 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-7e0a9cf4-0352-4fe7-bd71-dbf603fa666d tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:58:15.563252 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-25168864-d9d1-48c3-9e02-6fde5764682c tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c18e88436f14dc7a2001220b87ce9ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60998f08c40446e787ead285e40665b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:58:15.571962 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-25168864-d9d1-48c3-9e02-6fde5764682c tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] 10.222.0.31 "GET /compute/v2.1/servers/f4be98bb-be88-421f-a448-f04a4f97702b" status: 200 len: 1735 microversion: 2.1 time: 0.176720 Apr 29 08:58:15.573058 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 378/754] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 08:58:15 2022] GET /compute/v2.1/servers/f4be98bb-be88-421f-a448-f04a4f97702b => generated 1735 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 08:58:15.709651 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-7e0a9cf4-0352-4fe7-bd71-dbf603fa666d tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e47ecdfb01f447699275b13255c15d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578e6a35974d4e5c8a0cd4e5fa994259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:58:15.718107 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-7e0a9cf4-0352-4fe7-bd71-dbf603fa666d tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] 10.222.0.31 "GET /compute/v2.1/servers/0f9c17b6-b1a2-4ec6-ba8c-2097a8c8ccb7" status: 200 len: 1683 microversion: 2.1 time: 0.191054 Apr 29 08:58:15.718682 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 377/755] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 08:58:15 2022] GET /compute/v2.1/servers/0f9c17b6-b1a2-4ec6-ba8c-2097a8c8ccb7 => generated 1683 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 29 08:58:16.589796 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-001a11db-6fc2-4b5f-8884-1bea5383fe71 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Calling method '>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:58:16.590354 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-001a11db-6fc2-4b5f-8884-1bea5383fe71 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] [instance: f4be98bb-be88-421f-a448-f04a4f97702b] Fetching instance by UUID {{(pid=123459) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:58:16.596755 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-001a11db-6fc2-4b5f-8884-1bea5383fe71 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:58:16.597197 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-001a11db-6fc2-4b5f-8884-1bea5383fe71 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:58:16.597963 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-001a11db-6fc2-4b5f-8884-1bea5383fe71 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:58:16.598394 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-001a11db-6fc2-4b5f-8884-1bea5383fe71 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:58:16.731998 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-001a11db-6fc2-4b5f-8884-1bea5383fe71 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c18e88436f14dc7a2001220b87ce9ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60998f08c40446e787ead285e40665b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:58:16.736050 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-0a9ca643-d6ac-4370-b18d-16f164fc312f tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Calling method '>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:58:16.736708 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-0a9ca643-d6ac-4370-b18d-16f164fc312f tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] [instance: 0f9c17b6-b1a2-4ec6-ba8c-2097a8c8ccb7] Fetching instance by UUID {{(pid=123458) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:58:16.740984 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-001a11db-6fc2-4b5f-8884-1bea5383fe71 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] 10.222.0.31 "GET /compute/v2.1/servers/f4be98bb-be88-421f-a448-f04a4f97702b" status: 200 len: 1735 microversion: 2.1 time: 0.154468 Apr 29 08:58:16.750661 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 379/756] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 08:58:16 2022] GET /compute/v2.1/servers/f4be98bb-be88-421f-a448-f04a4f97702b => generated 1735 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 08:58:16.750910 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-0a9ca643-d6ac-4370-b18d-16f164fc312f tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:58:16.750910 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-0a9ca643-d6ac-4370-b18d-16f164fc312f tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:58:16.750910 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-0a9ca643-d6ac-4370-b18d-16f164fc312f tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:58:16.750910 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-0a9ca643-d6ac-4370-b18d-16f164fc312f tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:58:16.877524 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-0a9ca643-d6ac-4370-b18d-16f164fc312f tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e47ecdfb01f447699275b13255c15d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578e6a35974d4e5c8a0cd4e5fa994259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:58:16.885472 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-0a9ca643-d6ac-4370-b18d-16f164fc312f tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] 10.222.0.31 "GET /compute/v2.1/servers/0f9c17b6-b1a2-4ec6-ba8c-2097a8c8ccb7" status: 200 len: 1683 microversion: 2.1 time: 0.153244 Apr 29 08:58:16.886053 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 378/757] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 08:58:16 2022] GET /compute/v2.1/servers/0f9c17b6-b1a2-4ec6-ba8c-2097a8c8ccb7 => generated 1683 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 29 08:58:17.760219 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-192468ea-c29c-4da3-9e5a-b755fdea3c1d tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Calling method '>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:58:17.761168 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-192468ea-c29c-4da3-9e5a-b755fdea3c1d tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] [instance: f4be98bb-be88-421f-a448-f04a4f97702b] Fetching instance by UUID {{(pid=123459) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:58:17.767934 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-192468ea-c29c-4da3-9e5a-b755fdea3c1d tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:58:17.768557 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-192468ea-c29c-4da3-9e5a-b755fdea3c1d tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:58:17.769472 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-192468ea-c29c-4da3-9e5a-b755fdea3c1d tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:58:17.770135 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-192468ea-c29c-4da3-9e5a-b755fdea3c1d tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:58:17.794423 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [req-49b91c56-1202-403d-ba43-0eb648509853 req-b2db7fb3-b106-4245-a43f-1b6196e07bb0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0f9c17b6-b1a2-4ec6-ba8c-2097a8c8ccb7", "name": "network-vif-deleted", "tag": "3b21bf13-34c3-4eab-b46e-1fddbe0106a8"}]} {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 29 08:58:17.820598 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [req-49b91c56-1202-403d-ba43-0eb648509853 req-b2db7fb3-b106-4245-a43f-1b6196e07bb0 service nova] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:58:17.823298 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [req-49b91c56-1202-403d-ba43-0eb648509853 req-b2db7fb3-b106-4245-a43f-1b6196e07bb0 service nova] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:58:17.851591 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.compute.server_external_events [req-49b91c56-1202-403d-ba43-0eb648509853 req-b2db7fb3-b106-4245-a43f-1b6196e07bb0 service nova] Creating event network-vif-deleted:3b21bf13-34c3-4eab-b46e-1fddbe0106a8 for instance 0f9c17b6-b1a2-4ec6-ba8c-2097a8c8ccb7 on hv-cinder-83987 Apr 29 08:58:17.857274 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [req-49b91c56-1202-403d-ba43-0eb648509853 req-b2db7fb3-b106-4245-a43f-1b6196e07bb0 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066475 Apr 29 08:58:17.858591 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 379/758] 10.222.0.31 () {64 vars in 1317 bytes} [Fri Apr 29 08:58:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 29 08:58:17.904265 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-efb9927d-9492-4871-8141-8c2557c0e790 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Calling method '>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:58:17.905088 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-efb9927d-9492-4871-8141-8c2557c0e790 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] [instance: 0f9c17b6-b1a2-4ec6-ba8c-2097a8c8ccb7] Fetching instance by UUID {{(pid=123458) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:58:17.914325 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-efb9927d-9492-4871-8141-8c2557c0e790 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:58:17.914778 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-efb9927d-9492-4871-8141-8c2557c0e790 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:58:17.915570 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-efb9927d-9492-4871-8141-8c2557c0e790 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:58:17.916006 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-efb9927d-9492-4871-8141-8c2557c0e790 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:58:17.961601 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-efb9927d-9492-4871-8141-8c2557c0e790 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:58:17.962055 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-efb9927d-9492-4871-8141-8c2557c0e790 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:58:17.962701 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.objects.instance [None req-efb9927d-9492-4871-8141-8c2557c0e790 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lazy-loading 'fault' on Instance uuid 0f9c17b6-b1a2-4ec6-ba8c-2097a8c8ccb7 {{(pid=123458) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 29 08:58:17.962844 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-192468ea-c29c-4da3-9e5a-b755fdea3c1d tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c18e88436f14dc7a2001220b87ce9ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60998f08c40446e787ead285e40665b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:58:17.975704 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-192468ea-c29c-4da3-9e5a-b755fdea3c1d tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] 10.222.0.31 "GET /compute/v2.1/servers/f4be98bb-be88-421f-a448-f04a4f97702b" status: 200 len: 1735 microversion: 2.1 time: 0.218313 Apr 29 08:58:17.976655 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 380/759] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 08:58:17 2022] GET /compute/v2.1/servers/f4be98bb-be88-421f-a448-f04a4f97702b => generated 1735 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 08:58:18.020080 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-efb9927d-9492-4871-8141-8c2557c0e790 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e47ecdfb01f447699275b13255c15d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578e6a35974d4e5c8a0cd4e5fa994259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:58:18.034195 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-efb9927d-9492-4871-8141-8c2557c0e790 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] 10.222.0.31 "GET /compute/v2.1/servers/0f9c17b6-b1a2-4ec6-ba8c-2097a8c8ccb7" status: 200 len: 1332 microversion: 2.1 time: 0.134175 Apr 29 08:58:18.035631 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 380/760] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 08:58:17 2022] GET /compute/v2.1/servers/0f9c17b6-b1a2-4ec6-ba8c-2097a8c8ccb7 => generated 1332 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 08:58:18.993168 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-427a1ae0-2451-4e86-8f2d-7e2d65c1f018 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Calling method '>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:58:18.993907 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-427a1ae0-2451-4e86-8f2d-7e2d65c1f018 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] [instance: f4be98bb-be88-421f-a448-f04a4f97702b] Fetching instance by UUID {{(pid=123459) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:58:19.001560 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-427a1ae0-2451-4e86-8f2d-7e2d65c1f018 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:58:19.001816 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-427a1ae0-2451-4e86-8f2d-7e2d65c1f018 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:58:19.002801 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-427a1ae0-2451-4e86-8f2d-7e2d65c1f018 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:58:19.003310 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-427a1ae0-2451-4e86-8f2d-7e2d65c1f018 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:58:19.052887 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-ee5826e2-0586-49e0-8b41-38aa3b8c12e1 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Calling method '>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:58:19.054100 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-ee5826e2-0586-49e0-8b41-38aa3b8c12e1 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] [instance: 0f9c17b6-b1a2-4ec6-ba8c-2097a8c8ccb7] Fetching instance by UUID {{(pid=123458) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:58:19.061150 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-ee5826e2-0586-49e0-8b41-38aa3b8c12e1 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:58:19.061599 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-ee5826e2-0586-49e0-8b41-38aa3b8c12e1 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:58:19.062461 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-ee5826e2-0586-49e0-8b41-38aa3b8c12e1 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:58:19.063084 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-ee5826e2-0586-49e0-8b41-38aa3b8c12e1 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:58:19.078460 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.wsgi [None req-ee5826e2-0586-49e0-8b41-38aa3b8c12e1 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] HTTP exception thrown: Instance 0f9c17b6-b1a2-4ec6-ba8c-2097a8c8ccb7 could not be found. Apr 29 08:58:19.079146 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-ee5826e2-0586-49e0-8b41-38aa3b8c12e1 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Returning 404 to user: Instance 0f9c17b6-b1a2-4ec6-ba8c-2097a8c8ccb7 could not be found. {{(pid=123458) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 29 08:58:19.080060 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-ee5826e2-0586-49e0-8b41-38aa3b8c12e1 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] 10.222.0.31 "GET /compute/v2.1/servers/0f9c17b6-b1a2-4ec6-ba8c-2097a8c8ccb7" status: 404 len: 111 microversion: 2.1 time: 0.031346 Apr 29 08:58:19.080730 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 381/761] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 08:58:19 2022] GET /compute/v2.1/servers/0f9c17b6-b1a2-4ec6-ba8c-2097a8c8ccb7 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Apr 29 08:58:19.090468 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-b5c1b3b7-5ad1-4038-88cc-e59e80556c51 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Calling method '.version_select at 0x7f623824c160>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:58:19.110394 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-b5c1b3b7-5ad1-4038-88cc-e59e80556c51 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] 10.222.0.31 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1129396086" status: 202 len: 0 microversion: 2.1 time: 0.024148 Apr 29 08:58:19.111129 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 382/762] 10.222.0.31 () {58 vars in 1220 bytes} [Fri Apr 29 08:58:19 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1129396086 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 29 08:58:19.178195 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-427a1ae0-2451-4e86-8f2d-7e2d65c1f018 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c18e88436f14dc7a2001220b87ce9ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60998f08c40446e787ead285e40665b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:58:19.186173 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-427a1ae0-2451-4e86-8f2d-7e2d65c1f018 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] 10.222.0.31 "GET /compute/v2.1/servers/f4be98bb-be88-421f-a448-f04a4f97702b" status: 200 len: 1735 microversion: 2.1 time: 0.197237 Apr 29 08:58:19.186754 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 381/763] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 08:58:18 2022] GET /compute/v2.1/servers/f4be98bb-be88-421f-a448-f04a4f97702b => generated 1735 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 08:58:19.781447 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-0d300db2-21fa-4006-b235-acb54c1c58c1 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Action: 'create', calling method: .version_select at 0x7f62383d35e0>, body: {"keypair": {"name": "tempest-keypair-1969647991"}} {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 29 08:58:19.795876 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.quota [None req-0d300db2-21fa-4006-b235-acb54c1c58c1 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Getting quotas for project 578e6a35974d4e5c8a0cd4e5fa994259. Resources: {'key_pairs'} {{(pid=123458) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 29 08:58:19.799554 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.quota [None req-0d300db2-21fa-4006-b235-acb54c1c58c1 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Getting quotas for user 8e47ecdfb01f447699275b13255c15d4 and project 578e6a35974d4e5c8a0cd4e5fa994259. Resources: {'key_pairs'} {{(pid=123458) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 29 08:58:19.899620 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.quota [None req-0d300db2-21fa-4006-b235-acb54c1c58c1 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Getting quotas for project 578e6a35974d4e5c8a0cd4e5fa994259. Resources: {'key_pairs'} {{(pid=123458) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 29 08:58:19.903262 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.quota [None req-0d300db2-21fa-4006-b235-acb54c1c58c1 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Getting quotas for user 8e47ecdfb01f447699275b13255c15d4 and project 578e6a35974d4e5c8a0cd4e5fa994259. Resources: {'key_pairs'} {{(pid=123458) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 29 08:58:19.916482 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-0d300db2-21fa-4006-b235-acb54c1c58c1 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] 10.222.0.31 "POST /compute/v2.1/os-keypairs" status: 200 len: 2301 microversion: 2.1 time: 0.138847 Apr 29 08:58:19.917069 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 383/764] 10.222.0.31 () {60 vars in 1157 bytes} [Fri Apr 29 08:58:19 2022] POST /compute/v2.1/os-keypairs => generated 2301 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 08:58:20.204485 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-9ec6bc7f-2910-44e5-8c38-7f3a0cc3ec5a tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Calling method '>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:58:20.205020 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-9ec6bc7f-2910-44e5-8c38-7f3a0cc3ec5a tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] [instance: f4be98bb-be88-421f-a448-f04a4f97702b] Fetching instance by UUID {{(pid=123459) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:58:20.212297 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-9ec6bc7f-2910-44e5-8c38-7f3a0cc3ec5a tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:58:20.212845 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-9ec6bc7f-2910-44e5-8c38-7f3a0cc3ec5a tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:58:20.213701 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-9ec6bc7f-2910-44e5-8c38-7f3a0cc3ec5a tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:58:20.214212 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-9ec6bc7f-2910-44e5-8c38-7f3a0cc3ec5a tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:58:20.394224 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-9ec6bc7f-2910-44e5-8c38-7f3a0cc3ec5a tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c18e88436f14dc7a2001220b87ce9ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60998f08c40446e787ead285e40665b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:58:20.403411 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-9ec6bc7f-2910-44e5-8c38-7f3a0cc3ec5a tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] 10.222.0.31 "GET /compute/v2.1/servers/f4be98bb-be88-421f-a448-f04a4f97702b" status: 200 len: 1735 microversion: 2.1 time: 0.202777 Apr 29 08:58:20.404000 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 382/765] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 08:58:20 2022] GET /compute/v2.1/servers/f4be98bb-be88-421f-a448-f04a4f97702b => generated 1735 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 08:58:21.206153 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-f75797dc-a03f-430e-9e73-2599c814e06c tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-947199698", "imageRef": "e0678f88-0b68-4453-b569-29fd065e544e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "b24838f8-74fc-43df-860b-f0934d3ce2df"}], "security_groups": [{"name": "tempest-securitygroup--1787975358"}], "key_name": "tempest-keypair-1969647991", "user_data": "}} {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 29 08:58:21.307903 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.network.neutron [None req-f75797dc-a03f-430e-9e73-2599c814e06c tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] validate_networks() for [('b24838f8-74fc-43df-860b-f0934d3ce2df', None, None, None, None, None)] {{(pid=123458) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 29 08:58:21.421334 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-0c9505c8-667e-4678-9a5a-abb956242cb6 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Calling method '>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:58:21.421974 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-0c9505c8-667e-4678-9a5a-abb956242cb6 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] [instance: f4be98bb-be88-421f-a448-f04a4f97702b] Fetching instance by UUID {{(pid=123459) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:58:21.429241 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-0c9505c8-667e-4678-9a5a-abb956242cb6 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:58:21.429702 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-0c9505c8-667e-4678-9a5a-abb956242cb6 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:58:21.430516 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-0c9505c8-667e-4678-9a5a-abb956242cb6 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:58:21.430961 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-0c9505c8-667e-4678-9a5a-abb956242cb6 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:58:21.564668 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-0c9505c8-667e-4678-9a5a-abb956242cb6 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c18e88436f14dc7a2001220b87ce9ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60998f08c40446e787ead285e40665b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:58:21.572902 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-0c9505c8-667e-4678-9a5a-abb956242cb6 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] 10.222.0.31 "GET /compute/v2.1/servers/f4be98bb-be88-421f-a448-f04a4f97702b" status: 200 len: 1735 microversion: 2.1 time: 0.155334 Apr 29 08:58:21.573601 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 383/766] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 08:58:21 2022] GET /compute/v2.1/servers/f4be98bb-be88-421f-a448-f04a4f97702b => generated 1735 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 29 08:58:21.720969 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.virt.hardware [None req-f75797dc-a03f-430e-9e73-2599c814e06c tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Flavor limits 0:0:0 {{(pid=123458) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 29 08:58:21.721400 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.virt.hardware [None req-f75797dc-a03f-430e-9e73-2599c814e06c tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Image limits 0:0:0 {{(pid=123458) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 29 08:58:21.721878 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.virt.hardware [None req-f75797dc-a03f-430e-9e73-2599c814e06c tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Flavor pref 0:0:0 {{(pid=123458) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 29 08:58:21.722291 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.virt.hardware [None req-f75797dc-a03f-430e-9e73-2599c814e06c tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Image pref 0:0:0 {{(pid=123458) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 29 08:58:21.722728 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.virt.hardware [None req-f75797dc-a03f-430e-9e73-2599c814e06c tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123458) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 29 08:58:21.735308 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-f75797dc-a03f-430e-9e73-2599c814e06c tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:58:21.735912 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-f75797dc-a03f-430e-9e73-2599c814e06c tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:58:21.736768 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-f75797dc-a03f-430e-9e73-2599c814e06c tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:58:21.737223 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-f75797dc-a03f-430e-9e73-2599c814e06c tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:58:21.754792 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.quota [None req-f75797dc-a03f-430e-9e73-2599c814e06c tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Getting quotas for project 578e6a35974d4e5c8a0cd4e5fa994259. Resources: {'instances', 'cores', 'ram'} {{(pid=123458) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 29 08:58:21.758854 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.quota [None req-f75797dc-a03f-430e-9e73-2599c814e06c tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Getting quotas for user 8e47ecdfb01f447699275b13255c15d4 and project 578e6a35974d4e5c8a0cd4e5fa994259. Resources: {'instances', 'cores', 'ram'} {{(pid=123458) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 29 08:58:21.770063 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-f75797dc-a03f-430e-9e73-2599c814e06c tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Going to run 1 instances... {{(pid=123458) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 29 08:58:21.772990 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-f75797dc-a03f-430e-9e73-2599c814e06c tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] [instance: 6722378c-3c16-480e-b7de-4f9c8696fa03] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e0678f88-0b68-4453-b569-29fd065e544e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123458) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 29 08:58:21.820799 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-f75797dc-a03f-430e-9e73-2599c814e06c tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] 10.222.0.31 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.619005 Apr 29 08:58:21.826259 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 384/767] 10.222.0.31 () {60 vars in 1146 bytes} [Fri Apr 29 08:58:21 2022] POST /compute/v2.1/servers => generated 402 bytes in 620 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 29 08:58:21.831361 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-d77f4de2-1b9c-4366-8cab-ae43af861a2d tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Calling method '>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:58:21.831983 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-d77f4de2-1b9c-4366-8cab-ae43af861a2d tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] [instance: 6722378c-3c16-480e-b7de-4f9c8696fa03] Fetching instance by UUID {{(pid=123459) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:58:21.892202 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-d77f4de2-1b9c-4366-8cab-ae43af861a2d tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e47ecdfb01f447699275b13255c15d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578e6a35974d4e5c8a0cd4e5fa994259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:58:21.899528 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-d77f4de2-1b9c-4366-8cab-ae43af861a2d tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] 10.222.0.31 "GET /compute/v2.1/servers/6722378c-3c16-480e-b7de-4f9c8696fa03" status: 200 len: 1241 microversion: 2.1 time: 0.071960 Apr 29 08:58:21.900099 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 384/768] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 08:58:21 2022] GET /compute/v2.1/servers/6722378c-3c16-480e-b7de-4f9c8696fa03 => generated 1241 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 08:58:22.591587 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-4e5c3790-6d47-406b-8a2b-eb2fdfc06644 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Calling method '>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:58:22.592351 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-4e5c3790-6d47-406b-8a2b-eb2fdfc06644 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] [instance: f4be98bb-be88-421f-a448-f04a4f97702b] Fetching instance by UUID {{(pid=123458) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:58:22.598769 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-4e5c3790-6d47-406b-8a2b-eb2fdfc06644 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:58:22.599035 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-4e5c3790-6d47-406b-8a2b-eb2fdfc06644 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:58:22.600427 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-4e5c3790-6d47-406b-8a2b-eb2fdfc06644 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:58:22.600875 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-4e5c3790-6d47-406b-8a2b-eb2fdfc06644 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:58:22.745257 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-4e5c3790-6d47-406b-8a2b-eb2fdfc06644 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c18e88436f14dc7a2001220b87ce9ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60998f08c40446e787ead285e40665b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:58:22.753597 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-4e5c3790-6d47-406b-8a2b-eb2fdfc06644 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] 10.222.0.31 "GET /compute/v2.1/servers/f4be98bb-be88-421f-a448-f04a4f97702b" status: 200 len: 1735 microversion: 2.1 time: 0.167042 Apr 29 08:58:22.754177 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 385/769] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 08:58:22 2022] GET /compute/v2.1/servers/f4be98bb-be88-421f-a448-f04a4f97702b => generated 1735 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 08:58:22.936083 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-e74072f7-b537-4af8-9d6c-7b2fabcd1643 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Calling method '>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:58:22.936549 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-e74072f7-b537-4af8-9d6c-7b2fabcd1643 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] [instance: 6722378c-3c16-480e-b7de-4f9c8696fa03] Fetching instance by UUID {{(pid=123459) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:58:22.944259 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-e74072f7-b537-4af8-9d6c-7b2fabcd1643 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:58:22.944940 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-e74072f7-b537-4af8-9d6c-7b2fabcd1643 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:58:22.945799 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-e74072f7-b537-4af8-9d6c-7b2fabcd1643 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:58:22.946246 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-e74072f7-b537-4af8-9d6c-7b2fabcd1643 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:58:23.024579 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-e74072f7-b537-4af8-9d6c-7b2fabcd1643 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e47ecdfb01f447699275b13255c15d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578e6a35974d4e5c8a0cd4e5fa994259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:58:23.033199 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-e74072f7-b537-4af8-9d6c-7b2fabcd1643 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] 10.222.0.31 "GET /compute/v2.1/servers/6722378c-3c16-480e-b7de-4f9c8696fa03" status: 200 len: 1311 microversion: 2.1 time: 0.111301 Apr 29 08:58:23.033973 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 385/770] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 08:58:22 2022] GET /compute/v2.1/servers/6722378c-3c16-480e-b7de-4f9c8696fa03 => generated 1311 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 08:58:23.770919 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-e06452f1-78a3-4f71-ae93-95e109ca4b21 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Calling method '>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:58:23.771684 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-e06452f1-78a3-4f71-ae93-95e109ca4b21 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] [instance: f4be98bb-be88-421f-a448-f04a4f97702b] Fetching instance by UUID {{(pid=123458) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:58:23.780244 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-e06452f1-78a3-4f71-ae93-95e109ca4b21 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:58:23.781371 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-e06452f1-78a3-4f71-ae93-95e109ca4b21 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:58:23.781924 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-e06452f1-78a3-4f71-ae93-95e109ca4b21 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:58:23.782390 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-e06452f1-78a3-4f71-ae93-95e109ca4b21 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:58:24.001891 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-e06452f1-78a3-4f71-ae93-95e109ca4b21 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c18e88436f14dc7a2001220b87ce9ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60998f08c40446e787ead285e40665b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:58:24.010763 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-e06452f1-78a3-4f71-ae93-95e109ca4b21 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] 10.222.0.31 "GET /compute/v2.1/servers/f4be98bb-be88-421f-a448-f04a4f97702b" status: 200 len: 1735 microversion: 2.1 time: 0.243760 Apr 29 08:58:24.011536 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 386/771] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 08:58:23 2022] GET /compute/v2.1/servers/f4be98bb-be88-421f-a448-f04a4f97702b => generated 1735 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 08:58:24.050492 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-720f54b1-98ee-49f2-b629-94934263e403 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Calling method '>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:58:24.051160 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-720f54b1-98ee-49f2-b629-94934263e403 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] [instance: 6722378c-3c16-480e-b7de-4f9c8696fa03] Fetching instance by UUID {{(pid=123459) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:58:24.057993 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-720f54b1-98ee-49f2-b629-94934263e403 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:58:24.058442 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-720f54b1-98ee-49f2-b629-94934263e403 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:58:24.059228 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-720f54b1-98ee-49f2-b629-94934263e403 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:58:24.059662 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-720f54b1-98ee-49f2-b629-94934263e403 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:58:24.202656 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-720f54b1-98ee-49f2-b629-94934263e403 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e47ecdfb01f447699275b13255c15d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578e6a35974d4e5c8a0cd4e5fa994259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:58:24.211192 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-720f54b1-98ee-49f2-b629-94934263e403 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] 10.222.0.31 "GET /compute/v2.1/servers/6722378c-3c16-480e-b7de-4f9c8696fa03" status: 200 len: 1367 microversion: 2.1 time: 0.164488 Apr 29 08:58:24.211780 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 386/772] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 08:58:24 2022] GET /compute/v2.1/servers/6722378c-3c16-480e-b7de-4f9c8696fa03 => generated 1367 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 08:58:24.776614 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [req-fa559a74-1de8-4517-8085-de48c83c4a02 req-04f55e5d-edfe-4c9b-8139-c769e14fc836 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6722378c-3c16-480e-b7de-4f9c8696fa03", "tag": "55ac5c5c-82d5-480e-a4e9-c6ff2f7c561c"}]} {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 29 08:58:24.786972 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [req-fa559a74-1de8-4517-8085-de48c83c4a02 req-04f55e5d-edfe-4c9b-8139-c769e14fc836 service nova] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:58:24.787415 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [req-fa559a74-1de8-4517-8085-de48c83c4a02 req-04f55e5d-edfe-4c9b-8139-c769e14fc836 service nova] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:58:24.801873 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.compute.server_external_events [req-fa559a74-1de8-4517-8085-de48c83c4a02 req-04f55e5d-edfe-4c9b-8139-c769e14fc836 service nova] Creating event network-changed:55ac5c5c-82d5-480e-a4e9-c6ff2f7c561c for instance 6722378c-3c16-480e-b7de-4f9c8696fa03 on hv-cinder-83987 Apr 29 08:58:24.808928 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [req-fa559a74-1de8-4517-8085-de48c83c4a02 req-04f55e5d-edfe-4c9b-8139-c769e14fc836 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036884 Apr 29 08:58:24.810114 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 387/773] 10.222.0.31 () {64 vars in 1317 bytes} [Fri Apr 29 08:58:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 29 08:58:25.027939 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-1c697440-e50b-4e43-b7bb-732e3f3f72cb tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Calling method '>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:58:25.028846 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-1c697440-e50b-4e43-b7bb-732e3f3f72cb tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] [instance: f4be98bb-be88-421f-a448-f04a4f97702b] Fetching instance by UUID {{(pid=123459) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:58:25.036570 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-1c697440-e50b-4e43-b7bb-732e3f3f72cb tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:58:25.037688 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-1c697440-e50b-4e43-b7bb-732e3f3f72cb tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:58:25.038778 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-1c697440-e50b-4e43-b7bb-732e3f3f72cb tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:58:25.039512 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-1c697440-e50b-4e43-b7bb-732e3f3f72cb tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:58:25.188680 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-1c697440-e50b-4e43-b7bb-732e3f3f72cb tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c18e88436f14dc7a2001220b87ce9ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60998f08c40446e787ead285e40665b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:58:25.198260 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-1c697440-e50b-4e43-b7bb-732e3f3f72cb tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] 10.222.0.31 "GET /compute/v2.1/servers/f4be98bb-be88-421f-a448-f04a4f97702b" status: 200 len: 1735 microversion: 2.1 time: 0.173936 Apr 29 08:58:25.198857 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 387/774] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 08:58:25 2022] GET /compute/v2.1/servers/f4be98bb-be88-421f-a448-f04a4f97702b => generated 1735 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 08:58:25.229565 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-23ca604b-368c-490c-8ee7-4a158d8cc1e1 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Calling method '>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:58:25.230353 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-23ca604b-368c-490c-8ee7-4a158d8cc1e1 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] [instance: 6722378c-3c16-480e-b7de-4f9c8696fa03] Fetching instance by UUID {{(pid=123458) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:58:25.237177 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-23ca604b-368c-490c-8ee7-4a158d8cc1e1 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:58:25.238105 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-23ca604b-368c-490c-8ee7-4a158d8cc1e1 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:58:25.238386 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-23ca604b-368c-490c-8ee7-4a158d8cc1e1 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:58:25.238746 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-23ca604b-368c-490c-8ee7-4a158d8cc1e1 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:58:25.387817 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-23ca604b-368c-490c-8ee7-4a158d8cc1e1 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e47ecdfb01f447699275b13255c15d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578e6a35974d4e5c8a0cd4e5fa994259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:58:25.397191 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-23ca604b-368c-490c-8ee7-4a158d8cc1e1 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] 10.222.0.31 "GET /compute/v2.1/servers/6722378c-3c16-480e-b7de-4f9c8696fa03" status: 200 len: 1367 microversion: 2.1 time: 0.171505 Apr 29 08:58:25.397834 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 388/775] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 08:58:25 2022] GET /compute/v2.1/servers/6722378c-3c16-480e-b7de-4f9c8696fa03 => generated 1367 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 08:58:26.215791 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-83200081-a4ea-4082-bbd5-49bd3815e23d tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Calling method '>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:58:26.216434 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-83200081-a4ea-4082-bbd5-49bd3815e23d tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] [instance: f4be98bb-be88-421f-a448-f04a4f97702b] Fetching instance by UUID {{(pid=123459) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:58:26.222830 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-83200081-a4ea-4082-bbd5-49bd3815e23d tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:58:26.223277 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-83200081-a4ea-4082-bbd5-49bd3815e23d tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:58:26.224044 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-83200081-a4ea-4082-bbd5-49bd3815e23d tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:58:26.225248 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-83200081-a4ea-4082-bbd5-49bd3815e23d tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:58:26.359272 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-83200081-a4ea-4082-bbd5-49bd3815e23d tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c18e88436f14dc7a2001220b87ce9ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60998f08c40446e787ead285e40665b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:58:26.367892 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-83200081-a4ea-4082-bbd5-49bd3815e23d tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] 10.222.0.31 "GET /compute/v2.1/servers/f4be98bb-be88-421f-a448-f04a4f97702b" status: 200 len: 1735 microversion: 2.1 time: 0.155658 Apr 29 08:58:26.368506 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 388/776] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 08:58:26 2022] GET /compute/v2.1/servers/f4be98bb-be88-421f-a448-f04a4f97702b => generated 1735 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 08:58:26.416029 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-4c00e841-629e-4a33-ac59-5629ea798c21 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Calling method '>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:58:26.416675 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-4c00e841-629e-4a33-ac59-5629ea798c21 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] [instance: 6722378c-3c16-480e-b7de-4f9c8696fa03] Fetching instance by UUID {{(pid=123458) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:58:26.423190 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-4c00e841-629e-4a33-ac59-5629ea798c21 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:58:26.423640 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-4c00e841-629e-4a33-ac59-5629ea798c21 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:58:26.424441 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-4c00e841-629e-4a33-ac59-5629ea798c21 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:58:26.424885 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-4c00e841-629e-4a33-ac59-5629ea798c21 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:58:26.579432 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-4c00e841-629e-4a33-ac59-5629ea798c21 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e47ecdfb01f447699275b13255c15d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578e6a35974d4e5c8a0cd4e5fa994259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:58:26.591007 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-4c00e841-629e-4a33-ac59-5629ea798c21 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] 10.222.0.31 "GET /compute/v2.1/servers/6722378c-3c16-480e-b7de-4f9c8696fa03" status: 200 len: 1367 microversion: 2.1 time: 0.179936 Apr 29 08:58:26.591600 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 389/777] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 08:58:26 2022] GET /compute/v2.1/servers/6722378c-3c16-480e-b7de-4f9c8696fa03 => generated 1367 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 08:58:26.740794 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-c5cefc1b-0de3-4cd4-a679-3fc193b33f5a tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 29 08:58:26.741337 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-c5cefc1b-0de3-4cd4-a679-3fc193b33f5a tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] [instance: d83c29d2-6435-4edc-827b-2c37a66fb199] Fetching instance by UUID {{(pid=123459) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:58:26.747668 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-c5cefc1b-0de3-4cd4-a679-3fc193b33f5a tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:58:26.748119 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-c5cefc1b-0de3-4cd4-a679-3fc193b33f5a tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:58:26.748927 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-c5cefc1b-0de3-4cd4-a679-3fc193b33f5a tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:58:26.749363 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-c5cefc1b-0de3-4cd4-a679-3fc193b33f5a tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:58:26.773337 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.objects.instance [None req-c5cefc1b-0de3-4cd4-a679-3fc193b33f5a tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] Lazy-loading 'flavor' on Instance uuid d83c29d2-6435-4edc-827b-2c37a66fb199 {{(pid=123459) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 29 08:58:26.844431 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-c5cefc1b-0de3-4cd4-a679-3fc193b33f5a tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] 10.222.0.31 "POST /compute/v2.1/servers/d83c29d2-6435-4edc-827b-2c37a66fb199/action" status: 202 len: 0 microversion: 2.1 time: 0.108060 Apr 29 08:58:26.845017 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 389/778] 10.222.0.31 () {60 vars in 1277 bytes} [Fri Apr 29 08:58:26 2022] POST /compute/v2.1/servers/d83c29d2-6435-4edc-827b-2c37a66fb199/action => generated 0 bytes in 110 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 29 08:58:26.853799 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-11bac45a-d8c4-4ac1-98f5-c380aeeec50d tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] Calling method '>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:58:26.854412 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-11bac45a-d8c4-4ac1-98f5-c380aeeec50d tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] [instance: d83c29d2-6435-4edc-827b-2c37a66fb199] Fetching instance by UUID {{(pid=123458) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:58:26.860388 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-11bac45a-d8c4-4ac1-98f5-c380aeeec50d tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:58:26.860845 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-11bac45a-d8c4-4ac1-98f5-c380aeeec50d tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:58:26.861617 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-11bac45a-d8c4-4ac1-98f5-c380aeeec50d tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:58:26.862059 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-11bac45a-d8c4-4ac1-98f5-c380aeeec50d tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:58:26.995967 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-11bac45a-d8c4-4ac1-98f5-c380aeeec50d tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcf1c67873b7443084ea183c77698062', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0436edb5348a4ad5a0b6b5979a7c54fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:58:27.003460 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-11bac45a-d8c4-4ac1-98f5-c380aeeec50d tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] 10.222.0.31 "GET /compute/v2.1/servers/d83c29d2-6435-4edc-827b-2c37a66fb199" status: 200 len: 1571 microversion: 2.1 time: 0.153838 Apr 29 08:58:27.004029 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 390/779] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 08:58:26 2022] GET /compute/v2.1/servers/d83c29d2-6435-4edc-827b-2c37a66fb199 => generated 1571 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 29 08:58:27.386232 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-37fbe308-1cf1-4492-99f5-8bf80b7c3b73 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Calling method '>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:58:27.386929 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-37fbe308-1cf1-4492-99f5-8bf80b7c3b73 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] [instance: f4be98bb-be88-421f-a448-f04a4f97702b] Fetching instance by UUID {{(pid=123459) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:58:27.393128 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-37fbe308-1cf1-4492-99f5-8bf80b7c3b73 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:58:27.393614 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-37fbe308-1cf1-4492-99f5-8bf80b7c3b73 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:58:27.394378 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-37fbe308-1cf1-4492-99f5-8bf80b7c3b73 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:58:27.394813 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-37fbe308-1cf1-4492-99f5-8bf80b7c3b73 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:58:27.522728 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-37fbe308-1cf1-4492-99f5-8bf80b7c3b73 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c18e88436f14dc7a2001220b87ce9ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60998f08c40446e787ead285e40665b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:58:27.530654 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-37fbe308-1cf1-4492-99f5-8bf80b7c3b73 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] 10.222.0.31 "GET /compute/v2.1/servers/f4be98bb-be88-421f-a448-f04a4f97702b" status: 200 len: 1735 microversion: 2.1 time: 0.149086 Apr 29 08:58:27.531226 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 390/780] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 08:58:27 2022] GET /compute/v2.1/servers/f4be98bb-be88-421f-a448-f04a4f97702b => generated 1735 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 08:58:27.607273 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-c5a2fa43-4406-4776-873d-ecd9a88cd3ad tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Calling method '>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:58:27.607881 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-c5a2fa43-4406-4776-873d-ecd9a88cd3ad tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] [instance: 6722378c-3c16-480e-b7de-4f9c8696fa03] Fetching instance by UUID {{(pid=123458) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:58:27.614286 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-c5a2fa43-4406-4776-873d-ecd9a88cd3ad tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:58:27.614739 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-c5a2fa43-4406-4776-873d-ecd9a88cd3ad tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:58:27.615556 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-c5a2fa43-4406-4776-873d-ecd9a88cd3ad tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:58:27.615995 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-c5a2fa43-4406-4776-873d-ecd9a88cd3ad tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:58:27.747246 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-c5a2fa43-4406-4776-873d-ecd9a88cd3ad tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e47ecdfb01f447699275b13255c15d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578e6a35974d4e5c8a0cd4e5fa994259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:58:27.754957 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-c5a2fa43-4406-4776-873d-ecd9a88cd3ad tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] 10.222.0.31 "GET /compute/v2.1/servers/6722378c-3c16-480e-b7de-4f9c8696fa03" status: 200 len: 1367 microversion: 2.1 time: 0.151405 Apr 29 08:58:27.755542 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 391/781] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 08:58:27 2022] GET /compute/v2.1/servers/6722378c-3c16-480e-b7de-4f9c8696fa03 => generated 1367 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 08:58:28.024995 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-c1cc66a0-80e1-436f-8eaf-a81744a6bf24 tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] Calling method '>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:58:28.025703 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-c1cc66a0-80e1-436f-8eaf-a81744a6bf24 tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] [instance: d83c29d2-6435-4edc-827b-2c37a66fb199] Fetching instance by UUID {{(pid=123459) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:58:28.032088 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-c1cc66a0-80e1-436f-8eaf-a81744a6bf24 tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:58:28.032563 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-c1cc66a0-80e1-436f-8eaf-a81744a6bf24 tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:58:28.033348 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-c1cc66a0-80e1-436f-8eaf-a81744a6bf24 tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:58:28.033781 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-c1cc66a0-80e1-436f-8eaf-a81744a6bf24 tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:58:28.179533 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-c1cc66a0-80e1-436f-8eaf-a81744a6bf24 tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcf1c67873b7443084ea183c77698062', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0436edb5348a4ad5a0b6b5979a7c54fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:58:28.187436 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-c1cc66a0-80e1-436f-8eaf-a81744a6bf24 tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] 10.222.0.31 "GET /compute/v2.1/servers/d83c29d2-6435-4edc-827b-2c37a66fb199" status: 200 len: 1571 microversion: 2.1 time: 0.169114 Apr 29 08:58:28.198210 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 391/782] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 08:58:28 2022] GET /compute/v2.1/servers/d83c29d2-6435-4edc-827b-2c37a66fb199 => generated 1571 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 08:58:28.548344 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-38f756c8-145f-4beb-ab39-bf90c3bded3e tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Calling method '>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:58:28.548956 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-38f756c8-145f-4beb-ab39-bf90c3bded3e tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] [instance: f4be98bb-be88-421f-a448-f04a4f97702b] Fetching instance by UUID {{(pid=123458) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:58:28.556310 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-38f756c8-145f-4beb-ab39-bf90c3bded3e tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:58:28.556766 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-38f756c8-145f-4beb-ab39-bf90c3bded3e tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:58:28.557549 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-38f756c8-145f-4beb-ab39-bf90c3bded3e tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:58:28.557994 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-38f756c8-145f-4beb-ab39-bf90c3bded3e tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:58:28.698960 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-38f756c8-145f-4beb-ab39-bf90c3bded3e tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c18e88436f14dc7a2001220b87ce9ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60998f08c40446e787ead285e40665b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:58:28.707176 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-38f756c8-145f-4beb-ab39-bf90c3bded3e tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] 10.222.0.31 "GET /compute/v2.1/servers/f4be98bb-be88-421f-a448-f04a4f97702b" status: 200 len: 1735 microversion: 2.1 time: 0.162665 Apr 29 08:58:28.707758 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 392/783] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 08:58:28 2022] GET /compute/v2.1/servers/f4be98bb-be88-421f-a448-f04a4f97702b => generated 1735 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 08:58:28.771948 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-8023081c-beff-4b4a-9a4f-8a780e36c786 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Calling method '>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:58:28.772706 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-8023081c-beff-4b4a-9a4f-8a780e36c786 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] [instance: 6722378c-3c16-480e-b7de-4f9c8696fa03] Fetching instance by UUID {{(pid=123459) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:58:28.779026 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-8023081c-beff-4b4a-9a4f-8a780e36c786 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:58:28.779474 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-8023081c-beff-4b4a-9a4f-8a780e36c786 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:58:28.780273 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-8023081c-beff-4b4a-9a4f-8a780e36c786 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:58:28.780708 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-8023081c-beff-4b4a-9a4f-8a780e36c786 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:58:28.912776 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-8023081c-beff-4b4a-9a4f-8a780e36c786 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e47ecdfb01f447699275b13255c15d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578e6a35974d4e5c8a0cd4e5fa994259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:58:28.921177 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-8023081c-beff-4b4a-9a4f-8a780e36c786 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] 10.222.0.31 "GET /compute/v2.1/servers/6722378c-3c16-480e-b7de-4f9c8696fa03" status: 200 len: 1367 microversion: 2.1 time: 0.153039 Apr 29 08:58:28.922120 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 392/784] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 08:58:28 2022] GET /compute/v2.1/servers/6722378c-3c16-480e-b7de-4f9c8696fa03 => generated 1367 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 08:58:29.206633 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-74260cad-689d-4f45-bed4-364ce2107b5b tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] Calling method '>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:58:29.207251 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-74260cad-689d-4f45-bed4-364ce2107b5b tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] [instance: d83c29d2-6435-4edc-827b-2c37a66fb199] Fetching instance by UUID {{(pid=123458) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:58:29.213673 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-74260cad-689d-4f45-bed4-364ce2107b5b tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:58:29.214128 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-74260cad-689d-4f45-bed4-364ce2107b5b tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:58:29.214911 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-74260cad-689d-4f45-bed4-364ce2107b5b tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:58:29.215345 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-74260cad-689d-4f45-bed4-364ce2107b5b tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:58:29.356937 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-74260cad-689d-4f45-bed4-364ce2107b5b tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcf1c67873b7443084ea183c77698062', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0436edb5348a4ad5a0b6b5979a7c54fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:58:29.364293 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-74260cad-689d-4f45-bed4-364ce2107b5b tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] 10.222.0.31 "GET /compute/v2.1/servers/d83c29d2-6435-4edc-827b-2c37a66fb199" status: 200 len: 1571 microversion: 2.1 time: 0.162451 Apr 29 08:58:29.365361 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 393/785] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 08:58:29 2022] GET /compute/v2.1/servers/d83c29d2-6435-4edc-827b-2c37a66fb199 => generated 1571 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 08:58:29.726150 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-8277924e-3986-4a6a-a89b-e65167877cb4 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Calling method '>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:58:29.726764 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-8277924e-3986-4a6a-a89b-e65167877cb4 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] [instance: f4be98bb-be88-421f-a448-f04a4f97702b] Fetching instance by UUID {{(pid=123459) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:58:29.732738 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-8277924e-3986-4a6a-a89b-e65167877cb4 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:58:29.733189 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-8277924e-3986-4a6a-a89b-e65167877cb4 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:58:29.733959 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-8277924e-3986-4a6a-a89b-e65167877cb4 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:58:29.734403 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-8277924e-3986-4a6a-a89b-e65167877cb4 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:58:29.870844 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-8277924e-3986-4a6a-a89b-e65167877cb4 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c18e88436f14dc7a2001220b87ce9ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60998f08c40446e787ead285e40665b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:58:29.878611 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-8277924e-3986-4a6a-a89b-e65167877cb4 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] 10.222.0.31 "GET /compute/v2.1/servers/f4be98bb-be88-421f-a448-f04a4f97702b" status: 200 len: 1735 microversion: 2.1 time: 0.157436 Apr 29 08:58:29.879169 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 393/786] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 08:58:29 2022] GET /compute/v2.1/servers/f4be98bb-be88-421f-a448-f04a4f97702b => generated 1735 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 08:58:29.939020 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-38966b7b-094c-4d6a-9583-25794133f31a tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Calling method '>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:58:29.939631 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-38966b7b-094c-4d6a-9583-25794133f31a tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] [instance: 6722378c-3c16-480e-b7de-4f9c8696fa03] Fetching instance by UUID {{(pid=123458) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:58:29.946024 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-38966b7b-094c-4d6a-9583-25794133f31a tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:58:29.946474 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-38966b7b-094c-4d6a-9583-25794133f31a tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:58:29.947252 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-38966b7b-094c-4d6a-9583-25794133f31a tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:58:29.947690 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-38966b7b-094c-4d6a-9583-25794133f31a tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:58:30.076570 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-38966b7b-094c-4d6a-9583-25794133f31a tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e47ecdfb01f447699275b13255c15d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578e6a35974d4e5c8a0cd4e5fa994259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:58:30.084356 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-38966b7b-094c-4d6a-9583-25794133f31a tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] 10.222.0.31 "GET /compute/v2.1/servers/6722378c-3c16-480e-b7de-4f9c8696fa03" status: 200 len: 1367 microversion: 2.1 time: 0.148611 Apr 29 08:58:30.084924 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 394/787] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 08:58:29 2022] GET /compute/v2.1/servers/6722378c-3c16-480e-b7de-4f9c8696fa03 => generated 1367 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 08:58:30.383055 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-7964cac6-1c62-4401-b04b-e4db006aa47a tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] Calling method '>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:58:30.383822 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-7964cac6-1c62-4401-b04b-e4db006aa47a tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] [instance: d83c29d2-6435-4edc-827b-2c37a66fb199] Fetching instance by UUID {{(pid=123459) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:58:30.389936 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-7964cac6-1c62-4401-b04b-e4db006aa47a tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:58:30.390379 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-7964cac6-1c62-4401-b04b-e4db006aa47a tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:58:30.391156 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-7964cac6-1c62-4401-b04b-e4db006aa47a tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:58:30.391596 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-7964cac6-1c62-4401-b04b-e4db006aa47a tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:58:30.449779 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [req-9721bb62-f50c-401e-8e29-7f09d8578e09 req-b4e8b35c-8608-4f08-a3d4-b90c6787e1b2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6722378c-3c16-480e-b7de-4f9c8696fa03", "name": "network-vif-plugged", "status": "completed", "tag": "55ac5c5c-82d5-480e-a4e9-c6ff2f7c561c"}]} {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 29 08:58:30.459845 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [req-9721bb62-f50c-401e-8e29-7f09d8578e09 req-b4e8b35c-8608-4f08-a3d4-b90c6787e1b2 service nova] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:58:30.460325 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [req-9721bb62-f50c-401e-8e29-7f09d8578e09 req-b4e8b35c-8608-4f08-a3d4-b90c6787e1b2 service nova] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:58:30.472550 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.compute.server_external_events [req-9721bb62-f50c-401e-8e29-7f09d8578e09 req-b4e8b35c-8608-4f08-a3d4-b90c6787e1b2 service nova] Creating event network-vif-plugged:55ac5c5c-82d5-480e-a4e9-c6ff2f7c561c for instance 6722378c-3c16-480e-b7de-4f9c8696fa03 on hv-cinder-83987 Apr 29 08:58:30.478536 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [req-9721bb62-f50c-401e-8e29-7f09d8578e09 req-b4e8b35c-8608-4f08-a3d4-b90c6787e1b2 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032607 Apr 29 08:58:30.479310 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 395/788] 10.222.0.31 () {64 vars in 1317 bytes} [Fri Apr 29 08:58:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 29 08:58:30.543008 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-7964cac6-1c62-4401-b04b-e4db006aa47a tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcf1c67873b7443084ea183c77698062', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0436edb5348a4ad5a0b6b5979a7c54fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:58:30.550432 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-7964cac6-1c62-4401-b04b-e4db006aa47a tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] 10.222.0.31 "GET /compute/v2.1/servers/d83c29d2-6435-4edc-827b-2c37a66fb199" status: 200 len: 1571 microversion: 2.1 time: 0.171938 Apr 29 08:58:30.550997 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 394/789] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 08:58:30 2022] GET /compute/v2.1/servers/d83c29d2-6435-4edc-827b-2c37a66fb199 => generated 1571 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 08:58:30.745596 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-eed11ce3-8831-4a88-8f13-80263f55796e tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Calling method '>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:58:30.746176 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-eed11ce3-8831-4a88-8f13-80263f55796e tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] [instance: 406b5ad6-698e-457f-93f4-cdfd45fb3e8e] Fetching instance by UUID {{(pid=123458) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:58:30.757334 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-eed11ce3-8831-4a88-8f13-80263f55796e tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:58:30.757334 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-eed11ce3-8831-4a88-8f13-80263f55796e tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:58:30.757334 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-eed11ce3-8831-4a88-8f13-80263f55796e tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:58:30.757334 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-eed11ce3-8831-4a88-8f13-80263f55796e tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:58:30.783820 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-eed11ce3-8831-4a88-8f13-80263f55796e tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] 10.222.0.31 "GET /compute/v2.1/servers/406b5ad6-698e-457f-93f4-cdfd45fb3e8e/os-volume_attachments/4f915c48-efb9-4b30-b885-514e4aecf245" status: 200 len: 194 microversion: 2.20 time: 0.042616 Apr 29 08:58:30.784385 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 396/790] 10.222.0.31 () {60 vars in 1453 bytes} [Fri Apr 29 08:58:30 2022] GET /compute/v2.1/servers/406b5ad6-698e-457f-93f4-cdfd45fb3e8e/os-volume_attachments/4f915c48-efb9-4b30-b885-514e4aecf245 => generated 194 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 29 08:58:30.846929 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-ec4074dd-1896-49e5-a428-cc95080edd3b tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Calling method '>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:58:30.847424 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-ec4074dd-1896-49e5-a428-cc95080edd3b tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] [instance: 406b5ad6-698e-457f-93f4-cdfd45fb3e8e] Fetching instance by UUID {{(pid=123459) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:58:30.854462 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-ec4074dd-1896-49e5-a428-cc95080edd3b tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:58:30.854908 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-ec4074dd-1896-49e5-a428-cc95080edd3b tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:58:30.855675 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-ec4074dd-1896-49e5-a428-cc95080edd3b tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:58:30.856116 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-ec4074dd-1896-49e5-a428-cc95080edd3b tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:58:30.897689 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-3431271a-3e17-4311-ab6b-d5a1b909f0f3 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Calling method '>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:58:30.898384 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-3431271a-3e17-4311-ab6b-d5a1b909f0f3 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] [instance: f4be98bb-be88-421f-a448-f04a4f97702b] Fetching instance by UUID {{(pid=123458) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:58:30.906237 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-3431271a-3e17-4311-ab6b-d5a1b909f0f3 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:58:30.906828 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-3431271a-3e17-4311-ab6b-d5a1b909f0f3 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:58:30.907865 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-3431271a-3e17-4311-ab6b-d5a1b909f0f3 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:58:30.908488 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-3431271a-3e17-4311-ab6b-d5a1b909f0f3 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:58:30.987300 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.objects.instance [None req-ec4074dd-1896-49e5-a428-cc95080edd3b tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lazy-loading 'services' on Instance uuid 406b5ad6-698e-457f-93f4-cdfd45fb3e8e {{(pid=123459) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 29 08:58:31.071918 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-3431271a-3e17-4311-ab6b-d5a1b909f0f3 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c18e88436f14dc7a2001220b87ce9ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60998f08c40446e787ead285e40665b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:58:31.080195 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-3431271a-3e17-4311-ab6b-d5a1b909f0f3 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] 10.222.0.31 "GET /compute/v2.1/servers/f4be98bb-be88-421f-a448-f04a4f97702b" status: 200 len: 1735 microversion: 2.1 time: 0.188442 Apr 29 08:58:31.090829 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 397/791] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 08:58:30 2022] GET /compute/v2.1/servers/f4be98bb-be88-421f-a448-f04a4f97702b => generated 1735 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 29 08:58:31.101600 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-b684e8ff-7080-4fbb-a290-8311ddbaa2e6 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Calling method '>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:58:31.102324 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-b684e8ff-7080-4fbb-a290-8311ddbaa2e6 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] [instance: 6722378c-3c16-480e-b7de-4f9c8696fa03] Fetching instance by UUID {{(pid=123458) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:58:31.108575 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-b684e8ff-7080-4fbb-a290-8311ddbaa2e6 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:58:31.109021 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-b684e8ff-7080-4fbb-a290-8311ddbaa2e6 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:58:31.109784 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-b684e8ff-7080-4fbb-a290-8311ddbaa2e6 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:58:31.110212 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-b684e8ff-7080-4fbb-a290-8311ddbaa2e6 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:58:31.111633 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-ec4074dd-1896-49e5-a428-cc95080edd3b tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] 10.222.0.31 "DELETE /compute/v2.1/servers/406b5ad6-698e-457f-93f4-cdfd45fb3e8e/os-volume_attachments/4f915c48-efb9-4b30-b885-514e4aecf245" status: 202 len: 0 microversion: 2.20 time: 0.268522 Apr 29 08:58:31.115736 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 395/792] 10.222.0.31 () {60 vars in 1456 bytes} [Fri Apr 29 08:58:30 2022] DELETE /compute/v2.1/servers/406b5ad6-698e-457f-93f4-cdfd45fb3e8e/os-volume_attachments/4f915c48-efb9-4b30-b885-514e4aecf245 => generated 0 bytes in 273 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Apr 29 08:58:31.121498 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-941933f2-a316-41c1-8a94-c4ef5f794082 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Calling method '>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:58:31.122595 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-941933f2-a316-41c1-8a94-c4ef5f794082 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] [instance: 406b5ad6-698e-457f-93f4-cdfd45fb3e8e] Fetching instance by UUID {{(pid=123459) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:58:31.129064 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-941933f2-a316-41c1-8a94-c4ef5f794082 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:58:31.129519 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-941933f2-a316-41c1-8a94-c4ef5f794082 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:58:31.130307 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-941933f2-a316-41c1-8a94-c4ef5f794082 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:58:31.131246 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-941933f2-a316-41c1-8a94-c4ef5f794082 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:58:31.167107 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-941933f2-a316-41c1-8a94-c4ef5f794082 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] 10.222.0.31 "GET /compute/v2.1/servers/406b5ad6-698e-457f-93f4-cdfd45fb3e8e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050017 Apr 29 08:58:31.167704 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 396/793] 10.222.0.31 () {60 vars in 1342 bytes} [Fri Apr 29 08:58:31 2022] GET /compute/v2.1/servers/406b5ad6-698e-457f-93f4-cdfd45fb3e8e/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 29 08:58:31.246906 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-b684e8ff-7080-4fbb-a290-8311ddbaa2e6 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e47ecdfb01f447699275b13255c15d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578e6a35974d4e5c8a0cd4e5fa994259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:58:31.254160 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-b684e8ff-7080-4fbb-a290-8311ddbaa2e6 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] 10.222.0.31 "GET /compute/v2.1/servers/6722378c-3c16-480e-b7de-4f9c8696fa03" status: 200 len: 1367 microversion: 2.1 time: 0.157052 Apr 29 08:58:31.254731 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 398/794] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 08:58:31 2022] GET /compute/v2.1/servers/6722378c-3c16-480e-b7de-4f9c8696fa03 => generated 1367 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 29 08:58:31.569848 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-6633ff6d-c0d0-43ee-a264-7249b1f1eec2 tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] Calling method '>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:58:31.570501 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-6633ff6d-c0d0-43ee-a264-7249b1f1eec2 tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] [instance: d83c29d2-6435-4edc-827b-2c37a66fb199] Fetching instance by UUID {{(pid=123459) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:58:31.576837 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-6633ff6d-c0d0-43ee-a264-7249b1f1eec2 tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:58:31.577582 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-6633ff6d-c0d0-43ee-a264-7249b1f1eec2 tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:58:31.578374 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-6633ff6d-c0d0-43ee-a264-7249b1f1eec2 tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:58:31.578816 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-6633ff6d-c0d0-43ee-a264-7249b1f1eec2 tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:58:31.718777 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-6633ff6d-c0d0-43ee-a264-7249b1f1eec2 tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcf1c67873b7443084ea183c77698062', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0436edb5348a4ad5a0b6b5979a7c54fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:58:31.727068 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-6633ff6d-c0d0-43ee-a264-7249b1f1eec2 tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] 10.222.0.31 "GET /compute/v2.1/servers/d83c29d2-6435-4edc-827b-2c37a66fb199" status: 200 len: 1571 microversion: 2.1 time: 0.162506 Apr 29 08:58:31.727639 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 397/795] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 08:58:31 2022] GET /compute/v2.1/servers/d83c29d2-6435-4edc-827b-2c37a66fb199 => generated 1571 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 08:58:32.098459 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-285f4849-efaf-4567-be52-796589f76ab9 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Calling method '>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:58:32.099074 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-285f4849-efaf-4567-be52-796589f76ab9 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] [instance: f4be98bb-be88-421f-a448-f04a4f97702b] Fetching instance by UUID {{(pid=123458) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:58:32.106965 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-285f4849-efaf-4567-be52-796589f76ab9 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:58:32.107598 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-285f4849-efaf-4567-be52-796589f76ab9 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:58:32.108475 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-285f4849-efaf-4567-be52-796589f76ab9 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:58:32.108917 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-285f4849-efaf-4567-be52-796589f76ab9 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:58:32.179955 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-af8a9254-8dc5-4608-98c1-eab3ab957542 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Calling method '>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:58:32.180922 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-af8a9254-8dc5-4608-98c1-eab3ab957542 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] [instance: 406b5ad6-698e-457f-93f4-cdfd45fb3e8e] Fetching instance by UUID {{(pid=123459) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:58:32.188526 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-af8a9254-8dc5-4608-98c1-eab3ab957542 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:58:32.188836 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-af8a9254-8dc5-4608-98c1-eab3ab957542 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:58:32.189675 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-af8a9254-8dc5-4608-98c1-eab3ab957542 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:58:32.190127 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-af8a9254-8dc5-4608-98c1-eab3ab957542 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:58:32.221941 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-af8a9254-8dc5-4608-98c1-eab3ab957542 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] 10.222.0.31 "GET /compute/v2.1/servers/406b5ad6-698e-457f-93f4-cdfd45fb3e8e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046703 Apr 29 08:58:32.222523 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 398/796] 10.222.0.31 () {60 vars in 1342 bytes} [Fri Apr 29 08:58:32 2022] GET /compute/v2.1/servers/406b5ad6-698e-457f-93f4-cdfd45fb3e8e/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Apr 29 08:58:32.246492 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-285f4849-efaf-4567-be52-796589f76ab9 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c18e88436f14dc7a2001220b87ce9ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60998f08c40446e787ead285e40665b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:58:32.254923 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-285f4849-efaf-4567-be52-796589f76ab9 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] 10.222.0.31 "GET /compute/v2.1/servers/f4be98bb-be88-421f-a448-f04a4f97702b" status: 200 len: 1735 microversion: 2.1 time: 0.160416 Apr 29 08:58:32.255745 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 399/797] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 08:58:32 2022] GET /compute/v2.1/servers/f4be98bb-be88-421f-a448-f04a4f97702b => generated 1735 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 08:58:32.272559 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-913a80e6-50e7-4eee-9b07-8eb8275cff2d tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Calling method '>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:58:32.273202 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-913a80e6-50e7-4eee-9b07-8eb8275cff2d tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] [instance: 6722378c-3c16-480e-b7de-4f9c8696fa03] Fetching instance by UUID {{(pid=123459) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:58:32.279180 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-913a80e6-50e7-4eee-9b07-8eb8275cff2d tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:58:32.279627 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-913a80e6-50e7-4eee-9b07-8eb8275cff2d tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:58:32.280440 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-913a80e6-50e7-4eee-9b07-8eb8275cff2d tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:58:32.280877 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-913a80e6-50e7-4eee-9b07-8eb8275cff2d tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:58:32.419810 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-913a80e6-50e7-4eee-9b07-8eb8275cff2d tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e47ecdfb01f447699275b13255c15d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578e6a35974d4e5c8a0cd4e5fa994259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:58:32.428070 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-913a80e6-50e7-4eee-9b07-8eb8275cff2d tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] 10.222.0.31 "GET /compute/v2.1/servers/6722378c-3c16-480e-b7de-4f9c8696fa03" status: 200 len: 1367 microversion: 2.1 time: 0.159232 Apr 29 08:58:32.428810 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 399/798] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 08:58:32 2022] GET /compute/v2.1/servers/6722378c-3c16-480e-b7de-4f9c8696fa03 => generated 1367 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 08:58:32.745404 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-19a2dea0-0a74-4b95-90c3-0edd7637cc6f tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] Calling method '>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:58:32.746052 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-19a2dea0-0a74-4b95-90c3-0edd7637cc6f tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] [instance: d83c29d2-6435-4edc-827b-2c37a66fb199] Fetching instance by UUID {{(pid=123458) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:58:32.751968 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-19a2dea0-0a74-4b95-90c3-0edd7637cc6f tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:58:32.752454 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-19a2dea0-0a74-4b95-90c3-0edd7637cc6f tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:58:32.753242 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-19a2dea0-0a74-4b95-90c3-0edd7637cc6f tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:58:32.753684 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-19a2dea0-0a74-4b95-90c3-0edd7637cc6f tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:58:32.888504 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-19a2dea0-0a74-4b95-90c3-0edd7637cc6f tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcf1c67873b7443084ea183c77698062', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0436edb5348a4ad5a0b6b5979a7c54fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:58:32.895807 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-19a2dea0-0a74-4b95-90c3-0edd7637cc6f tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] 10.222.0.31 "GET /compute/v2.1/servers/d83c29d2-6435-4edc-827b-2c37a66fb199" status: 200 len: 1571 microversion: 2.1 time: 0.154719 Apr 29 08:58:32.896496 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 400/799] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 08:58:32 2022] GET /compute/v2.1/servers/d83c29d2-6435-4edc-827b-2c37a66fb199 => generated 1571 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 08:58:33.234449 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-af8a191e-163a-41ad-9e34-40b3e4d56f89 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Calling method '>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:58:33.235447 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-af8a191e-163a-41ad-9e34-40b3e4d56f89 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] [instance: 406b5ad6-698e-457f-93f4-cdfd45fb3e8e] Fetching instance by UUID {{(pid=123459) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:58:33.242915 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-af8a191e-163a-41ad-9e34-40b3e4d56f89 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:58:33.243296 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-af8a191e-163a-41ad-9e34-40b3e4d56f89 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:58:33.244077 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-af8a191e-163a-41ad-9e34-40b3e4d56f89 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:58:33.244541 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-af8a191e-163a-41ad-9e34-40b3e4d56f89 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:58:33.273861 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-ed80403a-a6d4-4064-86b7-614937a13614 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Calling method '>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:58:33.274494 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-ed80403a-a6d4-4064-86b7-614937a13614 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] [instance: f4be98bb-be88-421f-a448-f04a4f97702b] Fetching instance by UUID {{(pid=123458) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:58:33.276841 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-af8a191e-163a-41ad-9e34-40b3e4d56f89 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] 10.222.0.31 "GET /compute/v2.1/servers/406b5ad6-698e-457f-93f4-cdfd45fb3e8e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046341 Apr 29 08:58:33.277752 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 400/800] 10.222.0.31 () {60 vars in 1342 bytes} [Fri Apr 29 08:58:33 2022] GET /compute/v2.1/servers/406b5ad6-698e-457f-93f4-cdfd45fb3e8e/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 29 08:58:33.281568 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-ed80403a-a6d4-4064-86b7-614937a13614 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:58:33.282019 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-ed80403a-a6d4-4064-86b7-614937a13614 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:58:33.282806 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-ed80403a-a6d4-4064-86b7-614937a13614 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:58:33.283240 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-ed80403a-a6d4-4064-86b7-614937a13614 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:58:33.416007 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-ed80403a-a6d4-4064-86b7-614937a13614 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c18e88436f14dc7a2001220b87ce9ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60998f08c40446e787ead285e40665b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:58:33.424532 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-ed80403a-a6d4-4064-86b7-614937a13614 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] 10.222.0.31 "GET /compute/v2.1/servers/f4be98bb-be88-421f-a448-f04a4f97702b" status: 200 len: 1735 microversion: 2.1 time: 0.154820 Apr 29 08:58:33.425126 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 401/801] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 08:58:33 2022] GET /compute/v2.1/servers/f4be98bb-be88-421f-a448-f04a4f97702b => generated 1735 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 29 08:58:33.445118 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-a770186f-11f6-4ac9-9000-038be29dfbee tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Calling method '>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:58:33.445735 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-a770186f-11f6-4ac9-9000-038be29dfbee tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] [instance: 6722378c-3c16-480e-b7de-4f9c8696fa03] Fetching instance by UUID {{(pid=123459) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:58:33.451621 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-a770186f-11f6-4ac9-9000-038be29dfbee tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:58:33.452064 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-a770186f-11f6-4ac9-9000-038be29dfbee tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:58:33.452931 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-a770186f-11f6-4ac9-9000-038be29dfbee tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:58:33.453370 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-a770186f-11f6-4ac9-9000-038be29dfbee tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:58:33.581448 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-a770186f-11f6-4ac9-9000-038be29dfbee tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e47ecdfb01f447699275b13255c15d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578e6a35974d4e5c8a0cd4e5fa994259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:58:33.590109 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-a770186f-11f6-4ac9-9000-038be29dfbee tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] 10.222.0.31 "GET /compute/v2.1/servers/6722378c-3c16-480e-b7de-4f9c8696fa03" status: 200 len: 1367 microversion: 2.1 time: 0.148790 Apr 29 08:58:33.590683 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 401/802] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 08:58:33 2022] GET /compute/v2.1/servers/6722378c-3c16-480e-b7de-4f9c8696fa03 => generated 1367 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 29 08:58:33.913936 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-45c9d024-20dc-4aea-a88b-816dbb60dca3 tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] Calling method '>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:58:33.914453 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-45c9d024-20dc-4aea-a88b-816dbb60dca3 tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] [instance: d83c29d2-6435-4edc-827b-2c37a66fb199] Fetching instance by UUID {{(pid=123458) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:58:33.920625 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-45c9d024-20dc-4aea-a88b-816dbb60dca3 tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:58:33.921077 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-45c9d024-20dc-4aea-a88b-816dbb60dca3 tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:58:33.921861 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-45c9d024-20dc-4aea-a88b-816dbb60dca3 tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:58:33.922286 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-45c9d024-20dc-4aea-a88b-816dbb60dca3 tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:58:34.066680 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-45c9d024-20dc-4aea-a88b-816dbb60dca3 tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcf1c67873b7443084ea183c77698062', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0436edb5348a4ad5a0b6b5979a7c54fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:58:34.074943 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-45c9d024-20dc-4aea-a88b-816dbb60dca3 tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] 10.222.0.31 "GET /compute/v2.1/servers/d83c29d2-6435-4edc-827b-2c37a66fb199" status: 200 len: 1571 microversion: 2.1 time: 0.165859 Apr 29 08:58:34.075513 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 402/803] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 08:58:33 2022] GET /compute/v2.1/servers/d83c29d2-6435-4edc-827b-2c37a66fb199 => generated 1571 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 29 08:58:34.289573 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-ce54cd97-6b39-4e82-975c-02e49da9200c tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Calling method '>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:58:34.290531 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-ce54cd97-6b39-4e82-975c-02e49da9200c tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] [instance: 406b5ad6-698e-457f-93f4-cdfd45fb3e8e] Fetching instance by UUID {{(pid=123459) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:58:34.297210 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-ce54cd97-6b39-4e82-975c-02e49da9200c tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:58:34.297664 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-ce54cd97-6b39-4e82-975c-02e49da9200c tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:58:34.298453 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-ce54cd97-6b39-4e82-975c-02e49da9200c tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:58:34.298893 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-ce54cd97-6b39-4e82-975c-02e49da9200c tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:58:34.331716 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-ce54cd97-6b39-4e82-975c-02e49da9200c tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] 10.222.0.31 "GET /compute/v2.1/servers/406b5ad6-698e-457f-93f4-cdfd45fb3e8e/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.046827 Apr 29 08:58:34.332336 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 402/804] 10.222.0.31 () {60 vars in 1342 bytes} [Fri Apr 29 08:58:34 2022] GET /compute/v2.1/servers/406b5ad6-698e-457f-93f4-cdfd45fb3e8e/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 08:58:34.391591 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-ca8aaeb1-9b30-44d5-b752-fc02ebbc2dc8 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Calling method '>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:58:34.392822 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-ca8aaeb1-9b30-44d5-b752-fc02ebbc2dc8 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] [instance: 406b5ad6-698e-457f-93f4-cdfd45fb3e8e] Fetching instance by UUID {{(pid=123458) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:58:34.401706 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-ca8aaeb1-9b30-44d5-b752-fc02ebbc2dc8 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:58:34.402160 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-ca8aaeb1-9b30-44d5-b752-fc02ebbc2dc8 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:58:34.403019 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-ca8aaeb1-9b30-44d5-b752-fc02ebbc2dc8 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:58:34.403455 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-ca8aaeb1-9b30-44d5-b752-fc02ebbc2dc8 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:58:34.433706 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-ca8aaeb1-9b30-44d5-b752-fc02ebbc2dc8 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] [instance: 406b5ad6-698e-457f-93f4-cdfd45fb3e8e] Going to try to terminate instance {{(pid=123458) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 29 08:58:34.445769 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-dc70d9da-ede2-416f-9009-83867080e3b6 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Calling method '>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:58:34.446871 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-dc70d9da-ede2-416f-9009-83867080e3b6 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] [instance: f4be98bb-be88-421f-a448-f04a4f97702b] Fetching instance by UUID {{(pid=123459) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:58:34.453468 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-dc70d9da-ede2-416f-9009-83867080e3b6 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:58:34.453913 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-dc70d9da-ede2-416f-9009-83867080e3b6 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:58:34.454690 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-dc70d9da-ede2-416f-9009-83867080e3b6 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:58:34.455125 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-dc70d9da-ede2-416f-9009-83867080e3b6 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:58:34.515056 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-ca8aaeb1-9b30-44d5-b752-fc02ebbc2dc8 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] 10.222.0.31 "DELETE /compute/v2.1/servers/406b5ad6-698e-457f-93f4-cdfd45fb3e8e" status: 204 len: 0 microversion: 2.20 time: 0.127012 Apr 29 08:58:34.515654 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 403/805] 10.222.0.31 () {60 vars in 1279 bytes} [Fri Apr 29 08:58:34 2022] DELETE /compute/v2.1/servers/406b5ad6-698e-457f-93f4-cdfd45fb3e8e => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 29 08:58:34.524688 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-12aef9ef-5096-4b51-bc27-6a6faf5b9839 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Calling method '>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:58:34.525383 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-12aef9ef-5096-4b51-bc27-6a6faf5b9839 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] [instance: 406b5ad6-698e-457f-93f4-cdfd45fb3e8e] Fetching instance by UUID {{(pid=123458) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:58:34.531482 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-12aef9ef-5096-4b51-bc27-6a6faf5b9839 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:58:34.531931 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-12aef9ef-5096-4b51-bc27-6a6faf5b9839 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:58:34.532738 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-12aef9ef-5096-4b51-bc27-6a6faf5b9839 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:58:34.533171 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-12aef9ef-5096-4b51-bc27-6a6faf5b9839 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:58:34.682501 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-12aef9ef-5096-4b51-bc27-6a6faf5b9839 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:58:34.692020 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-12aef9ef-5096-4b51-bc27-6a6faf5b9839 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:58:34.694668 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-12aef9ef-5096-4b51-bc27-6a6faf5b9839 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:58:34.695945 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-12aef9ef-5096-4b51-bc27-6a6faf5b9839 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] 10.222.0.31 "GET /compute/v2.1/servers/406b5ad6-698e-457f-93f4-cdfd45fb3e8e" status: 200 len: 1726 microversion: 2.20 time: 0.175767 Apr 29 08:58:34.707069 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 404/806] 10.222.0.31 () {60 vars in 1276 bytes} [Fri Apr 29 08:58:34 2022] GET /compute/v2.1/servers/406b5ad6-698e-457f-93f4-cdfd45fb3e8e => generated 1726 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 29 08:58:34.713349 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-06c6f006-9011-4091-9b5d-32fe64e7310b tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Calling method '>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:58:34.713981 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-06c6f006-9011-4091-9b5d-32fe64e7310b tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] [instance: 6722378c-3c16-480e-b7de-4f9c8696fa03] Fetching instance by UUID {{(pid=123458) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:58:34.722230 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-06c6f006-9011-4091-9b5d-32fe64e7310b tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:58:34.722974 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-06c6f006-9011-4091-9b5d-32fe64e7310b tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:58:34.723803 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-06c6f006-9011-4091-9b5d-32fe64e7310b tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:58:34.724821 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-06c6f006-9011-4091-9b5d-32fe64e7310b tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:58:34.852726 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-dc70d9da-ede2-416f-9009-83867080e3b6 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c18e88436f14dc7a2001220b87ce9ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60998f08c40446e787ead285e40665b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:58:34.860773 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-dc70d9da-ede2-416f-9009-83867080e3b6 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] 10.222.0.31 "GET /compute/v2.1/servers/f4be98bb-be88-421f-a448-f04a4f97702b" status: 200 len: 1735 microversion: 2.1 time: 0.423144 Apr 29 08:58:34.861362 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 403/807] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 08:58:34 2022] GET /compute/v2.1/servers/f4be98bb-be88-421f-a448-f04a4f97702b => generated 1735 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 29 08:58:34.902207 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-06c6f006-9011-4091-9b5d-32fe64e7310b tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e47ecdfb01f447699275b13255c15d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578e6a35974d4e5c8a0cd4e5fa994259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:58:34.909663 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-06c6f006-9011-4091-9b5d-32fe64e7310b tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] 10.222.0.31 "GET /compute/v2.1/servers/6722378c-3c16-480e-b7de-4f9c8696fa03" status: 200 len: 1367 microversion: 2.1 time: 0.212066 Apr 29 08:58:34.910231 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 405/808] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 08:58:34 2022] GET /compute/v2.1/servers/6722378c-3c16-480e-b7de-4f9c8696fa03 => generated 1367 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 08:58:35.093885 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-71966a2b-dc34-4142-b56a-d311b7d28c6d tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] Calling method '>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:58:35.094435 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-71966a2b-dc34-4142-b56a-d311b7d28c6d tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] [instance: d83c29d2-6435-4edc-827b-2c37a66fb199] Fetching instance by UUID {{(pid=123459) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:58:35.100664 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-71966a2b-dc34-4142-b56a-d311b7d28c6d tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:58:35.101116 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-71966a2b-dc34-4142-b56a-d311b7d28c6d tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:58:35.101904 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-71966a2b-dc34-4142-b56a-d311b7d28c6d tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:58:35.102343 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-71966a2b-dc34-4142-b56a-d311b7d28c6d tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:58:35.241675 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-71966a2b-dc34-4142-b56a-d311b7d28c6d tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcf1c67873b7443084ea183c77698062', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0436edb5348a4ad5a0b6b5979a7c54fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:58:35.249522 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-71966a2b-dc34-4142-b56a-d311b7d28c6d tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] 10.222.0.31 "GET /compute/v2.1/servers/d83c29d2-6435-4edc-827b-2c37a66fb199" status: 200 len: 1571 microversion: 2.1 time: 0.160086 Apr 29 08:58:35.250102 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 404/809] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 08:58:35 2022] GET /compute/v2.1/servers/d83c29d2-6435-4edc-827b-2c37a66fb199 => generated 1571 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 08:58:35.714416 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-b3e8acc2-b248-4331-9ab5-6a5dc20b38ed tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Calling method '>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:58:35.715019 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-b3e8acc2-b248-4331-9ab5-6a5dc20b38ed tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] [instance: 406b5ad6-698e-457f-93f4-cdfd45fb3e8e] Fetching instance by UUID {{(pid=123458) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:58:35.721649 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-b3e8acc2-b248-4331-9ab5-6a5dc20b38ed tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:58:35.722089 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-b3e8acc2-b248-4331-9ab5-6a5dc20b38ed tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:58:35.722871 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-b3e8acc2-b248-4331-9ab5-6a5dc20b38ed tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:58:35.723305 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-b3e8acc2-b248-4331-9ab5-6a5dc20b38ed tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:58:35.861046 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-b3e8acc2-b248-4331-9ab5-6a5dc20b38ed tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:58:35.870285 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-b3e8acc2-b248-4331-9ab5-6a5dc20b38ed tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:58:35.871796 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-b3e8acc2-b248-4331-9ab5-6a5dc20b38ed tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:58:35.873008 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-b3e8acc2-b248-4331-9ab5-6a5dc20b38ed tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] 10.222.0.31 "GET /compute/v2.1/servers/406b5ad6-698e-457f-93f4-cdfd45fb3e8e" status: 200 len: 1726 microversion: 2.20 time: 0.162580 Apr 29 08:58:35.873573 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 406/810] 10.222.0.31 () {60 vars in 1276 bytes} [Fri Apr 29 08:58:35 2022] GET /compute/v2.1/servers/406b5ad6-698e-457f-93f4-cdfd45fb3e8e => generated 1726 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 29 08:58:35.877547 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-cc9157d5-74e8-4e3f-98b4-47dd7d721c88 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Calling method '>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:58:35.878148 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-cc9157d5-74e8-4e3f-98b4-47dd7d721c88 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] [instance: f4be98bb-be88-421f-a448-f04a4f97702b] Fetching instance by UUID {{(pid=123459) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:58:35.885140 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-cc9157d5-74e8-4e3f-98b4-47dd7d721c88 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:58:35.885605 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-cc9157d5-74e8-4e3f-98b4-47dd7d721c88 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:58:35.886798 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-cc9157d5-74e8-4e3f-98b4-47dd7d721c88 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:58:35.886798 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-cc9157d5-74e8-4e3f-98b4-47dd7d721c88 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:58:35.926556 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-b55289aa-878f-4cbc-9280-c221463148c7 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Calling method '>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:58:35.927168 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-b55289aa-878f-4cbc-9280-c221463148c7 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] [instance: 6722378c-3c16-480e-b7de-4f9c8696fa03] Fetching instance by UUID {{(pid=123458) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:58:35.933691 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-b55289aa-878f-4cbc-9280-c221463148c7 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:58:35.934253 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-b55289aa-878f-4cbc-9280-c221463148c7 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:58:35.935112 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-b55289aa-878f-4cbc-9280-c221463148c7 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:58:35.935558 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-b55289aa-878f-4cbc-9280-c221463148c7 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:58:36.027868 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-cc9157d5-74e8-4e3f-98b4-47dd7d721c88 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c18e88436f14dc7a2001220b87ce9ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60998f08c40446e787ead285e40665b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:58:36.035994 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-cc9157d5-74e8-4e3f-98b4-47dd7d721c88 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] 10.222.0.31 "GET /compute/v2.1/servers/f4be98bb-be88-421f-a448-f04a4f97702b" status: 200 len: 1715 microversion: 2.1 time: 0.162198 Apr 29 08:58:36.036759 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 405/811] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 08:58:35 2022] GET /compute/v2.1/servers/f4be98bb-be88-421f-a448-f04a4f97702b => generated 1715 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 29 08:58:36.075101 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-b55289aa-878f-4cbc-9280-c221463148c7 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e47ecdfb01f447699275b13255c15d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578e6a35974d4e5c8a0cd4e5fa994259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:58:36.082897 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-b55289aa-878f-4cbc-9280-c221463148c7 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] 10.222.0.31 "GET /compute/v2.1/servers/6722378c-3c16-480e-b7de-4f9c8696fa03" status: 200 len: 1557 microversion: 2.1 time: 0.159986 Apr 29 08:58:36.083473 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 407/812] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 08:58:35 2022] GET /compute/v2.1/servers/6722378c-3c16-480e-b7de-4f9c8696fa03 => generated 1557 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 29 08:58:36.091814 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-7c3ed065-8270-4414-a6dd-ca5c284c20fb tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Calling method '>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:58:36.092331 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-7c3ed065-8270-4414-a6dd-ca5c284c20fb tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] [instance: f4be98bb-be88-421f-a448-f04a4f97702b] Fetching instance by UUID {{(pid=123459) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:58:36.098260 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-7c3ed065-8270-4414-a6dd-ca5c284c20fb tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:58:36.098701 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-7c3ed065-8270-4414-a6dd-ca5c284c20fb tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:58:36.100291 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-7c3ed065-8270-4414-a6dd-ca5c284c20fb tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:58:36.100729 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-7c3ed065-8270-4414-a6dd-ca5c284c20fb tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:58:36.101412 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-a3ef8c8b-b154-4c21-8d7a-5caf5970e0c3 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Calling method '>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:58:36.101916 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-a3ef8c8b-b154-4c21-8d7a-5caf5970e0c3 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] [instance: 6722378c-3c16-480e-b7de-4f9c8696fa03] Fetching instance by UUID {{(pid=123458) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:58:36.107873 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-a3ef8c8b-b154-4c21-8d7a-5caf5970e0c3 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:58:36.108368 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-a3ef8c8b-b154-4c21-8d7a-5caf5970e0c3 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:58:36.109150 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-a3ef8c8b-b154-4c21-8d7a-5caf5970e0c3 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:58:36.109584 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-a3ef8c8b-b154-4c21-8d7a-5caf5970e0c3 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:58:36.179881 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.wsgi [None req-7c3ed065-8270-4414-a6dd-ca5c284c20fb tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] HTTP exception thrown: Cannot 'detach_volume' instance f4be98bb-be88-421f-a448-f04a4f97702b while it is in vm_state rescued Apr 29 08:58:36.180505 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-7c3ed065-8270-4414-a6dd-ca5c284c20fb tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Returning 409 to user: Cannot 'detach_volume' instance f4be98bb-be88-421f-a448-f04a4f97702b while it is in vm_state rescued {{(pid=123459) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 29 08:58:36.181345 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-7c3ed065-8270-4414-a6dd-ca5c284c20fb tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] 10.222.0.31 "DELETE /compute/v2.1/servers/f4be98bb-be88-421f-a448-f04a4f97702b/os-volume_attachments/71626bef-d479-4350-9a2d-9412aecca460" status: 409 len: 152 microversion: 2.1 time: 0.093630 Apr 29 08:58:36.181935 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 406/813] 10.222.0.31 () {58 vars in 1415 bytes} [Fri Apr 29 08:58:36 2022] DELETE /compute/v2.1/servers/f4be98bb-be88-421f-a448-f04a4f97702b/os-volume_attachments/71626bef-d479-4350-9a2d-9412aecca460 => generated 152 bytes in 95 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Apr 29 08:58:36.189995 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-020b6483-e7c9-4206-87d8-d604478c5a25 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 29 08:58:36.190526 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-020b6483-e7c9-4206-87d8-d604478c5a25 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] [instance: f4be98bb-be88-421f-a448-f04a4f97702b] Fetching instance by UUID {{(pid=123459) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:58:36.192892 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-a3ef8c8b-b154-4c21-8d7a-5caf5970e0c3 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] 10.222.0.31 "GET /compute/v2.1/servers/6722378c-3c16-480e-b7de-4f9c8696fa03/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.096471 Apr 29 08:58:36.194022 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 408/814] 10.222.0.31 () {58 vars in 1274 bytes} [Fri Apr 29 08:58:36 2022] GET /compute/v2.1/servers/6722378c-3c16-480e-b7de-4f9c8696fa03/os-interface => generated 284 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 29 08:58:36.199006 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-020b6483-e7c9-4206-87d8-d604478c5a25 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:58:36.199451 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-020b6483-e7c9-4206-87d8-d604478c5a25 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:58:36.200256 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-020b6483-e7c9-4206-87d8-d604478c5a25 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:58:36.200689 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-020b6483-e7c9-4206-87d8-d604478c5a25 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:58:36.269999 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-041bcec7-a8db-4d70-a98e-ecaea266ab5a tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] Calling method '>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:58:36.270630 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-041bcec7-a8db-4d70-a98e-ecaea266ab5a tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] [instance: d83c29d2-6435-4edc-827b-2c37a66fb199] Fetching instance by UUID {{(pid=123458) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:58:36.278852 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-020b6483-e7c9-4206-87d8-d604478c5a25 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] 10.222.0.31 "POST /compute/v2.1/servers/f4be98bb-be88-421f-a448-f04a4f97702b/action" status: 202 len: 0 microversion: 2.1 time: 0.090720 Apr 29 08:58:36.279138 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-041bcec7-a8db-4d70-a98e-ecaea266ab5a tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:58:36.279138 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-041bcec7-a8db-4d70-a98e-ecaea266ab5a tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:58:36.279907 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-041bcec7-a8db-4d70-a98e-ecaea266ab5a tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:58:36.280412 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-041bcec7-a8db-4d70-a98e-ecaea266ab5a tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:58:36.280651 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 407/815] 10.222.0.31 () {60 vars in 1277 bytes} [Fri Apr 29 08:58:36 2022] POST /compute/v2.1/servers/f4be98bb-be88-421f-a448-f04a4f97702b/action => generated 0 bytes in 95 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Apr 29 08:58:36.291835 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-0067c2da-f5a5-424a-97bb-0aa70145bf1c tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Calling method '>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:58:36.293446 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-0067c2da-f5a5-424a-97bb-0aa70145bf1c tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] [instance: f4be98bb-be88-421f-a448-f04a4f97702b] Fetching instance by UUID {{(pid=123459) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:58:36.301928 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-0067c2da-f5a5-424a-97bb-0aa70145bf1c tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:58:36.302424 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-0067c2da-f5a5-424a-97bb-0aa70145bf1c tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:58:36.303717 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-0067c2da-f5a5-424a-97bb-0aa70145bf1c tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:58:36.304193 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-0067c2da-f5a5-424a-97bb-0aa70145bf1c tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:58:36.457109 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-0067c2da-f5a5-424a-97bb-0aa70145bf1c tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c18e88436f14dc7a2001220b87ce9ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60998f08c40446e787ead285e40665b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:58:36.473832 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-0067c2da-f5a5-424a-97bb-0aa70145bf1c tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] 10.222.0.31 "GET /compute/v2.1/servers/f4be98bb-be88-421f-a448-f04a4f97702b" status: 200 len: 1723 microversion: 2.1 time: 0.188673 Apr 29 08:58:36.474487 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 408/816] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 08:58:36 2022] GET /compute/v2.1/servers/f4be98bb-be88-421f-a448-f04a4f97702b => generated 1723 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 29 08:58:36.553219 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-041bcec7-a8db-4d70-a98e-ecaea266ab5a tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcf1c67873b7443084ea183c77698062', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0436edb5348a4ad5a0b6b5979a7c54fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:58:36.561088 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-041bcec7-a8db-4d70-a98e-ecaea266ab5a tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] 10.222.0.31 "GET /compute/v2.1/servers/d83c29d2-6435-4edc-827b-2c37a66fb199" status: 200 len: 1571 microversion: 2.1 time: 0.295662 Apr 29 08:58:36.561676 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 409/817] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 08:58:36 2022] GET /compute/v2.1/servers/d83c29d2-6435-4edc-827b-2c37a66fb199 => generated 1571 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 29 08:58:36.892040 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-8124c977-5323-43b9-8fcf-76d88baf206d tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Calling method '>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:58:36.892728 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-8124c977-5323-43b9-8fcf-76d88baf206d tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] [instance: 406b5ad6-698e-457f-93f4-cdfd45fb3e8e] Fetching instance by UUID {{(pid=123459) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:58:36.901323 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-8124c977-5323-43b9-8fcf-76d88baf206d tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:58:36.902143 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-8124c977-5323-43b9-8fcf-76d88baf206d tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:58:36.902556 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-8124c977-5323-43b9-8fcf-76d88baf206d tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:58:36.903006 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-8124c977-5323-43b9-8fcf-76d88baf206d tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:58:37.054953 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-8124c977-5323-43b9-8fcf-76d88baf206d tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:58:37.063403 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-8124c977-5323-43b9-8fcf-76d88baf206d tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:58:37.064949 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-8124c977-5323-43b9-8fcf-76d88baf206d tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:58:37.066143 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-8124c977-5323-43b9-8fcf-76d88baf206d tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] 10.222.0.31 "GET /compute/v2.1/servers/406b5ad6-698e-457f-93f4-cdfd45fb3e8e" status: 200 len: 1726 microversion: 2.20 time: 0.177980 Apr 29 08:58:37.066663 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 409/818] 10.222.0.31 () {60 vars in 1276 bytes} [Fri Apr 29 08:58:36 2022] GET /compute/v2.1/servers/406b5ad6-698e-457f-93f4-cdfd45fb3e8e => generated 1726 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 29 08:58:37.354209 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [req-49a66c93-5f5f-47ba-95b5-dbe132c79188 req-af822018-42d6-454c-8a0a-47f1a9012ebf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6722378c-3c16-480e-b7de-4f9c8696fa03", "tag": "55ac5c5c-82d5-480e-a4e9-c6ff2f7c561c"}]} {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 29 08:58:37.363592 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [req-49a66c93-5f5f-47ba-95b5-dbe132c79188 req-af822018-42d6-454c-8a0a-47f1a9012ebf service nova] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:58:37.364211 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [req-49a66c93-5f5f-47ba-95b5-dbe132c79188 req-af822018-42d6-454c-8a0a-47f1a9012ebf service nova] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:58:37.376760 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.compute.server_external_events [req-49a66c93-5f5f-47ba-95b5-dbe132c79188 req-af822018-42d6-454c-8a0a-47f1a9012ebf service nova] Creating event network-changed:55ac5c5c-82d5-480e-a4e9-c6ff2f7c561c for instance 6722378c-3c16-480e-b7de-4f9c8696fa03 on hv-cinder-83987 Apr 29 08:58:37.381734 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [req-49a66c93-5f5f-47ba-95b5-dbe132c79188 req-af822018-42d6-454c-8a0a-47f1a9012ebf service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032012 Apr 29 08:58:37.382342 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 410/819] 10.222.0.31 () {64 vars in 1317 bytes} [Fri Apr 29 08:58:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 29 08:58:37.491440 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-59cf267d-e910-4f45-9ac9-6357f890d911 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Calling method '>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:58:37.492058 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-59cf267d-e910-4f45-9ac9-6357f890d911 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] [instance: f4be98bb-be88-421f-a448-f04a4f97702b] Fetching instance by UUID {{(pid=123459) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:58:37.498810 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-59cf267d-e910-4f45-9ac9-6357f890d911 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:58:37.499256 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-59cf267d-e910-4f45-9ac9-6357f890d911 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:58:37.500348 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-59cf267d-e910-4f45-9ac9-6357f890d911 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:58:37.500797 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-59cf267d-e910-4f45-9ac9-6357f890d911 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:58:37.579989 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-f84843fa-d572-44c3-ac64-d61e7aaf9541 tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] Calling method '>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:58:37.580887 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-f84843fa-d572-44c3-ac64-d61e7aaf9541 tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] [instance: d83c29d2-6435-4edc-827b-2c37a66fb199] Fetching instance by UUID {{(pid=123458) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:58:37.587953 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-f84843fa-d572-44c3-ac64-d61e7aaf9541 tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:58:37.588623 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-f84843fa-d572-44c3-ac64-d61e7aaf9541 tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:58:37.589501 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-f84843fa-d572-44c3-ac64-d61e7aaf9541 tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:58:37.590155 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-f84843fa-d572-44c3-ac64-d61e7aaf9541 tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:58:37.663309 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-59cf267d-e910-4f45-9ac9-6357f890d911 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c18e88436f14dc7a2001220b87ce9ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60998f08c40446e787ead285e40665b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:58:37.671359 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-59cf267d-e910-4f45-9ac9-6357f890d911 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] 10.222.0.31 "GET /compute/v2.1/servers/f4be98bb-be88-421f-a448-f04a4f97702b" status: 200 len: 1723 microversion: 2.1 time: 0.184341 Apr 29 08:58:37.672283 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 410/820] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 08:58:37 2022] GET /compute/v2.1/servers/f4be98bb-be88-421f-a448-f04a4f97702b => generated 1723 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 08:58:37.752297 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-f84843fa-d572-44c3-ac64-d61e7aaf9541 tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcf1c67873b7443084ea183c77698062', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0436edb5348a4ad5a0b6b5979a7c54fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:58:37.760201 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-f84843fa-d572-44c3-ac64-d61e7aaf9541 tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] 10.222.0.31 "GET /compute/v2.1/servers/d83c29d2-6435-4edc-827b-2c37a66fb199" status: 200 len: 1571 microversion: 2.1 time: 0.184551 Apr 29 08:58:37.760972 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 411/821] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 08:58:37 2022] GET /compute/v2.1/servers/d83c29d2-6435-4edc-827b-2c37a66fb199 => generated 1571 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 29 08:58:38.085668 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-aa35816a-c0f3-41ea-b928-93f53b063120 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Calling method '>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:58:38.086283 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-aa35816a-c0f3-41ea-b928-93f53b063120 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] [instance: 406b5ad6-698e-457f-93f4-cdfd45fb3e8e] Fetching instance by UUID {{(pid=123459) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:58:38.093961 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-aa35816a-c0f3-41ea-b928-93f53b063120 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:58:38.095218 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-aa35816a-c0f3-41ea-b928-93f53b063120 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:58:38.096497 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-aa35816a-c0f3-41ea-b928-93f53b063120 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:58:38.096497 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-aa35816a-c0f3-41ea-b928-93f53b063120 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:58:38.329456 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-aa35816a-c0f3-41ea-b928-93f53b063120 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:58:38.340646 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-aa35816a-c0f3-41ea-b928-93f53b063120 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:58:38.342338 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-aa35816a-c0f3-41ea-b928-93f53b063120 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:58:38.343533 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-aa35816a-c0f3-41ea-b928-93f53b063120 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] 10.222.0.31 "GET /compute/v2.1/servers/406b5ad6-698e-457f-93f4-cdfd45fb3e8e" status: 200 len: 1726 microversion: 2.20 time: 0.263330 Apr 29 08:58:38.356416 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 411/822] 10.222.0.31 () {60 vars in 1276 bytes} [Fri Apr 29 08:58:38 2022] GET /compute/v2.1/servers/406b5ad6-698e-457f-93f4-cdfd45fb3e8e => generated 1726 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 29 08:58:38.690296 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-d2d3c93d-8169-44af-b90f-8db062b676b7 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Calling method '>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:58:38.691246 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-d2d3c93d-8169-44af-b90f-8db062b676b7 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] [instance: f4be98bb-be88-421f-a448-f04a4f97702b] Fetching instance by UUID {{(pid=123458) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:58:38.701559 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-d2d3c93d-8169-44af-b90f-8db062b676b7 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:58:38.702408 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-d2d3c93d-8169-44af-b90f-8db062b676b7 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:58:38.708018 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-d2d3c93d-8169-44af-b90f-8db062b676b7 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:58:38.709001 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-d2d3c93d-8169-44af-b90f-8db062b676b7 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:58:38.777952 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-b543bdeb-0a80-47b3-a89a-4d0ef668558a tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] Calling method '>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:58:38.778567 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-b543bdeb-0a80-47b3-a89a-4d0ef668558a tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] [instance: d83c29d2-6435-4edc-827b-2c37a66fb199] Fetching instance by UUID {{(pid=123459) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:58:38.787237 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-b543bdeb-0a80-47b3-a89a-4d0ef668558a tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:58:38.787921 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-b543bdeb-0a80-47b3-a89a-4d0ef668558a tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:58:38.789194 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-b543bdeb-0a80-47b3-a89a-4d0ef668558a tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:58:38.789871 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-b543bdeb-0a80-47b3-a89a-4d0ef668558a tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:58:38.943660 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-b543bdeb-0a80-47b3-a89a-4d0ef668558a tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcf1c67873b7443084ea183c77698062', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0436edb5348a4ad5a0b6b5979a7c54fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:58:38.951485 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-b543bdeb-0a80-47b3-a89a-4d0ef668558a tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] 10.222.0.31 "GET /compute/v2.1/servers/d83c29d2-6435-4edc-827b-2c37a66fb199" status: 200 len: 1571 microversion: 2.1 time: 0.177343 Apr 29 08:58:38.956553 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 412/823] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 08:58:38 2022] GET /compute/v2.1/servers/d83c29d2-6435-4edc-827b-2c37a66fb199 => generated 1571 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 29 08:58:39.135372 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-d2d3c93d-8169-44af-b90f-8db062b676b7 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c18e88436f14dc7a2001220b87ce9ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60998f08c40446e787ead285e40665b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:58:39.143624 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-d2d3c93d-8169-44af-b90f-8db062b676b7 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] 10.222.0.31 "GET /compute/v2.1/servers/f4be98bb-be88-421f-a448-f04a4f97702b" status: 200 len: 1723 microversion: 2.1 time: 0.457383 Apr 29 08:58:39.144196 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 412/824] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 08:58:38 2022] GET /compute/v2.1/servers/f4be98bb-be88-421f-a448-f04a4f97702b => generated 1723 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 08:58:39.362909 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-1987cc55-1d9c-4af5-a89f-8f9fdc759083 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Calling method '>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:58:39.363550 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-1987cc55-1d9c-4af5-a89f-8f9fdc759083 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] [instance: 406b5ad6-698e-457f-93f4-cdfd45fb3e8e] Fetching instance by UUID {{(pid=123459) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:58:39.370431 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-1987cc55-1d9c-4af5-a89f-8f9fdc759083 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:58:39.370882 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-1987cc55-1d9c-4af5-a89f-8f9fdc759083 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:58:39.371667 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-1987cc55-1d9c-4af5-a89f-8f9fdc759083 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:58:39.372099 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-1987cc55-1d9c-4af5-a89f-8f9fdc759083 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:58:39.437644 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-1987cc55-1d9c-4af5-a89f-8f9fdc759083 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:58:39.446702 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-1987cc55-1d9c-4af5-a89f-8f9fdc759083 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:58:39.448222 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-1987cc55-1d9c-4af5-a89f-8f9fdc759083 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:58:39.449386 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-1987cc55-1d9c-4af5-a89f-8f9fdc759083 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] 10.222.0.31 "GET /compute/v2.1/servers/406b5ad6-698e-457f-93f4-cdfd45fb3e8e" status: 200 len: 1658 microversion: 2.20 time: 0.090427 Apr 29 08:58:39.449950 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 413/825] 10.222.0.31 () {60 vars in 1276 bytes} [Fri Apr 29 08:58:39 2022] GET /compute/v2.1/servers/406b5ad6-698e-457f-93f4-cdfd45fb3e8e => generated 1658 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 29 08:58:39.554060 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [req-035c30fb-86d7-40d0-8da9-013035b3ef15 req-de0e4011-939e-4f61-895a-f4a491f51408 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "406b5ad6-698e-457f-93f4-cdfd45fb3e8e", "name": "network-vif-deleted", "tag": "afdeb60c-c7b1-441b-90f4-293273965fad"}]} {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 29 08:58:39.564015 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [req-035c30fb-86d7-40d0-8da9-013035b3ef15 req-de0e4011-939e-4f61-895a-f4a491f51408 service nova] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:58:39.564900 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [req-035c30fb-86d7-40d0-8da9-013035b3ef15 req-de0e4011-939e-4f61-895a-f4a491f51408 service nova] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:58:39.576809 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.compute.server_external_events [req-035c30fb-86d7-40d0-8da9-013035b3ef15 req-de0e4011-939e-4f61-895a-f4a491f51408 service nova] Creating event network-vif-deleted:afdeb60c-c7b1-441b-90f4-293273965fad for instance 406b5ad6-698e-457f-93f4-cdfd45fb3e8e on hv-cinder-83987 Apr 29 08:58:39.586965 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [req-035c30fb-86d7-40d0-8da9-013035b3ef15 req-de0e4011-939e-4f61-895a-f4a491f51408 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038439 Apr 29 08:58:39.587870 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 413/826] 10.222.0.31 () {64 vars in 1317 bytes} [Fri Apr 29 08:58:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 29 08:58:39.969547 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-89bdabad-82e4-478d-a4f7-2a0bbb10de83 tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] Calling method '>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:58:39.970356 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-89bdabad-82e4-478d-a4f7-2a0bbb10de83 tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] [instance: d83c29d2-6435-4edc-827b-2c37a66fb199] Fetching instance by UUID {{(pid=123459) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:58:39.977295 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-89bdabad-82e4-478d-a4f7-2a0bbb10de83 tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:58:39.977752 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-89bdabad-82e4-478d-a4f7-2a0bbb10de83 tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:58:39.978527 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-89bdabad-82e4-478d-a4f7-2a0bbb10de83 tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:58:39.978971 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-89bdabad-82e4-478d-a4f7-2a0bbb10de83 tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:58:40.117194 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-89bdabad-82e4-478d-a4f7-2a0bbb10de83 tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcf1c67873b7443084ea183c77698062', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0436edb5348a4ad5a0b6b5979a7c54fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:58:40.125241 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-89bdabad-82e4-478d-a4f7-2a0bbb10de83 tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] 10.222.0.31 "GET /compute/v2.1/servers/d83c29d2-6435-4edc-827b-2c37a66fb199" status: 200 len: 1571 microversion: 2.1 time: 0.159474 Apr 29 08:58:40.125878 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 414/827] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 08:58:39 2022] GET /compute/v2.1/servers/d83c29d2-6435-4edc-827b-2c37a66fb199 => generated 1571 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 08:58:40.162061 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-801ce723-1e4b-4696-aedb-58f95d213083 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Calling method '>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:58:40.162965 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-801ce723-1e4b-4696-aedb-58f95d213083 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] [instance: f4be98bb-be88-421f-a448-f04a4f97702b] Fetching instance by UUID {{(pid=123458) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:58:40.169205 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-801ce723-1e4b-4696-aedb-58f95d213083 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:58:40.169587 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-801ce723-1e4b-4696-aedb-58f95d213083 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:58:40.170373 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-801ce723-1e4b-4696-aedb-58f95d213083 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:58:40.170803 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-801ce723-1e4b-4696-aedb-58f95d213083 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:58:40.312970 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-801ce723-1e4b-4696-aedb-58f95d213083 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c18e88436f14dc7a2001220b87ce9ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60998f08c40446e787ead285e40665b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:58:40.322046 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-801ce723-1e4b-4696-aedb-58f95d213083 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] 10.222.0.31 "GET /compute/v2.1/servers/f4be98bb-be88-421f-a448-f04a4f97702b" status: 200 len: 1723 microversion: 2.1 time: 0.164684 Apr 29 08:58:40.322643 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 414/828] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 08:58:40 2022] GET /compute/v2.1/servers/f4be98bb-be88-421f-a448-f04a4f97702b => generated 1723 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 08:58:40.469015 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-3ba73e75-5a57-4400-a592-999b68ede812 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Calling method '>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:58:40.469632 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-3ba73e75-5a57-4400-a592-999b68ede812 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] [instance: 406b5ad6-698e-457f-93f4-cdfd45fb3e8e] Fetching instance by UUID {{(pid=123459) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:58:40.477480 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-3ba73e75-5a57-4400-a592-999b68ede812 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:58:40.477838 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-3ba73e75-5a57-4400-a592-999b68ede812 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:58:40.478623 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-3ba73e75-5a57-4400-a592-999b68ede812 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:58:40.479054 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-3ba73e75-5a57-4400-a592-999b68ede812 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:58:40.551572 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-3ba73e75-5a57-4400-a592-999b68ede812 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:58:40.561948 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-3ba73e75-5a57-4400-a592-999b68ede812 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:58:40.563792 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-3ba73e75-5a57-4400-a592-999b68ede812 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:58:40.565555 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-3ba73e75-5a57-4400-a592-999b68ede812 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] 10.222.0.31 "GET /compute/v2.1/servers/406b5ad6-698e-457f-93f4-cdfd45fb3e8e" status: 200 len: 1658 microversion: 2.20 time: 0.100391 Apr 29 08:58:40.566230 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 415/829] 10.222.0.31 () {60 vars in 1276 bytes} [Fri Apr 29 08:58:40 2022] GET /compute/v2.1/servers/406b5ad6-698e-457f-93f4-cdfd45fb3e8e => generated 1658 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 29 08:58:41.143174 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-da8f1c02-2edd-490e-b54c-6b6a93f35ed8 tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] Calling method '>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:58:41.143787 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-da8f1c02-2edd-490e-b54c-6b6a93f35ed8 tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] [instance: d83c29d2-6435-4edc-827b-2c37a66fb199] Fetching instance by UUID {{(pid=123458) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:58:41.153135 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-da8f1c02-2edd-490e-b54c-6b6a93f35ed8 tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:58:41.153600 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-da8f1c02-2edd-490e-b54c-6b6a93f35ed8 tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:58:41.154372 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-da8f1c02-2edd-490e-b54c-6b6a93f35ed8 tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:58:41.154802 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-da8f1c02-2edd-490e-b54c-6b6a93f35ed8 tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:58:41.295651 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-da8f1c02-2edd-490e-b54c-6b6a93f35ed8 tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcf1c67873b7443084ea183c77698062', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0436edb5348a4ad5a0b6b5979a7c54fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:58:41.303288 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-da8f1c02-2edd-490e-b54c-6b6a93f35ed8 tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] 10.222.0.31 "GET /compute/v2.1/servers/d83c29d2-6435-4edc-827b-2c37a66fb199" status: 200 len: 1571 microversion: 2.1 time: 0.164065 Apr 29 08:58:41.303855 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 415/830] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 08:58:41 2022] GET /compute/v2.1/servers/d83c29d2-6435-4edc-827b-2c37a66fb199 => generated 1571 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 08:58:41.339266 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-eba487c0-7346-4b6a-a584-cc771aa5e73d tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Calling method '>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:58:41.339874 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-eba487c0-7346-4b6a-a584-cc771aa5e73d tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] [instance: f4be98bb-be88-421f-a448-f04a4f97702b] Fetching instance by UUID {{(pid=123459) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:58:41.346378 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-eba487c0-7346-4b6a-a584-cc771aa5e73d tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:58:41.346801 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-eba487c0-7346-4b6a-a584-cc771aa5e73d tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:58:41.347597 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-eba487c0-7346-4b6a-a584-cc771aa5e73d tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:58:41.348043 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-eba487c0-7346-4b6a-a584-cc771aa5e73d tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:58:41.480573 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-eba487c0-7346-4b6a-a584-cc771aa5e73d tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c18e88436f14dc7a2001220b87ce9ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60998f08c40446e787ead285e40665b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:58:41.488555 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-eba487c0-7346-4b6a-a584-cc771aa5e73d tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] 10.222.0.31 "GET /compute/v2.1/servers/f4be98bb-be88-421f-a448-f04a4f97702b" status: 200 len: 1723 microversion: 2.1 time: 0.153040 Apr 29 08:58:41.489119 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 416/831] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 08:58:41 2022] GET /compute/v2.1/servers/f4be98bb-be88-421f-a448-f04a4f97702b => generated 1723 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 08:58:41.584803 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-9b42b590-edf9-41f9-859c-f58249767ce1 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Calling method '>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:58:41.585332 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-9b42b590-edf9-41f9-859c-f58249767ce1 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] [instance: 406b5ad6-698e-457f-93f4-cdfd45fb3e8e] Fetching instance by UUID {{(pid=123458) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:58:41.591492 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-9b42b590-edf9-41f9-859c-f58249767ce1 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:58:41.591976 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-9b42b590-edf9-41f9-859c-f58249767ce1 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:58:41.592789 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-9b42b590-edf9-41f9-859c-f58249767ce1 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:58:41.593225 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-9b42b590-edf9-41f9-859c-f58249767ce1 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:58:41.657651 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-9b42b590-edf9-41f9-859c-f58249767ce1 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:58:41.666472 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-9b42b590-edf9-41f9-859c-f58249767ce1 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:58:41.668550 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-9b42b590-edf9-41f9-859c-f58249767ce1 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:58:41.669688 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-9b42b590-edf9-41f9-859c-f58249767ce1 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] 10.222.0.31 "GET /compute/v2.1/servers/406b5ad6-698e-457f-93f4-cdfd45fb3e8e" status: 200 len: 1367 microversion: 2.20 time: 0.090180 Apr 29 08:58:41.670249 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 416/832] 10.222.0.31 () {60 vars in 1276 bytes} [Fri Apr 29 08:58:41 2022] GET /compute/v2.1/servers/406b5ad6-698e-457f-93f4-cdfd45fb3e8e => generated 1367 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 29 08:58:42.320935 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-646adc26-626f-440a-a84e-2ab61d5e83f7 tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] Calling method '>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:58:42.322026 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-646adc26-626f-440a-a84e-2ab61d5e83f7 tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] [instance: d83c29d2-6435-4edc-827b-2c37a66fb199] Fetching instance by UUID {{(pid=123459) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:58:42.328745 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-646adc26-626f-440a-a84e-2ab61d5e83f7 tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:58:42.329503 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-646adc26-626f-440a-a84e-2ab61d5e83f7 tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:58:42.330682 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-646adc26-626f-440a-a84e-2ab61d5e83f7 tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:58:42.330801 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-646adc26-626f-440a-a84e-2ab61d5e83f7 tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:58:42.470377 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-646adc26-626f-440a-a84e-2ab61d5e83f7 tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcf1c67873b7443084ea183c77698062', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0436edb5348a4ad5a0b6b5979a7c54fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:58:42.478178 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-646adc26-626f-440a-a84e-2ab61d5e83f7 tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] 10.222.0.31 "GET /compute/v2.1/servers/d83c29d2-6435-4edc-827b-2c37a66fb199" status: 200 len: 1571 microversion: 2.1 time: 0.161887 Apr 29 08:58:42.478751 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 417/833] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 08:58:42 2022] GET /compute/v2.1/servers/d83c29d2-6435-4edc-827b-2c37a66fb199 => generated 1571 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 08:58:42.511541 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-ca3d54b4-1a17-4bf4-a04a-48136d46737b tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Calling method '>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:58:42.512098 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-ca3d54b4-1a17-4bf4-a04a-48136d46737b tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] [instance: f4be98bb-be88-421f-a448-f04a4f97702b] Fetching instance by UUID {{(pid=123458) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:58:42.518570 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-ca3d54b4-1a17-4bf4-a04a-48136d46737b tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:58:42.519027 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-ca3d54b4-1a17-4bf4-a04a-48136d46737b tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:58:42.519812 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-ca3d54b4-1a17-4bf4-a04a-48136d46737b tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:58:42.520294 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-ca3d54b4-1a17-4bf4-a04a-48136d46737b tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:58:42.651747 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-ca3d54b4-1a17-4bf4-a04a-48136d46737b tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c18e88436f14dc7a2001220b87ce9ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60998f08c40446e787ead285e40665b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:58:42.662793 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-ca3d54b4-1a17-4bf4-a04a-48136d46737b tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] 10.222.0.31 "GET /compute/v2.1/servers/f4be98bb-be88-421f-a448-f04a4f97702b" status: 200 len: 1729 microversion: 2.1 time: 0.153894 Apr 29 08:58:42.664275 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 417/834] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 08:58:42 2022] GET /compute/v2.1/servers/f4be98bb-be88-421f-a448-f04a4f97702b => generated 1729 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 08:58:42.680930 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-cc052aa0-8b3e-4bc8-a4e5-c5fed6ad0277 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Calling method '>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:58:42.681563 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-cc052aa0-8b3e-4bc8-a4e5-c5fed6ad0277 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] [instance: f4be98bb-be88-421f-a448-f04a4f97702b] Fetching instance by UUID {{(pid=123459) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:58:42.687701 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-cc052aa0-8b3e-4bc8-a4e5-c5fed6ad0277 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:58:42.687898 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-c1d06825-dc3e-41f1-94cf-43998af3ea6d tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Calling method '>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:58:42.688193 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-cc052aa0-8b3e-4bc8-a4e5-c5fed6ad0277 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:58:42.688507 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-c1d06825-dc3e-41f1-94cf-43998af3ea6d tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] [instance: 406b5ad6-698e-457f-93f4-cdfd45fb3e8e] Fetching instance by UUID {{(pid=123458) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:58:42.688948 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-cc052aa0-8b3e-4bc8-a4e5-c5fed6ad0277 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:58:42.689383 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-cc052aa0-8b3e-4bc8-a4e5-c5fed6ad0277 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:58:42.695074 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-c1d06825-dc3e-41f1-94cf-43998af3ea6d tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:58:42.695594 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-c1d06825-dc3e-41f1-94cf-43998af3ea6d tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:58:42.696409 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-c1d06825-dc3e-41f1-94cf-43998af3ea6d tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:58:42.696856 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-c1d06825-dc3e-41f1-94cf-43998af3ea6d tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:58:42.732750 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-c1d06825-dc3e-41f1-94cf-43998af3ea6d tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:58:42.733208 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-c1d06825-dc3e-41f1-94cf-43998af3ea6d tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:58:42.733726 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.objects.instance [None req-c1d06825-dc3e-41f1-94cf-43998af3ea6d tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lazy-loading 'fault' on Instance uuid 406b5ad6-698e-457f-93f4-cdfd45fb3e8e {{(pid=123458) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 29 08:58:42.768564 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-cc052aa0-8b3e-4bc8-a4e5-c5fed6ad0277 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] 10.222.0.31 "GET /compute/v2.1/servers/f4be98bb-be88-421f-a448-f04a4f97702b/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.092617 Apr 29 08:58:42.769172 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 418/835] 10.222.0.31 () {58 vars in 1274 bytes} [Fri Apr 29 08:58:42 2022] GET /compute/v2.1/servers/f4be98bb-be88-421f-a448-f04a4f97702b/os-interface => generated 284 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 29 08:58:42.784640 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-c1d06825-dc3e-41f1-94cf-43998af3ea6d tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:58:42.796831 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-c1d06825-dc3e-41f1-94cf-43998af3ea6d tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:58:42.798896 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-c1d06825-dc3e-41f1-94cf-43998af3ea6d tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:58:42.800924 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-c1d06825-dc3e-41f1-94cf-43998af3ea6d tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] 10.222.0.31 "GET /compute/v2.1/servers/406b5ad6-698e-457f-93f4-cdfd45fb3e8e" status: 200 len: 1372 microversion: 2.20 time: 0.116388 Apr 29 08:58:42.801994 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 418/836] 10.222.0.31 () {60 vars in 1276 bytes} [Fri Apr 29 08:58:42 2022] GET /compute/v2.1/servers/406b5ad6-698e-457f-93f4-cdfd45fb3e8e => generated 1372 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 29 08:58:43.496220 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-cd66aeed-fd0b-42db-8c07-cb3f2ee44755 tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] Calling method '>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:58:43.496841 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-cd66aeed-fd0b-42db-8c07-cb3f2ee44755 tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] [instance: d83c29d2-6435-4edc-827b-2c37a66fb199] Fetching instance by UUID {{(pid=123459) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:58:43.502964 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-cd66aeed-fd0b-42db-8c07-cb3f2ee44755 tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:58:43.503412 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-cd66aeed-fd0b-42db-8c07-cb3f2ee44755 tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:58:43.504334 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-cd66aeed-fd0b-42db-8c07-cb3f2ee44755 tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:58:43.504669 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-cd66aeed-fd0b-42db-8c07-cb3f2ee44755 tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:58:43.700284 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-cd66aeed-fd0b-42db-8c07-cb3f2ee44755 tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcf1c67873b7443084ea183c77698062', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0436edb5348a4ad5a0b6b5979a7c54fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:58:43.707985 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-cd66aeed-fd0b-42db-8c07-cb3f2ee44755 tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] 10.222.0.31 "GET /compute/v2.1/servers/d83c29d2-6435-4edc-827b-2c37a66fb199" status: 200 len: 1571 microversion: 2.1 time: 0.216322 Apr 29 08:58:43.708676 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 419/837] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 08:58:43 2022] GET /compute/v2.1/servers/d83c29d2-6435-4edc-827b-2c37a66fb199 => generated 1571 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 29 08:58:43.821092 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-0f158150-a077-4bb7-a6fe-e3c6a9c54b73 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Calling method '>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:58:43.821997 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-0f158150-a077-4bb7-a6fe-e3c6a9c54b73 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] [instance: 406b5ad6-698e-457f-93f4-cdfd45fb3e8e] Fetching instance by UUID {{(pid=123458) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:58:43.829710 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-0f158150-a077-4bb7-a6fe-e3c6a9c54b73 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:58:43.830159 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-0f158150-a077-4bb7-a6fe-e3c6a9c54b73 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:58:43.831720 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-0f158150-a077-4bb7-a6fe-e3c6a9c54b73 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:58:43.832180 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-0f158150-a077-4bb7-a6fe-e3c6a9c54b73 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:58:43.847842 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.wsgi [None req-0f158150-a077-4bb7-a6fe-e3c6a9c54b73 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] HTTP exception thrown: Instance 406b5ad6-698e-457f-93f4-cdfd45fb3e8e could not be found. Apr 29 08:58:43.848480 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-0f158150-a077-4bb7-a6fe-e3c6a9c54b73 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Returning 404 to user: Instance 406b5ad6-698e-457f-93f4-cdfd45fb3e8e could not be found. {{(pid=123458) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 29 08:58:43.849503 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-0f158150-a077-4bb7-a6fe-e3c6a9c54b73 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] 10.222.0.31 "GET /compute/v2.1/servers/406b5ad6-698e-457f-93f4-cdfd45fb3e8e" status: 404 len: 111 microversion: 2.20 time: 0.033182 Apr 29 08:58:43.853165 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 419/838] 10.222.0.31 () {60 vars in 1276 bytes} [Fri Apr 29 08:58:43 2022] GET /compute/v2.1/servers/406b5ad6-698e-457f-93f4-cdfd45fb3e8e => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 29 08:58:43.858957 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-031f6db4-c428-46dd-842c-4e891c5e4ed5 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Calling method '.version_select at 0x7f623cab6e50>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:58:43.872594 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [req-29a7f933-7b6e-48be-810b-ffe57f6f19ef req-3459cd69-2cab-4e54-9f22-9b556ecc7f40 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f4be98bb-be88-421f-a448-f04a4f97702b", "tag": "e6ef8121-81a9-4773-903b-5d18906a76d1"}]} {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 29 08:58:43.891546 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [req-29a7f933-7b6e-48be-810b-ffe57f6f19ef req-3459cd69-2cab-4e54-9f22-9b556ecc7f40 service nova] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:58:43.892215 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [req-29a7f933-7b6e-48be-810b-ffe57f6f19ef req-3459cd69-2cab-4e54-9f22-9b556ecc7f40 service nova] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:58:43.908841 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-031f6db4-c428-46dd-842c-4e891c5e4ed5 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] 10.222.0.31 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2074566819" status: 204 len: 0 microversion: 2.20 time: 0.054082 Apr 29 08:58:43.909472 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 420/839] 10.222.0.31 () {60 vars in 1261 bytes} [Fri Apr 29 08:58:43 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2074566819 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 29 08:58:43.914704 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.compute.server_external_events [req-29a7f933-7b6e-48be-810b-ffe57f6f19ef req-3459cd69-2cab-4e54-9f22-9b556ecc7f40 service nova] Creating event network-changed:e6ef8121-81a9-4773-903b-5d18906a76d1 for instance f4be98bb-be88-421f-a448-f04a4f97702b on hv-cinder-83987 Apr 29 08:58:43.923673 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [req-29a7f933-7b6e-48be-810b-ffe57f6f19ef req-3459cd69-2cab-4e54-9f22-9b556ecc7f40 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059994 Apr 29 08:58:43.923673 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 420/840] 10.222.0.31 () {64 vars in 1317 bytes} [Fri Apr 29 08:58:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 29 08:58:44.639997 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-3923d653-a3d7-40c1-aac8-d102f96a073e tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Action: 'create', calling method: .version_select at 0x7f623cb70430>, body: {"keypair": {"name": "tempest-keypair-982632728"}} {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 29 08:58:44.658378 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.quota [None req-3923d653-a3d7-40c1-aac8-d102f96a073e tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Getting quotas for project 81c2c3d18ff34afe806e090aec002a4b. Resources: {'key_pairs'} {{(pid=123459) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 29 08:58:44.663707 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.quota [None req-3923d653-a3d7-40c1-aac8-d102f96a073e tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Getting quotas for user abdb65629422487fba47326d5971bb3f and project 81c2c3d18ff34afe806e090aec002a4b. Resources: {'key_pairs'} {{(pid=123459) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 29 08:58:44.736906 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-8b969f1a-42f6-4298-aaa2-912c5a7a84c6 tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] Calling method '>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:58:44.741443 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-8b969f1a-42f6-4298-aaa2-912c5a7a84c6 tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] [instance: d83c29d2-6435-4edc-827b-2c37a66fb199] Fetching instance by UUID {{(pid=123458) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:58:44.758521 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-8b969f1a-42f6-4298-aaa2-912c5a7a84c6 tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:58:44.761278 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-8b969f1a-42f6-4298-aaa2-912c5a7a84c6 tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:58:44.762284 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-8b969f1a-42f6-4298-aaa2-912c5a7a84c6 tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:58:44.764497 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-8b969f1a-42f6-4298-aaa2-912c5a7a84c6 tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:58:44.882055 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.quota [None req-3923d653-a3d7-40c1-aac8-d102f96a073e tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Getting quotas for project 81c2c3d18ff34afe806e090aec002a4b. Resources: {'key_pairs'} {{(pid=123459) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 29 08:58:44.886610 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.quota [None req-3923d653-a3d7-40c1-aac8-d102f96a073e tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Getting quotas for user abdb65629422487fba47326d5971bb3f and project 81c2c3d18ff34afe806e090aec002a4b. Resources: {'key_pairs'} {{(pid=123459) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 29 08:58:44.903758 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-3923d653-a3d7-40c1-aac8-d102f96a073e tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] 10.222.0.31 "POST /compute/v2.1/os-keypairs" status: 201 len: 2319 microversion: 2.20 time: 0.265040 Apr 29 08:58:44.904455 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 421/841] 10.222.0.31 () {62 vars in 1198 bytes} [Fri Apr 29 08:58:44 2022] POST /compute/v2.1/os-keypairs => generated 2319 bytes in 270 msecs (HTTP/1.1 201) 9 headers in 365 bytes (1 switches on core 0) Apr 29 08:58:44.923032 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-8b969f1a-42f6-4298-aaa2-912c5a7a84c6 tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcf1c67873b7443084ea183c77698062', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0436edb5348a4ad5a0b6b5979a7c54fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:58:44.931161 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-8b969f1a-42f6-4298-aaa2-912c5a7a84c6 tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] 10.222.0.31 "GET /compute/v2.1/servers/d83c29d2-6435-4edc-827b-2c37a66fb199" status: 200 len: 1571 microversion: 2.1 time: 0.205041 Apr 29 08:58:44.932170 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 421/842] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 08:58:44 2022] GET /compute/v2.1/servers/d83c29d2-6435-4edc-827b-2c37a66fb199 => generated 1571 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 29 08:58:45.936588 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [req-e9d92409-82c7-49bd-ab1e-fb306cf80ee1 req-bb5798ff-63c1-4d1a-ab30-910af7c3d930 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f4be98bb-be88-421f-a448-f04a4f97702b", "tag": "e6ef8121-81a9-4773-903b-5d18906a76d1"}]} {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 29 08:58:45.946129 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [req-e9d92409-82c7-49bd-ab1e-fb306cf80ee1 req-bb5798ff-63c1-4d1a-ab30-910af7c3d930 service nova] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:58:45.946598 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [req-e9d92409-82c7-49bd-ab1e-fb306cf80ee1 req-bb5798ff-63c1-4d1a-ab30-910af7c3d930 service nova] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:58:45.949900 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-8010d29d-6568-4152-9648-c81c5926b3bc tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] Calling method '>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:58:45.950703 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-8010d29d-6568-4152-9648-c81c5926b3bc tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] [instance: d83c29d2-6435-4edc-827b-2c37a66fb199] Fetching instance by UUID {{(pid=123458) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:58:45.957897 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-8010d29d-6568-4152-9648-c81c5926b3bc tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:58:45.958345 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-8010d29d-6568-4152-9648-c81c5926b3bc tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:58:45.959101 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.compute.server_external_events [req-e9d92409-82c7-49bd-ab1e-fb306cf80ee1 req-bb5798ff-63c1-4d1a-ab30-910af7c3d930 service nova] Creating event network-changed:e6ef8121-81a9-4773-903b-5d18906a76d1 for instance f4be98bb-be88-421f-a448-f04a4f97702b on hv-cinder-83987 Apr 29 08:58:45.959675 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-8010d29d-6568-4152-9648-c81c5926b3bc tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:58:45.960116 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-8010d29d-6568-4152-9648-c81c5926b3bc tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:58:45.965582 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [req-e9d92409-82c7-49bd-ab1e-fb306cf80ee1 req-bb5798ff-63c1-4d1a-ab30-910af7c3d930 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032347 Apr 29 08:58:45.966531 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 422/843] 10.222.0.31 () {64 vars in 1317 bytes} [Fri Apr 29 08:58:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 29 08:58:46.261408 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-8010d29d-6568-4152-9648-c81c5926b3bc tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcf1c67873b7443084ea183c77698062', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0436edb5348a4ad5a0b6b5979a7c54fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:58:46.269433 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-8010d29d-6568-4152-9648-c81c5926b3bc tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] 10.222.0.31 "GET /compute/v2.1/servers/d83c29d2-6435-4edc-827b-2c37a66fb199" status: 200 len: 1571 microversion: 2.1 time: 0.323341 Apr 29 08:58:46.270034 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 422/844] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 08:58:45 2022] GET /compute/v2.1/servers/d83c29d2-6435-4edc-827b-2c37a66fb199 => generated 1571 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 29 08:58:46.373470 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-8d80a676-eb71-4bae-9b9d-b80aaf5244fb tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1430980966", "imageRef": "e0678f88-0b68-4453-b569-29fd065e544e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "88e14c54-6fc1-4ee6-8dc1-d1927744d27d"}], "security_groups": [{"name": "tempest-securitygroup--2035910654"}], "key_name": "tempest-keypair-982632728", "user_data": "}} {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 29 08:58:46.484695 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.network.neutron [None req-8d80a676-eb71-4bae-9b9d-b80aaf5244fb tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] validate_networks() for [('88e14c54-6fc1-4ee6-8dc1-d1927744d27d', None, None, None, None, None)] {{(pid=123459) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 29 08:58:46.871403 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.virt.hardware [None req-8d80a676-eb71-4bae-9b9d-b80aaf5244fb tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Flavor limits 0:0:0 {{(pid=123459) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 29 08:58:46.872046 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.virt.hardware [None req-8d80a676-eb71-4bae-9b9d-b80aaf5244fb tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Image limits 0:0:0 {{(pid=123459) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 29 08:58:46.872721 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.virt.hardware [None req-8d80a676-eb71-4bae-9b9d-b80aaf5244fb tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Flavor pref 0:0:0 {{(pid=123459) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 29 08:58:46.873342 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.virt.hardware [None req-8d80a676-eb71-4bae-9b9d-b80aaf5244fb tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Image pref 0:0:0 {{(pid=123459) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 29 08:58:46.873770 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.virt.hardware [None req-8d80a676-eb71-4bae-9b9d-b80aaf5244fb tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123459) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 29 08:58:46.883695 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-8d80a676-eb71-4bae-9b9d-b80aaf5244fb tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:58:46.885018 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-8d80a676-eb71-4bae-9b9d-b80aaf5244fb tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:58:46.886028 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-8d80a676-eb71-4bae-9b9d-b80aaf5244fb tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:58:46.886631 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-8d80a676-eb71-4bae-9b9d-b80aaf5244fb tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:58:46.904702 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.quota [None req-8d80a676-eb71-4bae-9b9d-b80aaf5244fb tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Getting quotas for project 81c2c3d18ff34afe806e090aec002a4b. Resources: {'instances', 'cores', 'ram'} {{(pid=123459) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 29 08:58:46.908966 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.quota [None req-8d80a676-eb71-4bae-9b9d-b80aaf5244fb tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Getting quotas for user abdb65629422487fba47326d5971bb3f and project 81c2c3d18ff34afe806e090aec002a4b. Resources: {'instances', 'cores', 'ram'} {{(pid=123459) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 29 08:58:46.921877 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-8d80a676-eb71-4bae-9b9d-b80aaf5244fb tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Going to run 1 instances... {{(pid=123459) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 29 08:58:46.934933 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-8d80a676-eb71-4bae-9b9d-b80aaf5244fb tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] [instance: e74dc909-2e3d-4acb-a05a-ed18d4c0f699] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e0678f88-0b68-4453-b569-29fd065e544e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123459) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 29 08:58:46.993033 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-8d80a676-eb71-4bae-9b9d-b80aaf5244fb tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] 10.222.0.31 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.623918 Apr 29 08:58:46.993652 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 423/845] 10.222.0.31 () {62 vars in 1187 bytes} [Fri Apr 29 08:58:46 2022] POST /compute/v2.1/servers => generated 402 bytes in 626 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Apr 29 08:58:47.003646 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-87606b77-6c8b-4040-9fe5-c03bd567c9ab tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Calling method '>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:58:47.004283 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-87606b77-6c8b-4040-9fe5-c03bd567c9ab tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] [instance: e74dc909-2e3d-4acb-a05a-ed18d4c0f699] Fetching instance by UUID {{(pid=123458) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:58:47.067442 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-87606b77-6c8b-4040-9fe5-c03bd567c9ab tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:58:47.075990 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-87606b77-6c8b-4040-9fe5-c03bd567c9ab tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:58:47.077378 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-87606b77-6c8b-4040-9fe5-c03bd567c9ab tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:58:47.078597 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-87606b77-6c8b-4040-9fe5-c03bd567c9ab tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] 10.222.0.31 "GET /compute/v2.1/servers/e74dc909-2e3d-4acb-a05a-ed18d4c0f699" status: 200 len: 1281 microversion: 2.20 time: 0.078763 Apr 29 08:58:47.079058 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 423/846] 10.222.0.31 () {60 vars in 1276 bytes} [Fri Apr 29 08:58:46 2022] GET /compute/v2.1/servers/e74dc909-2e3d-4acb-a05a-ed18d4c0f699 => generated 1281 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 29 08:58:47.287469 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-6a29edd0-5e46-4d05-afcf-3cf931ff40f4 tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] Calling method '>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:58:47.288085 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-6a29edd0-5e46-4d05-afcf-3cf931ff40f4 tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] [instance: d83c29d2-6435-4edc-827b-2c37a66fb199] Fetching instance by UUID {{(pid=123459) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:58:47.294404 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-6a29edd0-5e46-4d05-afcf-3cf931ff40f4 tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:58:47.294859 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-6a29edd0-5e46-4d05-afcf-3cf931ff40f4 tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:58:47.295636 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-6a29edd0-5e46-4d05-afcf-3cf931ff40f4 tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:58:47.296074 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-6a29edd0-5e46-4d05-afcf-3cf931ff40f4 tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:58:47.432419 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-6a29edd0-5e46-4d05-afcf-3cf931ff40f4 tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcf1c67873b7443084ea183c77698062', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0436edb5348a4ad5a0b6b5979a7c54fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:58:47.439873 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-6a29edd0-5e46-4d05-afcf-3cf931ff40f4 tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] 10.222.0.31 "GET /compute/v2.1/servers/d83c29d2-6435-4edc-827b-2c37a66fb199" status: 200 len: 1572 microversion: 2.1 time: 0.156885 Apr 29 08:58:47.440489 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 424/847] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 08:58:47 2022] GET /compute/v2.1/servers/d83c29d2-6435-4edc-827b-2c37a66fb199 => generated 1572 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 08:58:47.457313 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-fc4ad713-dbb0-4546-9eb2-c0376fe548af tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 29 08:58:47.457885 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-fc4ad713-dbb0-4546-9eb2-c0376fe548af tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] [instance: d83c29d2-6435-4edc-827b-2c37a66fb199] Fetching instance by UUID {{(pid=123458) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:58:47.464495 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-fc4ad713-dbb0-4546-9eb2-c0376fe548af tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:58:47.464992 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-fc4ad713-dbb0-4546-9eb2-c0376fe548af tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:58:47.465759 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-fc4ad713-dbb0-4546-9eb2-c0376fe548af tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:58:47.466182 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-fc4ad713-dbb0-4546-9eb2-c0376fe548af tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:58:47.565082 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-fc4ad713-dbb0-4546-9eb2-c0376fe548af tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] 10.222.0.31 "POST /compute/v2.1/servers/d83c29d2-6435-4edc-827b-2c37a66fb199/action" status: 202 len: 0 microversion: 2.1 time: 0.111573 Apr 29 08:58:47.565996 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 424/848] 10.222.0.31 () {60 vars in 1277 bytes} [Fri Apr 29 08:58:47 2022] POST /compute/v2.1/servers/d83c29d2-6435-4edc-827b-2c37a66fb199/action => generated 0 bytes in 113 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Apr 29 08:58:47.574076 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-3332b7d7-c858-4756-9730-2086b0632d0f tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] Calling method '>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:58:47.574776 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-3332b7d7-c858-4756-9730-2086b0632d0f tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] [instance: d83c29d2-6435-4edc-827b-2c37a66fb199] Fetching instance by UUID {{(pid=123459) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:58:47.580994 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-3332b7d7-c858-4756-9730-2086b0632d0f tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:58:47.581458 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-3332b7d7-c858-4756-9730-2086b0632d0f tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:58:47.582217 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-3332b7d7-c858-4756-9730-2086b0632d0f tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:58:47.582655 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-3332b7d7-c858-4756-9730-2086b0632d0f tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:58:47.729063 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-3332b7d7-c858-4756-9730-2086b0632d0f tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcf1c67873b7443084ea183c77698062', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0436edb5348a4ad5a0b6b5979a7c54fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:58:47.736717 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-3332b7d7-c858-4756-9730-2086b0632d0f tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] 10.222.0.31 "GET /compute/v2.1/servers/d83c29d2-6435-4edc-827b-2c37a66fb199" status: 200 len: 1520 microversion: 2.1 time: 0.166552 Apr 29 08:58:47.737299 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 425/849] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 08:58:47 2022] GET /compute/v2.1/servers/d83c29d2-6435-4edc-827b-2c37a66fb199 => generated 1520 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 08:58:48.096766 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-eb1e4171-1129-49c4-a13b-d5285eaedb10 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Calling method '>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:58:48.097460 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-eb1e4171-1129-49c4-a13b-d5285eaedb10 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] [instance: e74dc909-2e3d-4acb-a05a-ed18d4c0f699] Fetching instance by UUID {{(pid=123458) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:58:48.105789 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-eb1e4171-1129-49c4-a13b-d5285eaedb10 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:58:48.106471 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-eb1e4171-1129-49c4-a13b-d5285eaedb10 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:58:48.107413 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-eb1e4171-1129-49c4-a13b-d5285eaedb10 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:58:48.107853 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-eb1e4171-1129-49c4-a13b-d5285eaedb10 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:58:48.175781 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-eb1e4171-1129-49c4-a13b-d5285eaedb10 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:58:48.184860 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-eb1e4171-1129-49c4-a13b-d5285eaedb10 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:58:48.186368 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-eb1e4171-1129-49c4-a13b-d5285eaedb10 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:58:48.187382 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-eb1e4171-1129-49c4-a13b-d5285eaedb10 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] 10.222.0.31 "GET /compute/v2.1/servers/e74dc909-2e3d-4acb-a05a-ed18d4c0f699" status: 200 len: 1333 microversion: 2.20 time: 0.094650 Apr 29 08:58:48.188263 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 425/850] 10.222.0.31 () {60 vars in 1276 bytes} [Fri Apr 29 08:58:48 2022] GET /compute/v2.1/servers/e74dc909-2e3d-4acb-a05a-ed18d4c0f699 => generated 1333 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 29 08:58:48.435846 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [req-5df1543e-4049-4a8f-807b-065720214225 req-1a4ab0d0-19ec-4807-86c2-330a2da6c3f7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d83c29d2-6435-4edc-827b-2c37a66fb199", "name": "network-vif-unplugged", "status": "completed", "tag": "67bd0bd8-da3b-4ea7-9bf9-bfddba4f2c80"}]} {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 29 08:58:48.445777 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [req-5df1543e-4049-4a8f-807b-065720214225 req-1a4ab0d0-19ec-4807-86c2-330a2da6c3f7 service nova] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:58:48.446301 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [req-5df1543e-4049-4a8f-807b-065720214225 req-1a4ab0d0-19ec-4807-86c2-330a2da6c3f7 service nova] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:58:48.458583 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.compute.server_external_events [req-5df1543e-4049-4a8f-807b-065720214225 req-1a4ab0d0-19ec-4807-86c2-330a2da6c3f7 service nova] Unable to find a host for instance d83c29d2-6435-4edc-827b-2c37a66fb199. Dropping event network-vif-unplugged {{(pid=123459) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Apr 29 08:58:48.460095 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [req-5df1543e-4049-4a8f-807b-065720214225 req-1a4ab0d0-19ec-4807-86c2-330a2da6c3f7 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.029584 Apr 29 08:58:48.461033 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 426/851] 10.222.0.31 () {64 vars in 1317 bytes} [Fri Apr 29 08:58:48 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 31 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Apr 29 08:58:48.875325 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-9cb1ff8f-6148-4f00-bdc8-6de37ab19ae9 tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] Calling method '>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:58:48.875982 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-9cb1ff8f-6148-4f00-bdc8-6de37ab19ae9 tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] [instance: d83c29d2-6435-4edc-827b-2c37a66fb199] Fetching instance by UUID {{(pid=123458) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:58:48.890237 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-9cb1ff8f-6148-4f00-bdc8-6de37ab19ae9 tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:58:48.890970 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-9cb1ff8f-6148-4f00-bdc8-6de37ab19ae9 tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:58:48.891972 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-9cb1ff8f-6148-4f00-bdc8-6de37ab19ae9 tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:58:48.892717 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-9cb1ff8f-6148-4f00-bdc8-6de37ab19ae9 tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:58:49.165407 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-9cb1ff8f-6148-4f00-bdc8-6de37ab19ae9 tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcf1c67873b7443084ea183c77698062', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0436edb5348a4ad5a0b6b5979a7c54fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:58:49.173426 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-9cb1ff8f-6148-4f00-bdc8-6de37ab19ae9 tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] 10.222.0.31 "GET /compute/v2.1/servers/d83c29d2-6435-4edc-827b-2c37a66fb199" status: 200 len: 1522 microversion: 2.1 time: 0.422354 Apr 29 08:58:49.174279 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 426/852] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 08:58:48 2022] GET /compute/v2.1/servers/d83c29d2-6435-4edc-827b-2c37a66fb199 => generated 1522 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 08:58:49.207782 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-e7974b67-1510-4c0d-98e9-c22606ea486d tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Calling method '>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:58:49.208488 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-e7974b67-1510-4c0d-98e9-c22606ea486d tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] [instance: e74dc909-2e3d-4acb-a05a-ed18d4c0f699] Fetching instance by UUID {{(pid=123459) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:58:49.216244 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-e7974b67-1510-4c0d-98e9-c22606ea486d tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:58:49.216688 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-e7974b67-1510-4c0d-98e9-c22606ea486d tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:58:49.217459 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-e7974b67-1510-4c0d-98e9-c22606ea486d tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:58:49.218070 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-e7974b67-1510-4c0d-98e9-c22606ea486d tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:58:49.369491 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-e7974b67-1510-4c0d-98e9-c22606ea486d tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:58:49.378224 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-e7974b67-1510-4c0d-98e9-c22606ea486d tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:58:49.380069 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-e7974b67-1510-4c0d-98e9-c22606ea486d tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:58:49.382089 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-e7974b67-1510-4c0d-98e9-c22606ea486d tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] 10.222.0.31 "GET /compute/v2.1/servers/e74dc909-2e3d-4acb-a05a-ed18d4c0f699" status: 200 len: 1407 microversion: 2.20 time: 0.178540 Apr 29 08:58:49.393185 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 427/853] 10.222.0.31 () {60 vars in 1276 bytes} [Fri Apr 29 08:58:49 2022] GET /compute/v2.1/servers/e74dc909-2e3d-4acb-a05a-ed18d4c0f699 => generated 1407 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 29 08:58:50.025035 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [req-dca4e6ba-bbc3-4c10-843d-e3147062962a req-a7284ff3-b700-4b85-a578-c89b4e63357f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e74dc909-2e3d-4acb-a05a-ed18d4c0f699", "tag": "440a5656-f549-48bb-8394-679abd59d5c6"}]} {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 29 08:58:50.036376 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [req-dca4e6ba-bbc3-4c10-843d-e3147062962a req-a7284ff3-b700-4b85-a578-c89b4e63357f service nova] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:58:50.037291 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [req-dca4e6ba-bbc3-4c10-843d-e3147062962a req-a7284ff3-b700-4b85-a578-c89b4e63357f service nova] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:58:50.050117 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.compute.server_external_events [req-dca4e6ba-bbc3-4c10-843d-e3147062962a req-a7284ff3-b700-4b85-a578-c89b4e63357f service nova] Creating event network-changed:440a5656-f549-48bb-8394-679abd59d5c6 for instance e74dc909-2e3d-4acb-a05a-ed18d4c0f699 on hv-cinder-83987 Apr 29 08:58:50.057325 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [req-dca4e6ba-bbc3-4c10-843d-e3147062962a req-a7284ff3-b700-4b85-a578-c89b4e63357f service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047166 Apr 29 08:58:50.057936 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 427/854] 10.222.0.31 () {64 vars in 1317 bytes} [Fri Apr 29 08:58:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 29 08:58:50.191871 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-2fb6330f-af9c-4120-bf39-839e8440fe1f tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] Calling method '>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:58:50.192507 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-2fb6330f-af9c-4120-bf39-839e8440fe1f tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] [instance: d83c29d2-6435-4edc-827b-2c37a66fb199] Fetching instance by UUID {{(pid=123459) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:58:50.199554 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-2fb6330f-af9c-4120-bf39-839e8440fe1f tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:58:50.200003 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-2fb6330f-af9c-4120-bf39-839e8440fe1f tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:58:50.200861 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-2fb6330f-af9c-4120-bf39-839e8440fe1f tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:58:50.201339 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-2fb6330f-af9c-4120-bf39-839e8440fe1f tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:58:50.332963 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-2fb6330f-af9c-4120-bf39-839e8440fe1f tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcf1c67873b7443084ea183c77698062', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0436edb5348a4ad5a0b6b5979a7c54fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:58:50.340332 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-2fb6330f-af9c-4120-bf39-839e8440fe1f tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] 10.222.0.31 "GET /compute/v2.1/servers/d83c29d2-6435-4edc-827b-2c37a66fb199" status: 200 len: 1578 microversion: 2.1 time: 0.152218 Apr 29 08:58:50.340906 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 428/855] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 08:58:50 2022] GET /compute/v2.1/servers/d83c29d2-6435-4edc-827b-2c37a66fb199 => generated 1578 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 08:58:50.401614 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-b9d788e8-27a8-4c23-9e82-a78fcc55ec61 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Calling method '>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:58:50.402318 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-b9d788e8-27a8-4c23-9e82-a78fcc55ec61 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] [instance: e74dc909-2e3d-4acb-a05a-ed18d4c0f699] Fetching instance by UUID {{(pid=123458) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:58:50.409287 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-b9d788e8-27a8-4c23-9e82-a78fcc55ec61 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:58:50.409739 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-b9d788e8-27a8-4c23-9e82-a78fcc55ec61 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:58:50.410565 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-b9d788e8-27a8-4c23-9e82-a78fcc55ec61 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:58:50.411005 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-b9d788e8-27a8-4c23-9e82-a78fcc55ec61 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:58:50.631493 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-b9d788e8-27a8-4c23-9e82-a78fcc55ec61 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:58:50.643608 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-b9d788e8-27a8-4c23-9e82-a78fcc55ec61 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:58:50.645242 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-b9d788e8-27a8-4c23-9e82-a78fcc55ec61 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:58:50.646429 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-b9d788e8-27a8-4c23-9e82-a78fcc55ec61 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] 10.222.0.31 "GET /compute/v2.1/servers/e74dc909-2e3d-4acb-a05a-ed18d4c0f699" status: 200 len: 1407 microversion: 2.20 time: 0.249577 Apr 29 08:58:50.647337 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 428/856] 10.222.0.31 () {60 vars in 1276 bytes} [Fri Apr 29 08:58:50 2022] GET /compute/v2.1/servers/e74dc909-2e3d-4acb-a05a-ed18d4c0f699 => generated 1407 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 29 08:58:51.300069 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-68deb77f-368b-463e-b0ce-40b09bc977ab tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 29 08:58:51.301088 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-68deb77f-368b-463e-b0ce-40b09bc977ab tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] [instance: c3ad1103-185b-4f84-beb9-e1d0e546b2ed] Fetching instance by UUID {{(pid=123459) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:58:51.307483 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-68deb77f-368b-463e-b0ce-40b09bc977ab tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:58:51.307959 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-68deb77f-368b-463e-b0ce-40b09bc977ab tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:58:51.308752 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-68deb77f-368b-463e-b0ce-40b09bc977ab tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:58:51.309182 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-68deb77f-368b-463e-b0ce-40b09bc977ab tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:58:51.357959 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-d61af3ed-35a0-42fc-b97a-e2ef915684fc tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] Calling method '>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:58:51.358593 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-d61af3ed-35a0-42fc-b97a-e2ef915684fc tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] [instance: d83c29d2-6435-4edc-827b-2c37a66fb199] Fetching instance by UUID {{(pid=123458) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:58:51.364689 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-d61af3ed-35a0-42fc-b97a-e2ef915684fc tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:58:51.365146 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-d61af3ed-35a0-42fc-b97a-e2ef915684fc tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:58:51.366079 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-d61af3ed-35a0-42fc-b97a-e2ef915684fc tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:58:51.366560 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-d61af3ed-35a0-42fc-b97a-e2ef915684fc tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:58:51.385208 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-68deb77f-368b-463e-b0ce-40b09bc977ab tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] 10.222.0.31 "POST /compute/v2.1/servers/c3ad1103-185b-4f84-beb9-e1d0e546b2ed/action" status: 202 len: 0 microversion: 2.1 time: 0.088798 Apr 29 08:58:51.386251 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 429/857] 10.222.0.31 () {60 vars in 1277 bytes} [Fri Apr 29 08:58:51 2022] POST /compute/v2.1/servers/c3ad1103-185b-4f84-beb9-e1d0e546b2ed/action => generated 0 bytes in 90 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 29 08:58:51.394450 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-896ec643-0d56-41d4-93ff-a2f9670b47d7 tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] Calling method '>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:58:51.395143 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-896ec643-0d56-41d4-93ff-a2f9670b47d7 tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] [instance: c3ad1103-185b-4f84-beb9-e1d0e546b2ed] Fetching instance by UUID {{(pid=123459) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:58:51.402058 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-896ec643-0d56-41d4-93ff-a2f9670b47d7 tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:58:51.402504 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-896ec643-0d56-41d4-93ff-a2f9670b47d7 tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:58:51.403268 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-896ec643-0d56-41d4-93ff-a2f9670b47d7 tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:58:51.403698 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-896ec643-0d56-41d4-93ff-a2f9670b47d7 tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:58:51.503641 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-d61af3ed-35a0-42fc-b97a-e2ef915684fc tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcf1c67873b7443084ea183c77698062', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0436edb5348a4ad5a0b6b5979a7c54fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:58:51.512417 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-d61af3ed-35a0-42fc-b97a-e2ef915684fc tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] 10.222.0.31 "GET /compute/v2.1/servers/d83c29d2-6435-4edc-827b-2c37a66fb199" status: 200 len: 1578 microversion: 2.1 time: 0.158234 Apr 29 08:58:51.513105 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 429/858] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 08:58:51 2022] GET /compute/v2.1/servers/d83c29d2-6435-4edc-827b-2c37a66fb199 => generated 1578 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 29 08:58:51.557727 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-896ec643-0d56-41d4-93ff-a2f9670b47d7 tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5571352a755f45efa76b6720eb81c9c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6abb4912c175406ca0cefd03e327b7f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:58:51.565642 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-896ec643-0d56-41d4-93ff-a2f9670b47d7 tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] 10.222.0.31 "GET /compute/v2.1/servers/c3ad1103-185b-4f84-beb9-e1d0e546b2ed" status: 200 len: 1753 microversion: 2.1 time: 0.175248 Apr 29 08:58:51.566217 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 430/859] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 08:58:51 2022] GET /compute/v2.1/servers/c3ad1103-185b-4f84-beb9-e1d0e546b2ed => generated 1753 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 29 08:58:51.667098 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-044eb3e1-9a26-46fc-a8df-e1371aa7fa5a tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Calling method '>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:58:51.667695 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-044eb3e1-9a26-46fc-a8df-e1371aa7fa5a tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] [instance: e74dc909-2e3d-4acb-a05a-ed18d4c0f699] Fetching instance by UUID {{(pid=123458) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:58:51.674169 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-044eb3e1-9a26-46fc-a8df-e1371aa7fa5a tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:58:51.674639 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-044eb3e1-9a26-46fc-a8df-e1371aa7fa5a tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:58:51.675408 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-044eb3e1-9a26-46fc-a8df-e1371aa7fa5a tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:58:51.675836 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-044eb3e1-9a26-46fc-a8df-e1371aa7fa5a tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:58:51.806179 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-044eb3e1-9a26-46fc-a8df-e1371aa7fa5a tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:58:51.814222 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-044eb3e1-9a26-46fc-a8df-e1371aa7fa5a tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:58:51.815745 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-044eb3e1-9a26-46fc-a8df-e1371aa7fa5a tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:58:51.816892 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-044eb3e1-9a26-46fc-a8df-e1371aa7fa5a tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] 10.222.0.31 "GET /compute/v2.1/servers/e74dc909-2e3d-4acb-a05a-ed18d4c0f699" status: 200 len: 1407 microversion: 2.20 time: 0.153687 Apr 29 08:58:51.817457 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 430/860] 10.222.0.31 () {60 vars in 1276 bytes} [Fri Apr 29 08:58:51 2022] GET /compute/v2.1/servers/e74dc909-2e3d-4acb-a05a-ed18d4c0f699 => generated 1407 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 29 08:58:52.531147 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-5266dfe8-c513-45d5-9966-060da72cda1d tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] Calling method '>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:58:52.531945 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-5266dfe8-c513-45d5-9966-060da72cda1d tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] [instance: d83c29d2-6435-4edc-827b-2c37a66fb199] Fetching instance by UUID {{(pid=123459) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:58:52.539538 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-5266dfe8-c513-45d5-9966-060da72cda1d tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:58:52.540227 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-5266dfe8-c513-45d5-9966-060da72cda1d tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:58:52.541025 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-5266dfe8-c513-45d5-9966-060da72cda1d tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:58:52.541458 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-5266dfe8-c513-45d5-9966-060da72cda1d tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:58:52.585439 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-712b713f-c91c-424a-884c-3bed9d0c728e tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] Calling method '>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:58:52.586055 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-712b713f-c91c-424a-884c-3bed9d0c728e tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] [instance: c3ad1103-185b-4f84-beb9-e1d0e546b2ed] Fetching instance by UUID {{(pid=123458) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:58:52.592448 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-712b713f-c91c-424a-884c-3bed9d0c728e tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:58:52.592895 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-712b713f-c91c-424a-884c-3bed9d0c728e tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:58:52.593674 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-712b713f-c91c-424a-884c-3bed9d0c728e tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:58:52.594109 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-712b713f-c91c-424a-884c-3bed9d0c728e tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:58:52.673990 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-5266dfe8-c513-45d5-9966-060da72cda1d tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcf1c67873b7443084ea183c77698062', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0436edb5348a4ad5a0b6b5979a7c54fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:58:52.681576 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-5266dfe8-c513-45d5-9966-060da72cda1d tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] 10.222.0.31 "GET /compute/v2.1/servers/d83c29d2-6435-4edc-827b-2c37a66fb199" status: 200 len: 1578 microversion: 2.1 time: 0.154244 Apr 29 08:58:52.682147 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 431/861] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 08:58:52 2022] GET /compute/v2.1/servers/d83c29d2-6435-4edc-827b-2c37a66fb199 => generated 1578 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 08:58:52.742220 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-712b713f-c91c-424a-884c-3bed9d0c728e tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5571352a755f45efa76b6720eb81c9c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6abb4912c175406ca0cefd03e327b7f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:58:52.750109 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-712b713f-c91c-424a-884c-3bed9d0c728e tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] 10.222.0.31 "GET /compute/v2.1/servers/c3ad1103-185b-4f84-beb9-e1d0e546b2ed" status: 200 len: 1753 microversion: 2.1 time: 0.168936 Apr 29 08:58:52.750684 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 431/862] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 08:58:52 2022] GET /compute/v2.1/servers/c3ad1103-185b-4f84-beb9-e1d0e546b2ed => generated 1753 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 29 08:58:52.834708 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-73f62317-3847-4b5a-8873-1012911ef604 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Calling method '>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:58:52.835239 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-73f62317-3847-4b5a-8873-1012911ef604 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] [instance: e74dc909-2e3d-4acb-a05a-ed18d4c0f699] Fetching instance by UUID {{(pid=123459) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:58:52.842122 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-73f62317-3847-4b5a-8873-1012911ef604 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:58:52.842564 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-73f62317-3847-4b5a-8873-1012911ef604 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:58:52.843319 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-73f62317-3847-4b5a-8873-1012911ef604 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:58:52.843748 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-73f62317-3847-4b5a-8873-1012911ef604 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:58:53.214288 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-73f62317-3847-4b5a-8873-1012911ef604 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:58:53.222175 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-73f62317-3847-4b5a-8873-1012911ef604 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:58:53.223691 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-73f62317-3847-4b5a-8873-1012911ef604 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:58:53.225444 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-73f62317-3847-4b5a-8873-1012911ef604 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] 10.222.0.31 "GET /compute/v2.1/servers/e74dc909-2e3d-4acb-a05a-ed18d4c0f699" status: 200 len: 1407 microversion: 2.20 time: 0.394627 Apr 29 08:58:53.226004 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 432/863] 10.222.0.31 () {60 vars in 1276 bytes} [Fri Apr 29 08:58:52 2022] GET /compute/v2.1/servers/e74dc909-2e3d-4acb-a05a-ed18d4c0f699 => generated 1407 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 29 08:58:53.699321 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-a00c6ef3-8cac-4d9f-9804-32e6af674c09 tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] Calling method '>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:58:53.700184 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-a00c6ef3-8cac-4d9f-9804-32e6af674c09 tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] [instance: d83c29d2-6435-4edc-827b-2c37a66fb199] Fetching instance by UUID {{(pid=123458) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:58:53.707290 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-a00c6ef3-8cac-4d9f-9804-32e6af674c09 tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:58:53.707744 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-a00c6ef3-8cac-4d9f-9804-32e6af674c09 tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:58:53.708614 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-a00c6ef3-8cac-4d9f-9804-32e6af674c09 tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:58:53.709229 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-a00c6ef3-8cac-4d9f-9804-32e6af674c09 tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:58:53.767565 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-4d1f0ee6-d4e3-463e-95fd-89bbacf99e36 tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] Calling method '>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:58:53.768187 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-4d1f0ee6-d4e3-463e-95fd-89bbacf99e36 tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] [instance: c3ad1103-185b-4f84-beb9-e1d0e546b2ed] Fetching instance by UUID {{(pid=123459) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:58:53.774366 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-4d1f0ee6-d4e3-463e-95fd-89bbacf99e36 tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:58:53.774818 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-4d1f0ee6-d4e3-463e-95fd-89bbacf99e36 tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:58:53.775600 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-4d1f0ee6-d4e3-463e-95fd-89bbacf99e36 tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:58:53.776030 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-4d1f0ee6-d4e3-463e-95fd-89bbacf99e36 tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:58:53.933177 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-a00c6ef3-8cac-4d9f-9804-32e6af674c09 tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcf1c67873b7443084ea183c77698062', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0436edb5348a4ad5a0b6b5979a7c54fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:58:53.940858 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-4d1f0ee6-d4e3-463e-95fd-89bbacf99e36 tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5571352a755f45efa76b6720eb81c9c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6abb4912c175406ca0cefd03e327b7f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:58:53.942059 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-a00c6ef3-8cac-4d9f-9804-32e6af674c09 tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] 10.222.0.31 "GET /compute/v2.1/servers/d83c29d2-6435-4edc-827b-2c37a66fb199" status: 200 len: 1578 microversion: 2.1 time: 0.246710 Apr 29 08:58:53.942879 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 432/864] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 08:58:53 2022] GET /compute/v2.1/servers/d83c29d2-6435-4edc-827b-2c37a66fb199 => generated 1578 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 08:58:53.955724 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-4d1f0ee6-d4e3-463e-95fd-89bbacf99e36 tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] 10.222.0.31 "GET /compute/v2.1/servers/c3ad1103-185b-4f84-beb9-e1d0e546b2ed" status: 200 len: 1753 microversion: 2.1 time: 0.191871 Apr 29 08:58:53.956349 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 433/865] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 08:58:53 2022] GET /compute/v2.1/servers/c3ad1103-185b-4f84-beb9-e1d0e546b2ed => generated 1753 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 29 08:58:54.245604 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-a4d7c23e-32fb-4fcb-85e2-7d89780d5509 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Calling method '>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:58:54.246539 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-a4d7c23e-32fb-4fcb-85e2-7d89780d5509 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] [instance: e74dc909-2e3d-4acb-a05a-ed18d4c0f699] Fetching instance by UUID {{(pid=123458) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:58:54.256265 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-a4d7c23e-32fb-4fcb-85e2-7d89780d5509 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:58:54.257057 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-a4d7c23e-32fb-4fcb-85e2-7d89780d5509 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:58:54.258447 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-a4d7c23e-32fb-4fcb-85e2-7d89780d5509 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:58:54.259233 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-a4d7c23e-32fb-4fcb-85e2-7d89780d5509 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:58:54.402958 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-a4d7c23e-32fb-4fcb-85e2-7d89780d5509 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:58:54.411452 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-a4d7c23e-32fb-4fcb-85e2-7d89780d5509 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:58:54.413240 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-a4d7c23e-32fb-4fcb-85e2-7d89780d5509 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:58:54.414372 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-a4d7c23e-32fb-4fcb-85e2-7d89780d5509 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] 10.222.0.31 "GET /compute/v2.1/servers/e74dc909-2e3d-4acb-a05a-ed18d4c0f699" status: 200 len: 1407 microversion: 2.20 time: 0.175353 Apr 29 08:58:54.414941 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 433/866] 10.222.0.31 () {60 vars in 1276 bytes} [Fri Apr 29 08:58:54 2022] GET /compute/v2.1/servers/e74dc909-2e3d-4acb-a05a-ed18d4c0f699 => generated 1407 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 29 08:58:54.960343 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-07b2933d-5ea6-415b-9b1e-dcf4ad00f520 tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] Calling method '>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:58:54.960950 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-07b2933d-5ea6-415b-9b1e-dcf4ad00f520 tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] [instance: d83c29d2-6435-4edc-827b-2c37a66fb199] Fetching instance by UUID {{(pid=123459) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:58:54.967669 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-07b2933d-5ea6-415b-9b1e-dcf4ad00f520 tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:58:54.968149 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-07b2933d-5ea6-415b-9b1e-dcf4ad00f520 tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:58:54.968924 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-07b2933d-5ea6-415b-9b1e-dcf4ad00f520 tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:58:54.969366 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-07b2933d-5ea6-415b-9b1e-dcf4ad00f520 tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:58:54.974273 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-fdfe853b-abc7-4391-bc6a-bba09b062f24 tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] Calling method '>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:58:54.975074 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-fdfe853b-abc7-4391-bc6a-bba09b062f24 tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] [instance: c3ad1103-185b-4f84-beb9-e1d0e546b2ed] Fetching instance by UUID {{(pid=123458) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:58:54.981508 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-fdfe853b-abc7-4391-bc6a-bba09b062f24 tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:58:54.981953 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-fdfe853b-abc7-4391-bc6a-bba09b062f24 tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:58:54.982727 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-fdfe853b-abc7-4391-bc6a-bba09b062f24 tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:58:54.983165 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-fdfe853b-abc7-4391-bc6a-bba09b062f24 tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:58:55.104902 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-07b2933d-5ea6-415b-9b1e-dcf4ad00f520 tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcf1c67873b7443084ea183c77698062', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0436edb5348a4ad5a0b6b5979a7c54fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:58:55.112385 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-07b2933d-5ea6-415b-9b1e-dcf4ad00f520 tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] 10.222.0.31 "GET /compute/v2.1/servers/d83c29d2-6435-4edc-827b-2c37a66fb199" status: 200 len: 1578 microversion: 2.1 time: 0.156337 Apr 29 08:58:55.112955 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 434/867] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 08:58:54 2022] GET /compute/v2.1/servers/d83c29d2-6435-4edc-827b-2c37a66fb199 => generated 1578 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 08:58:55.132393 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-fdfe853b-abc7-4391-bc6a-bba09b062f24 tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5571352a755f45efa76b6720eb81c9c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6abb4912c175406ca0cefd03e327b7f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:58:55.140235 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-fdfe853b-abc7-4391-bc6a-bba09b062f24 tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] 10.222.0.31 "GET /compute/v2.1/servers/c3ad1103-185b-4f84-beb9-e1d0e546b2ed" status: 200 len: 1753 microversion: 2.1 time: 0.169839 Apr 29 08:58:55.140799 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 434/868] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 08:58:54 2022] GET /compute/v2.1/servers/c3ad1103-185b-4f84-beb9-e1d0e546b2ed => generated 1753 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 29 08:58:55.432691 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-bafbffce-8636-4af3-8623-fb641a8c1955 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Calling method '>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:58:55.433700 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-bafbffce-8636-4af3-8623-fb641a8c1955 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] [instance: e74dc909-2e3d-4acb-a05a-ed18d4c0f699] Fetching instance by UUID {{(pid=123459) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:58:55.440636 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-bafbffce-8636-4af3-8623-fb641a8c1955 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:58:55.441085 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-bafbffce-8636-4af3-8623-fb641a8c1955 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:58:55.442070 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-bafbffce-8636-4af3-8623-fb641a8c1955 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:58:55.442506 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-bafbffce-8636-4af3-8623-fb641a8c1955 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:58:55.595755 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-bafbffce-8636-4af3-8623-fb641a8c1955 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:58:55.604073 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-bafbffce-8636-4af3-8623-fb641a8c1955 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:58:55.605585 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-bafbffce-8636-4af3-8623-fb641a8c1955 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:58:55.606671 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-bafbffce-8636-4af3-8623-fb641a8c1955 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] 10.222.0.31 "GET /compute/v2.1/servers/e74dc909-2e3d-4acb-a05a-ed18d4c0f699" status: 200 len: 1407 microversion: 2.20 time: 0.177965 Apr 29 08:58:55.607223 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 435/869] 10.222.0.31 () {60 vars in 1276 bytes} [Fri Apr 29 08:58:55 2022] GET /compute/v2.1/servers/e74dc909-2e3d-4acb-a05a-ed18d4c0f699 => generated 1407 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 29 08:58:56.129962 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-f6e548f2-7d75-439d-b6fd-3effa77e08a8 tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] Calling method '>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:58:56.131153 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-f6e548f2-7d75-439d-b6fd-3effa77e08a8 tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] [instance: d83c29d2-6435-4edc-827b-2c37a66fb199] Fetching instance by UUID {{(pid=123458) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:58:56.137637 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-f6e548f2-7d75-439d-b6fd-3effa77e08a8 tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:58:56.138086 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-f6e548f2-7d75-439d-b6fd-3effa77e08a8 tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:58:56.138861 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-f6e548f2-7d75-439d-b6fd-3effa77e08a8 tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:58:56.139316 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-f6e548f2-7d75-439d-b6fd-3effa77e08a8 tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:58:56.157005 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-5f3ec127-4fa9-4eee-a99a-75e0e25d3926 tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] Calling method '>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:58:56.157738 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-5f3ec127-4fa9-4eee-a99a-75e0e25d3926 tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] [instance: c3ad1103-185b-4f84-beb9-e1d0e546b2ed] Fetching instance by UUID {{(pid=123459) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:58:56.164024 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-5f3ec127-4fa9-4eee-a99a-75e0e25d3926 tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:58:56.164502 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-5f3ec127-4fa9-4eee-a99a-75e0e25d3926 tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:58:56.165262 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-5f3ec127-4fa9-4eee-a99a-75e0e25d3926 tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:58:56.165692 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-5f3ec127-4fa9-4eee-a99a-75e0e25d3926 tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:58:56.275635 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-f6e548f2-7d75-439d-b6fd-3effa77e08a8 tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcf1c67873b7443084ea183c77698062', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0436edb5348a4ad5a0b6b5979a7c54fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:58:56.283003 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-f6e548f2-7d75-439d-b6fd-3effa77e08a8 tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] 10.222.0.31 "GET /compute/v2.1/servers/d83c29d2-6435-4edc-827b-2c37a66fb199" status: 200 len: 1578 microversion: 2.1 time: 0.157002 Apr 29 08:58:56.283576 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 435/870] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 08:58:56 2022] GET /compute/v2.1/servers/d83c29d2-6435-4edc-827b-2c37a66fb199 => generated 1578 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 08:58:56.311848 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-5f3ec127-4fa9-4eee-a99a-75e0e25d3926 tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5571352a755f45efa76b6720eb81c9c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6abb4912c175406ca0cefd03e327b7f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:58:56.320422 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-5f3ec127-4fa9-4eee-a99a-75e0e25d3926 tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] 10.222.0.31 "GET /compute/v2.1/servers/c3ad1103-185b-4f84-beb9-e1d0e546b2ed" status: 200 len: 1758 microversion: 2.1 time: 0.167090 Apr 29 08:58:56.320994 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 436/871] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 08:58:56 2022] GET /compute/v2.1/servers/c3ad1103-185b-4f84-beb9-e1d0e546b2ed => generated 1758 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 29 08:58:56.624727 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-c028c3e7-d4f9-4b11-862b-c74853458df0 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Calling method '>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:58:56.625271 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-c028c3e7-d4f9-4b11-862b-c74853458df0 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] [instance: e74dc909-2e3d-4acb-a05a-ed18d4c0f699] Fetching instance by UUID {{(pid=123458) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:58:56.631445 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-c028c3e7-d4f9-4b11-862b-c74853458df0 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:58:56.631870 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-c028c3e7-d4f9-4b11-862b-c74853458df0 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:58:56.632665 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-c028c3e7-d4f9-4b11-862b-c74853458df0 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:58:56.633098 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-c028c3e7-d4f9-4b11-862b-c74853458df0 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:58:56.766991 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-c028c3e7-d4f9-4b11-862b-c74853458df0 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:58:56.775321 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-c028c3e7-d4f9-4b11-862b-c74853458df0 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:58:56.776892 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-c028c3e7-d4f9-4b11-862b-c74853458df0 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:58:56.778016 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-c028c3e7-d4f9-4b11-862b-c74853458df0 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] 10.222.0.31 "GET /compute/v2.1/servers/e74dc909-2e3d-4acb-a05a-ed18d4c0f699" status: 200 len: 1407 microversion: 2.20 time: 0.157220 Apr 29 08:58:56.778576 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 436/872] 10.222.0.31 () {60 vars in 1276 bytes} [Fri Apr 29 08:58:56 2022] GET /compute/v2.1/servers/e74dc909-2e3d-4acb-a05a-ed18d4c0f699 => generated 1407 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 29 08:58:57.300982 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-5e077064-5d91-4c64-8353-7b131cd5c0be tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] Calling method '>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:58:57.301516 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-5e077064-5d91-4c64-8353-7b131cd5c0be tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] [instance: d83c29d2-6435-4edc-827b-2c37a66fb199] Fetching instance by UUID {{(pid=123459) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:58:57.310453 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-5e077064-5d91-4c64-8353-7b131cd5c0be tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:58:57.310903 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-5e077064-5d91-4c64-8353-7b131cd5c0be tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:58:57.312162 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-5e077064-5d91-4c64-8353-7b131cd5c0be tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:58:57.312651 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-5e077064-5d91-4c64-8353-7b131cd5c0be tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:58:57.338294 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-5170415c-887b-40d6-8f21-646fce47c3f4 tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] Calling method '>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:58:57.338908 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-5170415c-887b-40d6-8f21-646fce47c3f4 tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] [instance: c3ad1103-185b-4f84-beb9-e1d0e546b2ed] Fetching instance by UUID {{(pid=123458) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:58:57.345300 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-5170415c-887b-40d6-8f21-646fce47c3f4 tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:58:57.345749 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-5170415c-887b-40d6-8f21-646fce47c3f4 tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:58:57.346522 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-5170415c-887b-40d6-8f21-646fce47c3f4 tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:58:57.346956 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-5170415c-887b-40d6-8f21-646fce47c3f4 tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:58:57.456933 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-5e077064-5d91-4c64-8353-7b131cd5c0be tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcf1c67873b7443084ea183c77698062', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0436edb5348a4ad5a0b6b5979a7c54fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:58:57.465623 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-5e077064-5d91-4c64-8353-7b131cd5c0be tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] 10.222.0.31 "GET /compute/v2.1/servers/d83c29d2-6435-4edc-827b-2c37a66fb199" status: 200 len: 1578 microversion: 2.1 time: 0.168470 Apr 29 08:58:57.466207 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 437/873] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 08:58:57 2022] GET /compute/v2.1/servers/d83c29d2-6435-4edc-827b-2c37a66fb199 => generated 1578 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 08:58:57.498878 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-5170415c-887b-40d6-8f21-646fce47c3f4 tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5571352a755f45efa76b6720eb81c9c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6abb4912c175406ca0cefd03e327b7f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:58:57.507631 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-5170415c-887b-40d6-8f21-646fce47c3f4 tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] 10.222.0.31 "GET /compute/v2.1/servers/c3ad1103-185b-4f84-beb9-e1d0e546b2ed" status: 200 len: 1758 microversion: 2.1 time: 0.173901 Apr 29 08:58:57.508234 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 437/874] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 08:58:57 2022] GET /compute/v2.1/servers/c3ad1103-185b-4f84-beb9-e1d0e546b2ed => generated 1758 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 29 08:58:57.796954 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-371d85d4-3d61-45cc-b3a6-8d5091ce4154 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Calling method '>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:58:57.797567 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-371d85d4-3d61-45cc-b3a6-8d5091ce4154 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] [instance: e74dc909-2e3d-4acb-a05a-ed18d4c0f699] Fetching instance by UUID {{(pid=123459) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:58:57.805329 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-371d85d4-3d61-45cc-b3a6-8d5091ce4154 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:58:57.805811 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-371d85d4-3d61-45cc-b3a6-8d5091ce4154 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:58:57.806586 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-371d85d4-3d61-45cc-b3a6-8d5091ce4154 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:58:57.807020 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-371d85d4-3d61-45cc-b3a6-8d5091ce4154 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:58:57.942218 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-371d85d4-3d61-45cc-b3a6-8d5091ce4154 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:58:57.951477 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-371d85d4-3d61-45cc-b3a6-8d5091ce4154 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:58:57.953121 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-371d85d4-3d61-45cc-b3a6-8d5091ce4154 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:58:57.954238 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-371d85d4-3d61-45cc-b3a6-8d5091ce4154 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] 10.222.0.31 "GET /compute/v2.1/servers/e74dc909-2e3d-4acb-a05a-ed18d4c0f699" status: 200 len: 1407 microversion: 2.20 time: 0.161226 Apr 29 08:58:57.954811 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 438/875] 10.222.0.31 () {60 vars in 1276 bytes} [Fri Apr 29 08:58:57 2022] GET /compute/v2.1/servers/e74dc909-2e3d-4acb-a05a-ed18d4c0f699 => generated 1407 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 29 08:58:58.483476 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-0791eb34-4efb-43f6-ba23-c3ba4de11d47 tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] Calling method '>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:58:58.484257 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-0791eb34-4efb-43f6-ba23-c3ba4de11d47 tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] [instance: d83c29d2-6435-4edc-827b-2c37a66fb199] Fetching instance by UUID {{(pid=123458) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:58:58.494714 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-0791eb34-4efb-43f6-ba23-c3ba4de11d47 tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:58:58.495287 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-0791eb34-4efb-43f6-ba23-c3ba4de11d47 tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:58:58.496345 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-0791eb34-4efb-43f6-ba23-c3ba4de11d47 tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:58:58.496843 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-0791eb34-4efb-43f6-ba23-c3ba4de11d47 tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:58:58.526760 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-3f076b81-f405-4a2b-b21a-3e6d1dc448bf tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] Calling method '>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:58:58.528285 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-3f076b81-f405-4a2b-b21a-3e6d1dc448bf tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] [instance: c3ad1103-185b-4f84-beb9-e1d0e546b2ed] Fetching instance by UUID {{(pid=123459) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:58:58.535218 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-3f076b81-f405-4a2b-b21a-3e6d1dc448bf tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:58:58.535677 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-3f076b81-f405-4a2b-b21a-3e6d1dc448bf tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:58:58.536614 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-3f076b81-f405-4a2b-b21a-3e6d1dc448bf tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:58:58.537349 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-3f076b81-f405-4a2b-b21a-3e6d1dc448bf tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:58:58.648512 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-0791eb34-4efb-43f6-ba23-c3ba4de11d47 tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcf1c67873b7443084ea183c77698062', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0436edb5348a4ad5a0b6b5979a7c54fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:58:58.656396 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-0791eb34-4efb-43f6-ba23-c3ba4de11d47 tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] 10.222.0.31 "GET /compute/v2.1/servers/d83c29d2-6435-4edc-827b-2c37a66fb199" status: 200 len: 1578 microversion: 2.1 time: 0.177032 Apr 29 08:58:58.656967 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 438/876] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 08:58:58 2022] GET /compute/v2.1/servers/d83c29d2-6435-4edc-827b-2c37a66fb199 => generated 1578 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 08:58:58.661733 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [req-d63f420e-3a5c-4369-9591-af0b6b1cca48 req-b3681a3a-f53c-47a5-a7bb-a2a86ba0fffb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e74dc909-2e3d-4acb-a05a-ed18d4c0f699", "name": "network-vif-plugged", "status": "completed", "tag": "440a5656-f549-48bb-8394-679abd59d5c6"}]} {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 29 08:58:58.670239 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [req-d63f420e-3a5c-4369-9591-af0b6b1cca48 req-b3681a3a-f53c-47a5-a7bb-a2a86ba0fffb service nova] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:58:58.670708 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [req-d63f420e-3a5c-4369-9591-af0b6b1cca48 req-b3681a3a-f53c-47a5-a7bb-a2a86ba0fffb service nova] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:58:58.683797 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.compute.server_external_events [req-d63f420e-3a5c-4369-9591-af0b6b1cca48 req-b3681a3a-f53c-47a5-a7bb-a2a86ba0fffb service nova] Creating event network-vif-plugged:440a5656-f549-48bb-8394-679abd59d5c6 for instance e74dc909-2e3d-4acb-a05a-ed18d4c0f699 on hv-cinder-83987 Apr 29 08:58:58.689324 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [req-d63f420e-3a5c-4369-9591-af0b6b1cca48 req-b3681a3a-f53c-47a5-a7bb-a2a86ba0fffb service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031183 Apr 29 08:58:58.689943 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 439/877] 10.222.0.31 () {64 vars in 1317 bytes} [Fri Apr 29 08:58:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 29 08:58:58.705629 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-3f076b81-f405-4a2b-b21a-3e6d1dc448bf tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5571352a755f45efa76b6720eb81c9c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6abb4912c175406ca0cefd03e327b7f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:58:58.713760 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-3f076b81-f405-4a2b-b21a-3e6d1dc448bf tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] 10.222.0.31 "GET /compute/v2.1/servers/c3ad1103-185b-4f84-beb9-e1d0e546b2ed" status: 200 len: 1758 microversion: 2.1 time: 0.191647 Apr 29 08:58:58.714338 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 439/878] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 08:58:58 2022] GET /compute/v2.1/servers/c3ad1103-185b-4f84-beb9-e1d0e546b2ed => generated 1758 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 08:58:58.973477 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-9654abbb-026a-4165-b4bc-acef356d4bdc tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Calling method '>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:58:58.974848 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-9654abbb-026a-4165-b4bc-acef356d4bdc tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] [instance: e74dc909-2e3d-4acb-a05a-ed18d4c0f699] Fetching instance by UUID {{(pid=123458) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:58:58.981533 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-9654abbb-026a-4165-b4bc-acef356d4bdc tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:58:58.981975 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-9654abbb-026a-4165-b4bc-acef356d4bdc tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:58:58.982753 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-9654abbb-026a-4165-b4bc-acef356d4bdc tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:58:58.983185 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-9654abbb-026a-4165-b4bc-acef356d4bdc tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:58:59.122683 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-9654abbb-026a-4165-b4bc-acef356d4bdc tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:58:59.131695 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-9654abbb-026a-4165-b4bc-acef356d4bdc tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:58:59.133341 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-9654abbb-026a-4165-b4bc-acef356d4bdc tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:58:59.134508 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-9654abbb-026a-4165-b4bc-acef356d4bdc tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] 10.222.0.31 "GET /compute/v2.1/servers/e74dc909-2e3d-4acb-a05a-ed18d4c0f699" status: 200 len: 1407 microversion: 2.20 time: 0.165350 Apr 29 08:58:59.135083 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 440/879] 10.222.0.31 () {60 vars in 1276 bytes} [Fri Apr 29 08:58:58 2022] GET /compute/v2.1/servers/e74dc909-2e3d-4acb-a05a-ed18d4c0f699 => generated 1407 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 29 08:58:59.682204 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-5c224304-ee28-4295-b284-d2390bb34aab tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] Calling method '>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:58:59.682846 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-5c224304-ee28-4295-b284-d2390bb34aab tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] [instance: d83c29d2-6435-4edc-827b-2c37a66fb199] Fetching instance by UUID {{(pid=123459) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:58:59.689269 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-5c224304-ee28-4295-b284-d2390bb34aab tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:58:59.689721 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-5c224304-ee28-4295-b284-d2390bb34aab tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:58:59.690485 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-5c224304-ee28-4295-b284-d2390bb34aab tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:58:59.690915 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-5c224304-ee28-4295-b284-d2390bb34aab tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:58:59.731611 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-3e4d2030-2502-45dc-8719-f290271a7504 tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] Calling method '>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:58:59.732227 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-3e4d2030-2502-45dc-8719-f290271a7504 tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] [instance: c3ad1103-185b-4f84-beb9-e1d0e546b2ed] Fetching instance by UUID {{(pid=123458) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:58:59.738896 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-3e4d2030-2502-45dc-8719-f290271a7504 tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:58:59.739348 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-3e4d2030-2502-45dc-8719-f290271a7504 tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:58:59.741063 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-3e4d2030-2502-45dc-8719-f290271a7504 tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:58:59.741503 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-3e4d2030-2502-45dc-8719-f290271a7504 tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:58:59.833254 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-5c224304-ee28-4295-b284-d2390bb34aab tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcf1c67873b7443084ea183c77698062', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0436edb5348a4ad5a0b6b5979a7c54fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:58:59.841109 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-5c224304-ee28-4295-b284-d2390bb34aab tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] 10.222.0.31 "GET /compute/v2.1/servers/d83c29d2-6435-4edc-827b-2c37a66fb199" status: 200 len: 1578 microversion: 2.1 time: 0.163330 Apr 29 08:58:59.841689 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 440/880] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 08:58:59 2022] GET /compute/v2.1/servers/d83c29d2-6435-4edc-827b-2c37a66fb199 => generated 1578 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 08:58:59.888836 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-3e4d2030-2502-45dc-8719-f290271a7504 tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5571352a755f45efa76b6720eb81c9c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6abb4912c175406ca0cefd03e327b7f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:58:59.897748 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-3e4d2030-2502-45dc-8719-f290271a7504 tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] 10.222.0.31 "GET /compute/v2.1/servers/c3ad1103-185b-4f84-beb9-e1d0e546b2ed" status: 200 len: 1758 microversion: 2.1 time: 0.169817 Apr 29 08:58:59.898330 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 441/881] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 08:58:59 2022] GET /compute/v2.1/servers/c3ad1103-185b-4f84-beb9-e1d0e546b2ed => generated 1758 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 29 08:59:00.153449 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-0ea0a2e4-c1fb-4aac-a60f-80b04f3ffe13 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Calling method '>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:59:00.154051 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-0ea0a2e4-c1fb-4aac-a60f-80b04f3ffe13 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] [instance: e74dc909-2e3d-4acb-a05a-ed18d4c0f699] Fetching instance by UUID {{(pid=123459) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:59:00.160383 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-0ea0a2e4-c1fb-4aac-a60f-80b04f3ffe13 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:59:00.160830 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-0ea0a2e4-c1fb-4aac-a60f-80b04f3ffe13 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:59:00.162407 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-0ea0a2e4-c1fb-4aac-a60f-80b04f3ffe13 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:59:00.162877 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-0ea0a2e4-c1fb-4aac-a60f-80b04f3ffe13 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:59:00.296874 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-0ea0a2e4-c1fb-4aac-a60f-80b04f3ffe13 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:59:00.304905 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-0ea0a2e4-c1fb-4aac-a60f-80b04f3ffe13 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:59:00.306415 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-0ea0a2e4-c1fb-4aac-a60f-80b04f3ffe13 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:59:00.307499 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-0ea0a2e4-c1fb-4aac-a60f-80b04f3ffe13 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] 10.222.0.31 "GET /compute/v2.1/servers/e74dc909-2e3d-4acb-a05a-ed18d4c0f699" status: 200 len: 1407 microversion: 2.20 time: 0.157950 Apr 29 08:59:00.308057 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 441/882] 10.222.0.31 () {60 vars in 1276 bytes} [Fri Apr 29 08:59:00 2022] GET /compute/v2.1/servers/e74dc909-2e3d-4acb-a05a-ed18d4c0f699 => generated 1407 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 29 08:59:00.858864 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-951aefad-630c-4aa8-9cb1-d0b7cc3a5f47 tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] Calling method '>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:59:00.859468 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-951aefad-630c-4aa8-9cb1-d0b7cc3a5f47 tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] [instance: d83c29d2-6435-4edc-827b-2c37a66fb199] Fetching instance by UUID {{(pid=123458) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:59:00.866514 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-951aefad-630c-4aa8-9cb1-d0b7cc3a5f47 tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:59:00.866955 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-951aefad-630c-4aa8-9cb1-d0b7cc3a5f47 tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:59:00.867719 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-951aefad-630c-4aa8-9cb1-d0b7cc3a5f47 tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:59:00.868439 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-951aefad-630c-4aa8-9cb1-d0b7cc3a5f47 tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:59:00.914934 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-b86a45d5-acc6-4aaf-a331-9ea542a246ef tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] Calling method '>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:59:00.915527 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-b86a45d5-acc6-4aaf-a331-9ea542a246ef tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] [instance: c3ad1103-185b-4f84-beb9-e1d0e546b2ed] Fetching instance by UUID {{(pid=123459) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:59:00.922386 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-b86a45d5-acc6-4aaf-a331-9ea542a246ef tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:59:00.922826 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-b86a45d5-acc6-4aaf-a331-9ea542a246ef tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:59:00.923631 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-b86a45d5-acc6-4aaf-a331-9ea542a246ef tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:59:00.924243 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-b86a45d5-acc6-4aaf-a331-9ea542a246ef tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:59:01.006855 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-951aefad-630c-4aa8-9cb1-d0b7cc3a5f47 tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcf1c67873b7443084ea183c77698062', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0436edb5348a4ad5a0b6b5979a7c54fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:59:01.014400 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-951aefad-630c-4aa8-9cb1-d0b7cc3a5f47 tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] 10.222.0.31 "GET /compute/v2.1/servers/d83c29d2-6435-4edc-827b-2c37a66fb199" status: 200 len: 1578 microversion: 2.1 time: 0.159374 Apr 29 08:59:01.014977 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 442/883] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 08:59:00 2022] GET /compute/v2.1/servers/d83c29d2-6435-4edc-827b-2c37a66fb199 => generated 1578 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 08:59:01.073211 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-b86a45d5-acc6-4aaf-a331-9ea542a246ef tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5571352a755f45efa76b6720eb81c9c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6abb4912c175406ca0cefd03e327b7f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:59:01.081218 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-b86a45d5-acc6-4aaf-a331-9ea542a246ef tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] 10.222.0.31 "GET /compute/v2.1/servers/c3ad1103-185b-4f84-beb9-e1d0e546b2ed" status: 200 len: 1758 microversion: 2.1 time: 0.170277 Apr 29 08:59:01.081793 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 442/884] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 08:59:00 2022] GET /compute/v2.1/servers/c3ad1103-185b-4f84-beb9-e1d0e546b2ed => generated 1758 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 29 08:59:01.326392 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-be315e9e-7915-4db1-9c48-dd84c7123232 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Calling method '>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:59:01.327028 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-be315e9e-7915-4db1-9c48-dd84c7123232 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] [instance: e74dc909-2e3d-4acb-a05a-ed18d4c0f699] Fetching instance by UUID {{(pid=123458) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:59:01.333138 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-be315e9e-7915-4db1-9c48-dd84c7123232 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:59:01.333644 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-be315e9e-7915-4db1-9c48-dd84c7123232 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:59:01.334468 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-be315e9e-7915-4db1-9c48-dd84c7123232 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:59:01.334914 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-be315e9e-7915-4db1-9c48-dd84c7123232 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:59:01.470229 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-be315e9e-7915-4db1-9c48-dd84c7123232 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:59:01.479288 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-be315e9e-7915-4db1-9c48-dd84c7123232 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:59:01.480839 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-be315e9e-7915-4db1-9c48-dd84c7123232 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:59:01.481947 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-be315e9e-7915-4db1-9c48-dd84c7123232 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] 10.222.0.31 "GET /compute/v2.1/servers/e74dc909-2e3d-4acb-a05a-ed18d4c0f699" status: 200 len: 1407 microversion: 2.20 time: 0.159469 Apr 29 08:59:01.482508 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 443/885] 10.222.0.31 () {60 vars in 1276 bytes} [Fri Apr 29 08:59:01 2022] GET /compute/v2.1/servers/e74dc909-2e3d-4acb-a05a-ed18d4c0f699 => generated 1407 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 29 08:59:02.031587 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-b194aca2-ad1d-499d-9510-49d8aca1efa9 tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] Calling method '>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:59:02.032220 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-b194aca2-ad1d-499d-9510-49d8aca1efa9 tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] [instance: d83c29d2-6435-4edc-827b-2c37a66fb199] Fetching instance by UUID {{(pid=123459) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:59:02.039688 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-b194aca2-ad1d-499d-9510-49d8aca1efa9 tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:59:02.040166 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-b194aca2-ad1d-499d-9510-49d8aca1efa9 tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:59:02.041009 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-b194aca2-ad1d-499d-9510-49d8aca1efa9 tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:59:02.041454 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-b194aca2-ad1d-499d-9510-49d8aca1efa9 tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:59:02.099507 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-bcf08419-53ea-4891-9db3-e3bb84a02cd9 tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] Calling method '>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:59:02.101420 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-bcf08419-53ea-4891-9db3-e3bb84a02cd9 tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] [instance: c3ad1103-185b-4f84-beb9-e1d0e546b2ed] Fetching instance by UUID {{(pid=123458) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:59:02.111217 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-bcf08419-53ea-4891-9db3-e3bb84a02cd9 tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:59:02.111573 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-bcf08419-53ea-4891-9db3-e3bb84a02cd9 tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:59:02.112409 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-bcf08419-53ea-4891-9db3-e3bb84a02cd9 tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:59:02.112854 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-bcf08419-53ea-4891-9db3-e3bb84a02cd9 tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:59:02.185131 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-b194aca2-ad1d-499d-9510-49d8aca1efa9 tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcf1c67873b7443084ea183c77698062', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0436edb5348a4ad5a0b6b5979a7c54fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:59:02.192649 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-b194aca2-ad1d-499d-9510-49d8aca1efa9 tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] 10.222.0.31 "GET /compute/v2.1/servers/d83c29d2-6435-4edc-827b-2c37a66fb199" status: 200 len: 1578 microversion: 2.1 time: 0.164852 Apr 29 08:59:02.195417 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 443/886] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 08:59:02 2022] GET /compute/v2.1/servers/d83c29d2-6435-4edc-827b-2c37a66fb199 => generated 1578 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 08:59:02.266995 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-bcf08419-53ea-4891-9db3-e3bb84a02cd9 tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5571352a755f45efa76b6720eb81c9c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6abb4912c175406ca0cefd03e327b7f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:59:02.275905 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-bcf08419-53ea-4891-9db3-e3bb84a02cd9 tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] 10.222.0.31 "GET /compute/v2.1/servers/c3ad1103-185b-4f84-beb9-e1d0e546b2ed" status: 200 len: 1758 microversion: 2.1 time: 0.180733 Apr 29 08:59:02.276514 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 444/887] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 08:59:02 2022] GET /compute/v2.1/servers/c3ad1103-185b-4f84-beb9-e1d0e546b2ed => generated 1758 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 08:59:02.500755 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-1a0594b9-5fb8-4928-88bb-5514f73240de tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Calling method '>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:59:02.501362 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-1a0594b9-5fb8-4928-88bb-5514f73240de tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] [instance: e74dc909-2e3d-4acb-a05a-ed18d4c0f699] Fetching instance by UUID {{(pid=123459) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:59:02.509058 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-1a0594b9-5fb8-4928-88bb-5514f73240de tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:59:02.509510 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-1a0594b9-5fb8-4928-88bb-5514f73240de tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:59:02.510294 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-1a0594b9-5fb8-4928-88bb-5514f73240de tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:59:02.510735 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-1a0594b9-5fb8-4928-88bb-5514f73240de tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:59:02.649168 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-1a0594b9-5fb8-4928-88bb-5514f73240de tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:59:02.657062 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-1a0594b9-5fb8-4928-88bb-5514f73240de tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:59:02.658560 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-1a0594b9-5fb8-4928-88bb-5514f73240de tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:59:02.659705 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-1a0594b9-5fb8-4928-88bb-5514f73240de tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] 10.222.0.31 "GET /compute/v2.1/servers/e74dc909-2e3d-4acb-a05a-ed18d4c0f699" status: 200 len: 1599 microversion: 2.20 time: 0.162936 Apr 29 08:59:02.660285 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 444/888] 10.222.0.31 () {60 vars in 1276 bytes} [Fri Apr 29 08:59:02 2022] GET /compute/v2.1/servers/e74dc909-2e3d-4acb-a05a-ed18d4c0f699 => generated 1599 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 29 08:59:02.679129 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-d2e71ea1-e7c4-4867-8a10-f37a12e049b5 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Calling method '>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:59:02.679635 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-d2e71ea1-e7c4-4867-8a10-f37a12e049b5 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] [instance: e74dc909-2e3d-4acb-a05a-ed18d4c0f699] Fetching instance by UUID {{(pid=123458) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:59:02.685914 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-d2e71ea1-e7c4-4867-8a10-f37a12e049b5 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:59:02.686366 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-d2e71ea1-e7c4-4867-8a10-f37a12e049b5 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:59:02.687244 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-d2e71ea1-e7c4-4867-8a10-f37a12e049b5 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:59:02.687598 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-d2e71ea1-e7c4-4867-8a10-f37a12e049b5 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:59:02.803825 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-d2e71ea1-e7c4-4867-8a10-f37a12e049b5 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] 10.222.0.31 "GET /compute/v2.1/servers/e74dc909-2e3d-4acb-a05a-ed18d4c0f699/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.129759 Apr 29 08:59:02.804457 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 445/889] 10.222.0.31 () {60 vars in 1315 bytes} [Fri Apr 29 08:59:02 2022] GET /compute/v2.1/servers/e74dc909-2e3d-4acb-a05a-ed18d4c0f699/os-interface => generated 284 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 29 08:59:03.211628 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-97408836-417c-416f-9f56-9eaeee09b864 tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] Calling method '>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:59:03.212339 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-97408836-417c-416f-9f56-9eaeee09b864 tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] [instance: d83c29d2-6435-4edc-827b-2c37a66fb199] Fetching instance by UUID {{(pid=123459) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:59:03.218703 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-97408836-417c-416f-9f56-9eaeee09b864 tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:59:03.219158 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-97408836-417c-416f-9f56-9eaeee09b864 tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:59:03.219939 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-97408836-417c-416f-9f56-9eaeee09b864 tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:59:03.220427 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-97408836-417c-416f-9f56-9eaeee09b864 tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:59:03.295738 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-1af5cc5d-1c53-4faa-b84b-0d54397568e4 tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] Calling method '>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:59:03.296643 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-1af5cc5d-1c53-4faa-b84b-0d54397568e4 tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] [instance: c3ad1103-185b-4f84-beb9-e1d0e546b2ed] Fetching instance by UUID {{(pid=123458) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:59:03.304301 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-1af5cc5d-1c53-4faa-b84b-0d54397568e4 tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:59:03.304762 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-1af5cc5d-1c53-4faa-b84b-0d54397568e4 tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:59:03.305582 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-1af5cc5d-1c53-4faa-b84b-0d54397568e4 tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:59:03.306026 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-1af5cc5d-1c53-4faa-b84b-0d54397568e4 tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:59:03.375199 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-97408836-417c-416f-9f56-9eaeee09b864 tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcf1c67873b7443084ea183c77698062', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0436edb5348a4ad5a0b6b5979a7c54fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:59:03.383492 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-97408836-417c-416f-9f56-9eaeee09b864 tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] 10.222.0.31 "GET /compute/v2.1/servers/d83c29d2-6435-4edc-827b-2c37a66fb199" status: 200 len: 1578 microversion: 2.1 time: 0.176798 Apr 29 08:59:03.384086 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 445/890] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 08:59:03 2022] GET /compute/v2.1/servers/d83c29d2-6435-4edc-827b-2c37a66fb199 => generated 1578 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 08:59:03.758430 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-1af5cc5d-1c53-4faa-b84b-0d54397568e4 tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5571352a755f45efa76b6720eb81c9c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6abb4912c175406ca0cefd03e327b7f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:59:03.766829 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-1af5cc5d-1c53-4faa-b84b-0d54397568e4 tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] 10.222.0.31 "GET /compute/v2.1/servers/c3ad1103-185b-4f84-beb9-e1d0e546b2ed" status: 200 len: 1758 microversion: 2.1 time: 0.475645 Apr 29 08:59:03.767424 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 446/891] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 08:59:03 2022] GET /compute/v2.1/servers/c3ad1103-185b-4f84-beb9-e1d0e546b2ed => generated 1758 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 08:59:04.140992 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [req-d9a4e39c-9e05-4034-a673-b17e4a58a1fc req-f3dce4a8-2345-4112-9421-f1dc1bb75a76 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e74dc909-2e3d-4acb-a05a-ed18d4c0f699", "tag": "440a5656-f549-48bb-8394-679abd59d5c6"}]} {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 29 08:59:04.149862 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [req-d9a4e39c-9e05-4034-a673-b17e4a58a1fc req-f3dce4a8-2345-4112-9421-f1dc1bb75a76 service nova] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:59:04.150303 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [req-d9a4e39c-9e05-4034-a673-b17e4a58a1fc req-f3dce4a8-2345-4112-9421-f1dc1bb75a76 service nova] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:59:04.162727 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.compute.server_external_events [req-d9a4e39c-9e05-4034-a673-b17e4a58a1fc req-f3dce4a8-2345-4112-9421-f1dc1bb75a76 service nova] Creating event network-changed:440a5656-f549-48bb-8394-679abd59d5c6 for instance e74dc909-2e3d-4acb-a05a-ed18d4c0f699 on hv-cinder-83987 Apr 29 08:59:04.167852 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [req-d9a4e39c-9e05-4034-a673-b17e4a58a1fc req-f3dce4a8-2345-4112-9421-f1dc1bb75a76 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030432 Apr 29 08:59:04.168886 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 446/892] 10.222.0.31 () {64 vars in 1317 bytes} [Fri Apr 29 08:59:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 29 08:59:04.401102 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-1cfac480-d0be-48f2-900f-0b557278407c tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] Calling method '>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:59:04.401717 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-1cfac480-d0be-48f2-900f-0b557278407c tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] [instance: d83c29d2-6435-4edc-827b-2c37a66fb199] Fetching instance by UUID {{(pid=123458) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:59:04.408398 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-1cfac480-d0be-48f2-900f-0b557278407c tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:59:04.409193 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-1cfac480-d0be-48f2-900f-0b557278407c tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:59:04.410031 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-1cfac480-d0be-48f2-900f-0b557278407c tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:59:04.410473 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-1cfac480-d0be-48f2-900f-0b557278407c tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:59:04.555464 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-1cfac480-d0be-48f2-900f-0b557278407c tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcf1c67873b7443084ea183c77698062', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0436edb5348a4ad5a0b6b5979a7c54fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:59:04.563109 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-1cfac480-d0be-48f2-900f-0b557278407c tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] 10.222.0.31 "GET /compute/v2.1/servers/d83c29d2-6435-4edc-827b-2c37a66fb199" status: 200 len: 1578 microversion: 2.1 time: 0.165790 Apr 29 08:59:04.564302 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 447/893] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 08:59:04 2022] GET /compute/v2.1/servers/d83c29d2-6435-4edc-827b-2c37a66fb199 => generated 1578 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 29 08:59:04.785723 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-ba4d68cc-73fe-4d29-a41f-8a06097de5d9 tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] Calling method '>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:59:04.786492 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-ba4d68cc-73fe-4d29-a41f-8a06097de5d9 tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] [instance: c3ad1103-185b-4f84-beb9-e1d0e546b2ed] Fetching instance by UUID {{(pid=123459) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:59:04.793443 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-ba4d68cc-73fe-4d29-a41f-8a06097de5d9 tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:59:04.793930 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-ba4d68cc-73fe-4d29-a41f-8a06097de5d9 tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:59:04.794722 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-ba4d68cc-73fe-4d29-a41f-8a06097de5d9 tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:59:04.795164 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-ba4d68cc-73fe-4d29-a41f-8a06097de5d9 tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:59:04.959421 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-ba4d68cc-73fe-4d29-a41f-8a06097de5d9 tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5571352a755f45efa76b6720eb81c9c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6abb4912c175406ca0cefd03e327b7f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:59:04.968176 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-ba4d68cc-73fe-4d29-a41f-8a06097de5d9 tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] 10.222.0.31 "GET /compute/v2.1/servers/c3ad1103-185b-4f84-beb9-e1d0e546b2ed" status: 200 len: 1758 microversion: 2.1 time: 0.187188 Apr 29 08:59:04.968719 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 447/894] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 08:59:04 2022] GET /compute/v2.1/servers/c3ad1103-185b-4f84-beb9-e1d0e546b2ed => generated 1758 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 08:59:05.581390 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-859508b0-8a76-4dcd-af9c-e8bdbf4e9e9d tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] Calling method '>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:59:05.582872 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-859508b0-8a76-4dcd-af9c-e8bdbf4e9e9d tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] [instance: d83c29d2-6435-4edc-827b-2c37a66fb199] Fetching instance by UUID {{(pid=123458) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:59:05.589638 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-859508b0-8a76-4dcd-af9c-e8bdbf4e9e9d tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:59:05.590426 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-859508b0-8a76-4dcd-af9c-e8bdbf4e9e9d tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:59:05.591556 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-859508b0-8a76-4dcd-af9c-e8bdbf4e9e9d tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:59:05.592232 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-859508b0-8a76-4dcd-af9c-e8bdbf4e9e9d tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:59:05.737650 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-859508b0-8a76-4dcd-af9c-e8bdbf4e9e9d tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcf1c67873b7443084ea183c77698062', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0436edb5348a4ad5a0b6b5979a7c54fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:59:05.746495 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-859508b0-8a76-4dcd-af9c-e8bdbf4e9e9d tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] 10.222.0.31 "GET /compute/v2.1/servers/d83c29d2-6435-4edc-827b-2c37a66fb199" status: 200 len: 1578 microversion: 2.1 time: 0.168962 Apr 29 08:59:05.747123 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 448/895] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 08:59:05 2022] GET /compute/v2.1/servers/d83c29d2-6435-4edc-827b-2c37a66fb199 => generated 1578 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 08:59:05.986298 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-89d4b857-cb0c-4ee6-915a-61e71ae9a432 tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] Calling method '>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:59:05.986899 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-89d4b857-cb0c-4ee6-915a-61e71ae9a432 tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] [instance: c3ad1103-185b-4f84-beb9-e1d0e546b2ed] Fetching instance by UUID {{(pid=123459) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:59:05.994077 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-89d4b857-cb0c-4ee6-915a-61e71ae9a432 tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:59:05.994522 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-89d4b857-cb0c-4ee6-915a-61e71ae9a432 tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:59:06.004310 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-89d4b857-cb0c-4ee6-915a-61e71ae9a432 tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:59:06.004310 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-89d4b857-cb0c-4ee6-915a-61e71ae9a432 tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:59:06.150201 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-89d4b857-cb0c-4ee6-915a-61e71ae9a432 tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5571352a755f45efa76b6720eb81c9c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6abb4912c175406ca0cefd03e327b7f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:59:06.158151 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-89d4b857-cb0c-4ee6-915a-61e71ae9a432 tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] 10.222.0.31 "GET /compute/v2.1/servers/c3ad1103-185b-4f84-beb9-e1d0e546b2ed" status: 200 len: 1758 microversion: 2.1 time: 0.175691 Apr 29 08:59:06.158729 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 448/896] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 08:59:05 2022] GET /compute/v2.1/servers/c3ad1103-185b-4f84-beb9-e1d0e546b2ed => generated 1758 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 08:59:06.763343 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-7c1296af-282c-4b9b-9994-dda4a7a6bc8b tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] Calling method '>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:59:06.764008 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-7c1296af-282c-4b9b-9994-dda4a7a6bc8b tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] [instance: d83c29d2-6435-4edc-827b-2c37a66fb199] Fetching instance by UUID {{(pid=123458) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:59:06.770431 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-7c1296af-282c-4b9b-9994-dda4a7a6bc8b tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:59:06.771380 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-7c1296af-282c-4b9b-9994-dda4a7a6bc8b tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:59:06.772177 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-7c1296af-282c-4b9b-9994-dda4a7a6bc8b tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:59:06.772605 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-7c1296af-282c-4b9b-9994-dda4a7a6bc8b tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:59:06.917198 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-7c1296af-282c-4b9b-9994-dda4a7a6bc8b tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcf1c67873b7443084ea183c77698062', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0436edb5348a4ad5a0b6b5979a7c54fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:59:06.925431 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-7c1296af-282c-4b9b-9994-dda4a7a6bc8b tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] 10.222.0.31 "GET /compute/v2.1/servers/d83c29d2-6435-4edc-827b-2c37a66fb199" status: 200 len: 1578 microversion: 2.1 time: 0.165879 Apr 29 08:59:06.925984 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 449/897] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 08:59:06 2022] GET /compute/v2.1/servers/d83c29d2-6435-4edc-827b-2c37a66fb199 => generated 1578 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 08:59:06.959623 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [req-f9756827-5b74-4b09-832e-fb9db17f58a0 req-4401f3cb-3dd6-4ce6-8181-104014cd2220 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d83c29d2-6435-4edc-827b-2c37a66fb199", "name": "network-vif-plugged", "status": "completed", "tag": "67bd0bd8-da3b-4ea7-9bf9-bfddba4f2c80"}]} {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 29 08:59:06.968548 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [req-f9756827-5b74-4b09-832e-fb9db17f58a0 req-4401f3cb-3dd6-4ce6-8181-104014cd2220 service nova] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:59:06.968998 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [req-f9756827-5b74-4b09-832e-fb9db17f58a0 req-4401f3cb-3dd6-4ce6-8181-104014cd2220 service nova] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:59:06.981426 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.compute.server_external_events [req-f9756827-5b74-4b09-832e-fb9db17f58a0 req-4401f3cb-3dd6-4ce6-8181-104014cd2220 service nova] Creating event network-vif-plugged:67bd0bd8-da3b-4ea7-9bf9-bfddba4f2c80 for instance d83c29d2-6435-4edc-827b-2c37a66fb199 on hv-cinder-83987 Apr 29 08:59:06.986379 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [req-f9756827-5b74-4b09-832e-fb9db17f58a0 req-4401f3cb-3dd6-4ce6-8181-104014cd2220 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031101 Apr 29 08:59:06.987141 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 449/898] 10.222.0.31 () {64 vars in 1317 bytes} [Fri Apr 29 08:59:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 29 08:59:07.176748 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-8441f841-522e-4cea-bbc9-5057b5731905 tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] Calling method '>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:59:07.177457 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-8441f841-522e-4cea-bbc9-5057b5731905 tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] [instance: c3ad1103-185b-4f84-beb9-e1d0e546b2ed] Fetching instance by UUID {{(pid=123458) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:59:07.183876 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-8441f841-522e-4cea-bbc9-5057b5731905 tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:59:07.184356 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-8441f841-522e-4cea-bbc9-5057b5731905 tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:59:07.185195 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-8441f841-522e-4cea-bbc9-5057b5731905 tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:59:07.185634 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-8441f841-522e-4cea-bbc9-5057b5731905 tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:59:07.343971 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-8441f841-522e-4cea-bbc9-5057b5731905 tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5571352a755f45efa76b6720eb81c9c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6abb4912c175406ca0cefd03e327b7f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:59:07.352179 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-8441f841-522e-4cea-bbc9-5057b5731905 tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] 10.222.0.31 "GET /compute/v2.1/servers/c3ad1103-185b-4f84-beb9-e1d0e546b2ed" status: 200 len: 1758 microversion: 2.1 time: 0.179345 Apr 29 08:59:07.352766 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 450/899] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 08:59:07 2022] GET /compute/v2.1/servers/c3ad1103-185b-4f84-beb9-e1d0e546b2ed => generated 1758 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 29 08:59:07.944426 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-d93020b1-9efd-48c1-92e1-051827fdb549 tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] Calling method '>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:59:07.945113 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-d93020b1-9efd-48c1-92e1-051827fdb549 tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] [instance: d83c29d2-6435-4edc-827b-2c37a66fb199] Fetching instance by UUID {{(pid=123459) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:59:07.951290 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-d93020b1-9efd-48c1-92e1-051827fdb549 tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:59:07.951733 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-d93020b1-9efd-48c1-92e1-051827fdb549 tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:59:07.952531 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-d93020b1-9efd-48c1-92e1-051827fdb549 tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:59:07.952970 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-d93020b1-9efd-48c1-92e1-051827fdb549 tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:59:08.082044 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-d93020b1-9efd-48c1-92e1-051827fdb549 tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcf1c67873b7443084ea183c77698062', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0436edb5348a4ad5a0b6b5979a7c54fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:59:08.090167 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-d93020b1-9efd-48c1-92e1-051827fdb549 tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] 10.222.0.31 "GET /compute/v2.1/servers/d83c29d2-6435-4edc-827b-2c37a66fb199" status: 200 len: 1578 microversion: 2.1 time: 0.151051 Apr 29 08:59:08.090733 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 450/900] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 08:59:07 2022] GET /compute/v2.1/servers/d83c29d2-6435-4edc-827b-2c37a66fb199 => generated 1578 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 08:59:08.370035 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-66fc80b1-f810-4eb2-a745-3365080744b0 tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] Calling method '>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:59:08.370588 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-66fc80b1-f810-4eb2-a745-3365080744b0 tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] [instance: c3ad1103-185b-4f84-beb9-e1d0e546b2ed] Fetching instance by UUID {{(pid=123458) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:59:08.377143 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-66fc80b1-f810-4eb2-a745-3365080744b0 tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:59:08.377591 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-66fc80b1-f810-4eb2-a745-3365080744b0 tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:59:08.378381 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-66fc80b1-f810-4eb2-a745-3365080744b0 tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:59:08.378818 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-66fc80b1-f810-4eb2-a745-3365080744b0 tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:59:08.533664 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-66fc80b1-f810-4eb2-a745-3365080744b0 tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5571352a755f45efa76b6720eb81c9c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6abb4912c175406ca0cefd03e327b7f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:59:08.542573 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-66fc80b1-f810-4eb2-a745-3365080744b0 tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] 10.222.0.31 "GET /compute/v2.1/servers/c3ad1103-185b-4f84-beb9-e1d0e546b2ed" status: 200 len: 1758 microversion: 2.1 time: 0.176697 Apr 29 08:59:08.543145 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 451/901] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 08:59:08 2022] GET /compute/v2.1/servers/c3ad1103-185b-4f84-beb9-e1d0e546b2ed => generated 1758 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 08:59:09.111005 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-776cf002-7b0a-4deb-9e48-976bf103f24f tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] Calling method '>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:59:09.111943 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-776cf002-7b0a-4deb-9e48-976bf103f24f tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] [instance: d83c29d2-6435-4edc-827b-2c37a66fb199] Fetching instance by UUID {{(pid=123459) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:59:09.122280 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-776cf002-7b0a-4deb-9e48-976bf103f24f tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:59:09.122728 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-776cf002-7b0a-4deb-9e48-976bf103f24f tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:59:09.123517 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-776cf002-7b0a-4deb-9e48-976bf103f24f tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:59:09.123955 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-776cf002-7b0a-4deb-9e48-976bf103f24f tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:59:09.265292 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-776cf002-7b0a-4deb-9e48-976bf103f24f tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcf1c67873b7443084ea183c77698062', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0436edb5348a4ad5a0b6b5979a7c54fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:59:09.274657 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-776cf002-7b0a-4deb-9e48-976bf103f24f tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] 10.222.0.31 "GET /compute/v2.1/servers/d83c29d2-6435-4edc-827b-2c37a66fb199" status: 200 len: 1578 microversion: 2.1 time: 0.170503 Apr 29 08:59:09.275300 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 451/902] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 08:59:09 2022] GET /compute/v2.1/servers/d83c29d2-6435-4edc-827b-2c37a66fb199 => generated 1578 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 08:59:09.560965 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-4e38acff-8cba-42ba-b12a-1fb0b9a01eeb tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] Calling method '>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:59:09.561584 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-4e38acff-8cba-42ba-b12a-1fb0b9a01eeb tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] [instance: c3ad1103-185b-4f84-beb9-e1d0e546b2ed] Fetching instance by UUID {{(pid=123458) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:59:09.569108 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-4e38acff-8cba-42ba-b12a-1fb0b9a01eeb tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:59:09.569741 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-4e38acff-8cba-42ba-b12a-1fb0b9a01eeb tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:59:09.570540 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-4e38acff-8cba-42ba-b12a-1fb0b9a01eeb tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:59:09.570983 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-4e38acff-8cba-42ba-b12a-1fb0b9a01eeb tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:59:09.725223 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-4e38acff-8cba-42ba-b12a-1fb0b9a01eeb tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5571352a755f45efa76b6720eb81c9c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6abb4912c175406ca0cefd03e327b7f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:59:09.733619 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-4e38acff-8cba-42ba-b12a-1fb0b9a01eeb tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] 10.222.0.31 "GET /compute/v2.1/servers/c3ad1103-185b-4f84-beb9-e1d0e546b2ed" status: 200 len: 1758 microversion: 2.1 time: 0.176447 Apr 29 08:59:09.734402 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 452/903] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 08:59:09 2022] GET /compute/v2.1/servers/c3ad1103-185b-4f84-beb9-e1d0e546b2ed => generated 1758 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 08:59:10.291797 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-32d604ca-ab12-4c5e-b7fb-1220c7cbc4d1 tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] Calling method '>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:59:10.292446 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-32d604ca-ab12-4c5e-b7fb-1220c7cbc4d1 tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] [instance: d83c29d2-6435-4edc-827b-2c37a66fb199] Fetching instance by UUID {{(pid=123459) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:59:10.299835 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-32d604ca-ab12-4c5e-b7fb-1220c7cbc4d1 tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:59:10.300068 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-32d604ca-ab12-4c5e-b7fb-1220c7cbc4d1 tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:59:10.300783 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-32d604ca-ab12-4c5e-b7fb-1220c7cbc4d1 tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:59:10.301216 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-32d604ca-ab12-4c5e-b7fb-1220c7cbc4d1 tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:59:10.526355 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-32d604ca-ab12-4c5e-b7fb-1220c7cbc4d1 tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcf1c67873b7443084ea183c77698062', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0436edb5348a4ad5a0b6b5979a7c54fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:59:10.533879 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-32d604ca-ab12-4c5e-b7fb-1220c7cbc4d1 tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] 10.222.0.31 "GET /compute/v2.1/servers/d83c29d2-6435-4edc-827b-2c37a66fb199" status: 200 len: 1565 microversion: 2.1 time: 0.246891 Apr 29 08:59:10.534450 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 452/904] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 08:59:10 2022] GET /compute/v2.1/servers/d83c29d2-6435-4edc-827b-2c37a66fb199 => generated 1565 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 08:59:10.750673 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-76ddc88c-84e5-48b8-aaa2-991a3563bf58 tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] Calling method '>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:59:10.751279 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-76ddc88c-84e5-48b8-aaa2-991a3563bf58 tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] [instance: c3ad1103-185b-4f84-beb9-e1d0e546b2ed] Fetching instance by UUID {{(pid=123458) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:59:10.758257 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-76ddc88c-84e5-48b8-aaa2-991a3563bf58 tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:59:10.758699 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-76ddc88c-84e5-48b8-aaa2-991a3563bf58 tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:59:10.759475 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-76ddc88c-84e5-48b8-aaa2-991a3563bf58 tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:59:10.759906 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-76ddc88c-84e5-48b8-aaa2-991a3563bf58 tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:59:10.898787 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-76ddc88c-84e5-48b8-aaa2-991a3563bf58 tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5571352a755f45efa76b6720eb81c9c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6abb4912c175406ca0cefd03e327b7f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:59:10.906685 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-76ddc88c-84e5-48b8-aaa2-991a3563bf58 tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] 10.222.0.31 "GET /compute/v2.1/servers/c3ad1103-185b-4f84-beb9-e1d0e546b2ed" status: 200 len: 1758 microversion: 2.1 time: 0.159802 Apr 29 08:59:10.907264 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 453/905] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 08:59:10 2022] GET /compute/v2.1/servers/c3ad1103-185b-4f84-beb9-e1d0e546b2ed => generated 1758 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 08:59:11.926229 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-f1764ec5-8b1a-4917-9429-51c322ee5849 tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] Calling method '>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:59:11.926767 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-f1764ec5-8b1a-4917-9429-51c322ee5849 tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] [instance: c3ad1103-185b-4f84-beb9-e1d0e546b2ed] Fetching instance by UUID {{(pid=123459) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:59:11.934831 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-f1764ec5-8b1a-4917-9429-51c322ee5849 tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:59:11.935282 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-f1764ec5-8b1a-4917-9429-51c322ee5849 tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:59:11.936067 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-f1764ec5-8b1a-4917-9429-51c322ee5849 tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:59:11.936534 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-f1764ec5-8b1a-4917-9429-51c322ee5849 tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:59:12.086809 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-f1764ec5-8b1a-4917-9429-51c322ee5849 tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5571352a755f45efa76b6720eb81c9c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6abb4912c175406ca0cefd03e327b7f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:59:12.094855 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-f1764ec5-8b1a-4917-9429-51c322ee5849 tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] 10.222.0.31 "GET /compute/v2.1/servers/c3ad1103-185b-4f84-beb9-e1d0e546b2ed" status: 200 len: 1758 microversion: 2.1 time: 0.174320 Apr 29 08:59:12.095425 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 453/906] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 08:59:11 2022] GET /compute/v2.1/servers/c3ad1103-185b-4f84-beb9-e1d0e546b2ed => generated 1758 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 08:59:13.112272 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-0773d6ab-326b-45cd-ae2f-c8e4dcefb04c tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] Calling method '>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:59:13.112901 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-0773d6ab-326b-45cd-ae2f-c8e4dcefb04c tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] [instance: c3ad1103-185b-4f84-beb9-e1d0e546b2ed] Fetching instance by UUID {{(pid=123458) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:59:13.120547 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-0773d6ab-326b-45cd-ae2f-c8e4dcefb04c tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:59:13.121006 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-0773d6ab-326b-45cd-ae2f-c8e4dcefb04c tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:59:13.121801 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-0773d6ab-326b-45cd-ae2f-c8e4dcefb04c tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:59:13.122239 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-0773d6ab-326b-45cd-ae2f-c8e4dcefb04c tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:59:13.269189 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-0773d6ab-326b-45cd-ae2f-c8e4dcefb04c tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5571352a755f45efa76b6720eb81c9c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6abb4912c175406ca0cefd03e327b7f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:59:13.277920 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-0773d6ab-326b-45cd-ae2f-c8e4dcefb04c tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] 10.222.0.31 "GET /compute/v2.1/servers/c3ad1103-185b-4f84-beb9-e1d0e546b2ed" status: 200 len: 1758 microversion: 2.1 time: 0.169467 Apr 29 08:59:13.278512 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 454/907] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 08:59:13 2022] GET /compute/v2.1/servers/c3ad1103-185b-4f84-beb9-e1d0e546b2ed => generated 1758 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 08:59:14.295917 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-f485127d-36ce-4759-b9ad-fcebd0259f61 tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] Calling method '>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 08:59:14.296554 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-f485127d-36ce-4759-b9ad-fcebd0259f61 tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] [instance: c3ad1103-185b-4f84-beb9-e1d0e546b2ed] Fetching instance by UUID {{(pid=123459) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 08:59:14.307661 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-f485127d-36ce-4759-b9ad-fcebd0259f61 tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:59:14.308243 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-f485127d-36ce-4759-b9ad-fcebd0259f61 tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:59:14.309446 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-f485127d-36ce-4759-b9ad-fcebd0259f61 tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 08:59:14.310205 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-f485127d-36ce-4759-b9ad-fcebd0259f61 tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 08:59:14.461907 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-f485127d-36ce-4759-b9ad-fcebd0259f61 tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5571352a755f45efa76b6720eb81c9c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6abb4912c175406ca0cefd03e327b7f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 08:59:14.469981 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-f485127d-36ce-4759-b9ad-fcebd0259f61 tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] 10.222.0.31 "GET /compute/v2.1/servers/c3ad1103-185b-4f84-beb9-e1d0e546b2ed" status: 200 len: 1761 microversion: 2.1 time: 0.177883 Apr 29 08:59:14.470560 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 454/908] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 08:59:14 2022] GET /compute/v2.1/servers/c3ad1103-185b-4f84-beb9-e1d0e546b2ed => generated 1761 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 09:00:00.074006 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-0dd598eb-96b5-47be-aa30-a7431ef3fcdd tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Calling method '>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 09:00:00.074634 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-0dd598eb-96b5-47be-aa30-a7431ef3fcdd tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] [instance: f4be98bb-be88-421f-a448-f04a4f97702b] Fetching instance by UUID {{(pid=123458) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 09:00:00.081013 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-0dd598eb-96b5-47be-aa30-a7431ef3fcdd tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:00:00.081470 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-0dd598eb-96b5-47be-aa30-a7431ef3fcdd tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:00:00.082263 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-0dd598eb-96b5-47be-aa30-a7431ef3fcdd tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:00:00.082710 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-0dd598eb-96b5-47be-aa30-a7431ef3fcdd tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:00:00.181186 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.objects.instance [None req-0dd598eb-96b5-47be-aa30-a7431ef3fcdd tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lazy-loading 'services' on Instance uuid f4be98bb-be88-421f-a448-f04a4f97702b {{(pid=123458) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 29 09:00:00.257220 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-0dd598eb-96b5-47be-aa30-a7431ef3fcdd tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] 10.222.0.31 "DELETE /compute/v2.1/servers/f4be98bb-be88-421f-a448-f04a4f97702b/os-volume_attachments/71626bef-d479-4350-9a2d-9412aecca460" status: 202 len: 0 microversion: 2.1 time: 0.188533 Apr 29 09:00:00.257947 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 455/909] 10.222.0.31 () {58 vars in 1415 bytes} [Fri Apr 29 09:00:00 2022] DELETE /compute/v2.1/servers/f4be98bb-be88-421f-a448-f04a4f97702b/os-volume_attachments/71626bef-d479-4350-9a2d-9412aecca460 => generated 0 bytes in 190 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 29 09:00:00.266671 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-473a9326-3c27-4ee8-905e-43eddfa1bd4e tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Calling method '>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 09:00:00.267815 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-473a9326-3c27-4ee8-905e-43eddfa1bd4e tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] [instance: f4be98bb-be88-421f-a448-f04a4f97702b] Fetching instance by UUID {{(pid=123459) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 09:00:00.274344 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-473a9326-3c27-4ee8-905e-43eddfa1bd4e tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:00:00.274766 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-473a9326-3c27-4ee8-905e-43eddfa1bd4e tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:00:00.276025 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-473a9326-3c27-4ee8-905e-43eddfa1bd4e tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:00:00.276505 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-473a9326-3c27-4ee8-905e-43eddfa1bd4e tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:00:00.310009 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-473a9326-3c27-4ee8-905e-43eddfa1bd4e tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] 10.222.0.31 "GET /compute/v2.1/servers/f4be98bb-be88-421f-a448-f04a4f97702b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047355 Apr 29 09:00:00.310603 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 455/910] 10.222.0.31 () {58 vars in 1301 bytes} [Fri Apr 29 09:00:00 2022] GET /compute/v2.1/servers/f4be98bb-be88-421f-a448-f04a4f97702b/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 29 09:00:01.323539 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-b358dd6b-e2be-4b7b-8b44-664bb2671e72 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Calling method '>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 09:00:01.324668 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-b358dd6b-e2be-4b7b-8b44-664bb2671e72 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] [instance: f4be98bb-be88-421f-a448-f04a4f97702b] Fetching instance by UUID {{(pid=123458) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 09:00:01.331216 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-b358dd6b-e2be-4b7b-8b44-664bb2671e72 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:00:01.331662 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-b358dd6b-e2be-4b7b-8b44-664bb2671e72 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:00:01.332470 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-b358dd6b-e2be-4b7b-8b44-664bb2671e72 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:00:01.332900 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-b358dd6b-e2be-4b7b-8b44-664bb2671e72 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:00:01.365589 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-b358dd6b-e2be-4b7b-8b44-664bb2671e72 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] 10.222.0.31 "GET /compute/v2.1/servers/f4be98bb-be88-421f-a448-f04a4f97702b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047139 Apr 29 09:00:01.366173 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 456/911] 10.222.0.31 () {58 vars in 1301 bytes} [Fri Apr 29 09:00:01 2022] GET /compute/v2.1/servers/f4be98bb-be88-421f-a448-f04a4f97702b/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 29 09:00:02.377952 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-f240739a-b067-4be7-aed2-5e936743c024 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Calling method '>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 09:00:02.378925 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-f240739a-b067-4be7-aed2-5e936743c024 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] [instance: f4be98bb-be88-421f-a448-f04a4f97702b] Fetching instance by UUID {{(pid=123459) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 09:00:02.385749 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-f240739a-b067-4be7-aed2-5e936743c024 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:00:02.386198 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-f240739a-b067-4be7-aed2-5e936743c024 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:00:02.386983 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-f240739a-b067-4be7-aed2-5e936743c024 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:00:02.387416 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-f240739a-b067-4be7-aed2-5e936743c024 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:00:02.420049 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-f240739a-b067-4be7-aed2-5e936743c024 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] 10.222.0.31 "GET /compute/v2.1/servers/f4be98bb-be88-421f-a448-f04a4f97702b/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046107 Apr 29 09:00:02.420723 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 456/912] 10.222.0.31 () {58 vars in 1301 bytes} [Fri Apr 29 09:00:02 2022] GET /compute/v2.1/servers/f4be98bb-be88-421f-a448-f04a4f97702b/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 29 09:00:02.505711 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-9226d189-c6fc-4f1b-b3a2-fa4088996c07 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Calling method '>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 09:00:02.506362 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-9226d189-c6fc-4f1b-b3a2-fa4088996c07 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] [instance: f4be98bb-be88-421f-a448-f04a4f97702b] Fetching instance by UUID {{(pid=123458) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 09:00:02.513154 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-9226d189-c6fc-4f1b-b3a2-fa4088996c07 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:00:02.513635 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-9226d189-c6fc-4f1b-b3a2-fa4088996c07 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:00:02.514419 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-9226d189-c6fc-4f1b-b3a2-fa4088996c07 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:00:02.514856 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-9226d189-c6fc-4f1b-b3a2-fa4088996c07 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:00:02.542106 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-9226d189-c6fc-4f1b-b3a2-fa4088996c07 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] [instance: f4be98bb-be88-421f-a448-f04a4f97702b] Going to try to terminate instance {{(pid=123458) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 29 09:00:02.624001 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-9226d189-c6fc-4f1b-b3a2-fa4088996c07 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] 10.222.0.31 "DELETE /compute/v2.1/servers/f4be98bb-be88-421f-a448-f04a4f97702b" status: 204 len: 0 microversion: 2.1 time: 0.122037 Apr 29 09:00:02.624645 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 457/913] 10.222.0.31 () {58 vars in 1238 bytes} [Fri Apr 29 09:00:02 2022] DELETE /compute/v2.1/servers/f4be98bb-be88-421f-a448-f04a4f97702b => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 29 09:00:02.634693 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-e803c643-aa4e-4533-b7d3-1878c0e66d39 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Calling method '>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 09:00:02.635322 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-e803c643-aa4e-4533-b7d3-1878c0e66d39 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] [instance: f4be98bb-be88-421f-a448-f04a4f97702b] Fetching instance by UUID {{(pid=123459) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 09:00:02.642229 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-e803c643-aa4e-4533-b7d3-1878c0e66d39 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:00:02.642678 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-e803c643-aa4e-4533-b7d3-1878c0e66d39 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:00:02.643481 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-e803c643-aa4e-4533-b7d3-1878c0e66d39 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:00:02.643910 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-e803c643-aa4e-4533-b7d3-1878c0e66d39 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:00:02.791267 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-e803c643-aa4e-4533-b7d3-1878c0e66d39 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c18e88436f14dc7a2001220b87ce9ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60998f08c40446e787ead285e40665b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 09:00:02.798919 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-e803c643-aa4e-4533-b7d3-1878c0e66d39 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] 10.222.0.31 "GET /compute/v2.1/servers/f4be98bb-be88-421f-a448-f04a4f97702b" status: 200 len: 1689 microversion: 2.1 time: 0.169616 Apr 29 09:00:02.799493 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 457/914] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 09:00:02 2022] GET /compute/v2.1/servers/f4be98bb-be88-421f-a448-f04a4f97702b => generated 1689 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 29 09:00:03.817461 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-542fbe15-ed2a-41ff-83ac-4467f0a4c561 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Calling method '>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 09:00:03.818154 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-542fbe15-ed2a-41ff-83ac-4467f0a4c561 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] [instance: f4be98bb-be88-421f-a448-f04a4f97702b] Fetching instance by UUID {{(pid=123458) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 09:00:03.824854 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-542fbe15-ed2a-41ff-83ac-4467f0a4c561 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:00:03.825300 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-542fbe15-ed2a-41ff-83ac-4467f0a4c561 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:00:03.826089 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-542fbe15-ed2a-41ff-83ac-4467f0a4c561 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:00:03.826523 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-542fbe15-ed2a-41ff-83ac-4467f0a4c561 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:00:03.971442 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-542fbe15-ed2a-41ff-83ac-4467f0a4c561 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c18e88436f14dc7a2001220b87ce9ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60998f08c40446e787ead285e40665b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 09:00:03.979078 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-542fbe15-ed2a-41ff-83ac-4467f0a4c561 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] 10.222.0.31 "GET /compute/v2.1/servers/f4be98bb-be88-421f-a448-f04a4f97702b" status: 200 len: 1689 microversion: 2.1 time: 0.165786 Apr 29 09:00:03.979676 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 458/915] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 09:00:03 2022] GET /compute/v2.1/servers/f4be98bb-be88-421f-a448-f04a4f97702b => generated 1689 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 09:00:04.996749 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-9398ff2c-9dff-4af5-94d0-ef797d88f4c6 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Calling method '>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 09:00:04.997338 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-9398ff2c-9dff-4af5-94d0-ef797d88f4c6 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] [instance: f4be98bb-be88-421f-a448-f04a4f97702b] Fetching instance by UUID {{(pid=123459) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 09:00:05.005380 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-9398ff2c-9dff-4af5-94d0-ef797d88f4c6 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:00:05.005835 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-9398ff2c-9dff-4af5-94d0-ef797d88f4c6 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:00:05.006728 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-9398ff2c-9dff-4af5-94d0-ef797d88f4c6 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:00:05.007455 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-9398ff2c-9dff-4af5-94d0-ef797d88f4c6 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:00:05.146976 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-9398ff2c-9dff-4af5-94d0-ef797d88f4c6 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c18e88436f14dc7a2001220b87ce9ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60998f08c40446e787ead285e40665b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 09:00:05.155995 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-9398ff2c-9dff-4af5-94d0-ef797d88f4c6 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] 10.222.0.31 "GET /compute/v2.1/servers/f4be98bb-be88-421f-a448-f04a4f97702b" status: 200 len: 1689 microversion: 2.1 time: 0.163501 Apr 29 09:00:05.156515 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 458/916] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 09:00:04 2022] GET /compute/v2.1/servers/f4be98bb-be88-421f-a448-f04a4f97702b => generated 1689 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 09:00:06.173042 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-e549699f-fb63-4fdd-8fec-a020052515cc tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Calling method '>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 09:00:06.173700 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-e549699f-fb63-4fdd-8fec-a020052515cc tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] [instance: f4be98bb-be88-421f-a448-f04a4f97702b] Fetching instance by UUID {{(pid=123458) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 09:00:06.180610 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-e549699f-fb63-4fdd-8fec-a020052515cc tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:00:06.181089 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-e549699f-fb63-4fdd-8fec-a020052515cc tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:00:06.181898 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-e549699f-fb63-4fdd-8fec-a020052515cc tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:00:06.182317 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-e549699f-fb63-4fdd-8fec-a020052515cc tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:00:06.334396 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-e549699f-fb63-4fdd-8fec-a020052515cc tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c18e88436f14dc7a2001220b87ce9ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60998f08c40446e787ead285e40665b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 09:00:06.345305 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-e549699f-fb63-4fdd-8fec-a020052515cc tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] 10.222.0.31 "GET /compute/v2.1/servers/f4be98bb-be88-421f-a448-f04a4f97702b" status: 200 len: 1689 microversion: 2.1 time: 0.176097 Apr 29 09:00:06.345961 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 459/917] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 09:00:06 2022] GET /compute/v2.1/servers/f4be98bb-be88-421f-a448-f04a4f97702b => generated 1689 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 09:00:07.370563 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-90122f32-a3c7-45de-be94-926a75134159 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Calling method '>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 09:00:07.371283 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-90122f32-a3c7-45de-be94-926a75134159 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] [instance: f4be98bb-be88-421f-a448-f04a4f97702b] Fetching instance by UUID {{(pid=123459) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 09:00:07.378338 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-90122f32-a3c7-45de-be94-926a75134159 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:00:07.378781 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-90122f32-a3c7-45de-be94-926a75134159 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:00:07.379567 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-90122f32-a3c7-45de-be94-926a75134159 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:00:07.379999 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-90122f32-a3c7-45de-be94-926a75134159 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:00:07.467973 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-8586f631-229f-404f-bdf5-9067647844d8 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Calling method '>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 09:00:07.468612 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-8586f631-229f-404f-bdf5-9067647844d8 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] [instance: 6722378c-3c16-480e-b7de-4f9c8696fa03] Fetching instance by UUID {{(pid=123458) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 09:00:07.476873 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-8586f631-229f-404f-bdf5-9067647844d8 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:00:07.477450 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-8586f631-229f-404f-bdf5-9067647844d8 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:00:07.478264 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-8586f631-229f-404f-bdf5-9067647844d8 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:00:07.478712 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-8586f631-229f-404f-bdf5-9067647844d8 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:00:07.504620 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-8586f631-229f-404f-bdf5-9067647844d8 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] 10.222.0.31 "GET /compute/v2.1/servers/6722378c-3c16-480e-b7de-4f9c8696fa03/ips" status: 200 len: 150 microversion: 2.1 time: 0.040581 Apr 29 09:00:07.505403 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 460/918] 10.222.0.31 () {58 vars in 1247 bytes} [Fri Apr 29 09:00:07 2022] GET /compute/v2.1/servers/6722378c-3c16-480e-b7de-4f9c8696fa03/ips => generated 150 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 29 09:00:07.607562 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-90122f32-a3c7-45de-be94-926a75134159 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c18e88436f14dc7a2001220b87ce9ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60998f08c40446e787ead285e40665b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 09:00:07.617504 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-90122f32-a3c7-45de-be94-926a75134159 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] 10.222.0.31 "GET /compute/v2.1/servers/f4be98bb-be88-421f-a448-f04a4f97702b" status: 200 len: 1689 microversion: 2.1 time: 0.251027 Apr 29 09:00:07.628515 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 459/919] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 09:00:07 2022] GET /compute/v2.1/servers/f4be98bb-be88-421f-a448-f04a4f97702b => generated 1689 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 29 09:00:08.201626 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [req-dc95d01a-022d-4be8-87f1-e44a31a74fed req-c8f16b62-7660-4fcd-a6fa-c7c8ebf44ad5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f4be98bb-be88-421f-a448-f04a4f97702b", "name": "network-vif-deleted", "tag": "e6ef8121-81a9-4773-903b-5d18906a76d1"}]} {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 29 09:00:08.235096 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [req-dc95d01a-022d-4be8-87f1-e44a31a74fed req-c8f16b62-7660-4fcd-a6fa-c7c8ebf44ad5 service nova] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:00:08.236123 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [req-dc95d01a-022d-4be8-87f1-e44a31a74fed req-c8f16b62-7660-4fcd-a6fa-c7c8ebf44ad5 service nova] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:00:08.256224 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.compute.server_external_events [req-dc95d01a-022d-4be8-87f1-e44a31a74fed req-c8f16b62-7660-4fcd-a6fa-c7c8ebf44ad5 service nova] Creating event network-vif-deleted:e6ef8121-81a9-4773-903b-5d18906a76d1 for instance f4be98bb-be88-421f-a448-f04a4f97702b on hv-cinder-83987 Apr 29 09:00:08.262823 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [req-dc95d01a-022d-4be8-87f1-e44a31a74fed req-c8f16b62-7660-4fcd-a6fa-c7c8ebf44ad5 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072104 Apr 29 09:00:08.263453 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 461/920] 10.222.0.31 () {64 vars in 1317 bytes} [Fri Apr 29 09:00:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 29 09:00:08.637839 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-0cb8865d-3096-40fd-b119-683ffebccc31 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Calling method '>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 09:00:08.638614 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-0cb8865d-3096-40fd-b119-683ffebccc31 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] [instance: f4be98bb-be88-421f-a448-f04a4f97702b] Fetching instance by UUID {{(pid=123459) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 09:00:08.646041 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-0cb8865d-3096-40fd-b119-683ffebccc31 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:00:08.646659 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-0cb8865d-3096-40fd-b119-683ffebccc31 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:00:08.647583 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-0cb8865d-3096-40fd-b119-683ffebccc31 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:00:08.648163 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-0cb8865d-3096-40fd-b119-683ffebccc31 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:00:08.686375 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-0cb8865d-3096-40fd-b119-683ffebccc31 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:00:08.686829 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-0cb8865d-3096-40fd-b119-683ffebccc31 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:00:08.687294 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.objects.instance [None req-0cb8865d-3096-40fd-b119-683ffebccc31 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lazy-loading 'fault' on Instance uuid f4be98bb-be88-421f-a448-f04a4f97702b {{(pid=123459) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 29 09:00:08.737499 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-0cb8865d-3096-40fd-b119-683ffebccc31 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c18e88436f14dc7a2001220b87ce9ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60998f08c40446e787ead285e40665b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 09:00:08.746173 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-0cb8865d-3096-40fd-b119-683ffebccc31 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] 10.222.0.31 "GET /compute/v2.1/servers/f4be98bb-be88-421f-a448-f04a4f97702b" status: 200 len: 1335 microversion: 2.1 time: 0.113442 Apr 29 09:00:08.746767 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 460/921] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 09:00:08 2022] GET /compute/v2.1/servers/f4be98bb-be88-421f-a448-f04a4f97702b => generated 1335 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 09:00:08.949266 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-c7d64205-7af6-403d-a64e-bf27b112761e tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3ae9ccf3-f74c-465a-affe-9cf04dcf5306"}} {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 29 09:00:08.950459 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-c7d64205-7af6-403d-a64e-bf27b112761e tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] [instance: 6722378c-3c16-480e-b7de-4f9c8696fa03] Fetching instance by UUID {{(pid=123458) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 09:00:08.957081 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-c7d64205-7af6-403d-a64e-bf27b112761e tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:00:08.957531 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-c7d64205-7af6-403d-a64e-bf27b112761e tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:00:08.958320 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-c7d64205-7af6-403d-a64e-bf27b112761e tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:00:08.958839 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-c7d64205-7af6-403d-a64e-bf27b112761e tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:00:09.611669 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-c7d64205-7af6-403d-a64e-bf27b112761e tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] 10.222.0.31 "POST /compute/v2.1/servers/6722378c-3c16-480e-b7de-4f9c8696fa03/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.667999 Apr 29 09:00:09.612494 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 462/922] 10.222.0.31 () {60 vars in 1322 bytes} [Fri Apr 29 09:00:08 2022] POST /compute/v2.1/servers/6722378c-3c16-480e-b7de-4f9c8696fa03/os-volume_attachments => generated 194 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 29 09:00:09.766333 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-76585be2-fa80-4398-b2a2-41a25fe1e592 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Calling method '>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 09:00:09.766893 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-76585be2-fa80-4398-b2a2-41a25fe1e592 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] [instance: f4be98bb-be88-421f-a448-f04a4f97702b] Fetching instance by UUID {{(pid=123459) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 09:00:09.774710 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-76585be2-fa80-4398-b2a2-41a25fe1e592 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:00:09.775556 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-76585be2-fa80-4398-b2a2-41a25fe1e592 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:00:09.776505 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-76585be2-fa80-4398-b2a2-41a25fe1e592 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:00:09.776951 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-76585be2-fa80-4398-b2a2-41a25fe1e592 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:00:09.792861 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.wsgi [None req-76585be2-fa80-4398-b2a2-41a25fe1e592 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] HTTP exception thrown: Instance f4be98bb-be88-421f-a448-f04a4f97702b could not be found. Apr 29 09:00:09.793472 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-76585be2-fa80-4398-b2a2-41a25fe1e592 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Returning 404 to user: Instance f4be98bb-be88-421f-a448-f04a4f97702b could not be found. {{(pid=123459) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 29 09:00:09.794330 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-76585be2-fa80-4398-b2a2-41a25fe1e592 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] 10.222.0.31 "GET /compute/v2.1/servers/f4be98bb-be88-421f-a448-f04a4f97702b" status: 404 len: 111 microversion: 2.1 time: 0.032222 Apr 29 09:00:09.798214 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 461/923] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 09:00:09 2022] GET /compute/v2.1/servers/f4be98bb-be88-421f-a448-f04a4f97702b => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 29 09:00:09.805048 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-b92b1a9a-b8bd-4afc-bec4-1677668a3462 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Calling method '.version_select at 0x7f623838f1f0>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 09:00:09.824495 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-b92b1a9a-b8bd-4afc-bec4-1677668a3462 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] 10.222.0.31 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-703014161" status: 202 len: 0 microversion: 2.1 time: 0.024658 Apr 29 09:00:09.825089 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 463/924] 10.222.0.31 () {58 vars in 1217 bytes} [Fri Apr 29 09:00:09 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-703014161 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 29 09:00:12.984384 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-b5605886-55e5-43e5-971f-beb05204e1c0 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Calling method '>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 09:00:12.984952 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-b5605886-55e5-43e5-971f-beb05204e1c0 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] [instance: 8715736d-99f1-4f4c-af1f-c4bf3fc295d3] Fetching instance by UUID {{(pid=123459) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 09:00:12.991952 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-b5605886-55e5-43e5-971f-beb05204e1c0 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:00:12.993060 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-b5605886-55e5-43e5-971f-beb05204e1c0 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:00:12.993882 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-b5605886-55e5-43e5-971f-beb05204e1c0 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:00:12.994596 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-b5605886-55e5-43e5-971f-beb05204e1c0 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:00:13.027501 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-b5605886-55e5-43e5-971f-beb05204e1c0 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] [instance: 8715736d-99f1-4f4c-af1f-c4bf3fc295d3] Going to try to terminate instance {{(pid=123459) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 29 09:00:13.276371 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-b5605886-55e5-43e5-971f-beb05204e1c0 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] 10.222.0.31 "DELETE /compute/v2.1/servers/8715736d-99f1-4f4c-af1f-c4bf3fc295d3" status: 204 len: 0 microversion: 2.1 time: 0.295528 Apr 29 09:00:13.277447 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 462/925] 10.222.0.31 () {58 vars in 1238 bytes} [Fri Apr 29 09:00:12 2022] DELETE /compute/v2.1/servers/8715736d-99f1-4f4c-af1f-c4bf3fc295d3 => generated 0 bytes in 297 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Apr 29 09:00:13.285856 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-559237a6-38e5-4a9d-9927-e9a1b4c50a0f tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Calling method '>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 09:00:13.286859 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-559237a6-38e5-4a9d-9927-e9a1b4c50a0f tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] [instance: 8715736d-99f1-4f4c-af1f-c4bf3fc295d3] Fetching instance by UUID {{(pid=123458) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 09:00:13.295254 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-559237a6-38e5-4a9d-9927-e9a1b4c50a0f tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:00:13.295701 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-559237a6-38e5-4a9d-9927-e9a1b4c50a0f tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:00:13.296524 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-559237a6-38e5-4a9d-9927-e9a1b4c50a0f tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:00:13.296959 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-559237a6-38e5-4a9d-9927-e9a1b4c50a0f tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:00:13.440665 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-559237a6-38e5-4a9d-9927-e9a1b4c50a0f tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c18e88436f14dc7a2001220b87ce9ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60998f08c40446e787ead285e40665b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 09:00:13.449258 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-559237a6-38e5-4a9d-9927-e9a1b4c50a0f tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] 10.222.0.31 "GET /compute/v2.1/servers/8715736d-99f1-4f4c-af1f-c4bf3fc295d3" status: 200 len: 1508 microversion: 2.1 time: 0.167254 Apr 29 09:00:13.449844 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 464/926] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 09:00:13 2022] GET /compute/v2.1/servers/8715736d-99f1-4f4c-af1f-c4bf3fc295d3 => generated 1508 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 29 09:00:14.467715 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-b1992493-7548-4954-ac7f-210b9fc9118a tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Calling method '>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 09:00:14.468934 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-b1992493-7548-4954-ac7f-210b9fc9118a tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] [instance: 8715736d-99f1-4f4c-af1f-c4bf3fc295d3] Fetching instance by UUID {{(pid=123459) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 09:00:14.478347 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-b1992493-7548-4954-ac7f-210b9fc9118a tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:00:14.478935 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-b1992493-7548-4954-ac7f-210b9fc9118a tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:00:14.479789 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-b1992493-7548-4954-ac7f-210b9fc9118a tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:00:14.480254 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-b1992493-7548-4954-ac7f-210b9fc9118a tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:00:14.719235 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-b1992493-7548-4954-ac7f-210b9fc9118a tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c18e88436f14dc7a2001220b87ce9ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60998f08c40446e787ead285e40665b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 09:00:14.726885 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-b1992493-7548-4954-ac7f-210b9fc9118a tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] 10.222.0.31 "GET /compute/v2.1/servers/8715736d-99f1-4f4c-af1f-c4bf3fc295d3" status: 200 len: 1508 microversion: 2.1 time: 0.263873 Apr 29 09:00:14.727470 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 463/927] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 09:00:14 2022] GET /compute/v2.1/servers/8715736d-99f1-4f4c-af1f-c4bf3fc295d3 => generated 1508 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 29 09:00:15.077658 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [req-5e40c74c-b969-42fb-8e14-50bc58dfe997 req-8945ca59-e073-4950-89cb-8ed81bee6b17 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8715736d-99f1-4f4c-af1f-c4bf3fc295d3", "name": "network-vif-deleted", "tag": "4011c2e6-769b-4586-8b40-1da7764504df"}]} {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 29 09:00:15.103508 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [req-5e40c74c-b969-42fb-8e14-50bc58dfe997 req-8945ca59-e073-4950-89cb-8ed81bee6b17 service nova] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:00:15.104394 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [req-5e40c74c-b969-42fb-8e14-50bc58dfe997 req-8945ca59-e073-4950-89cb-8ed81bee6b17 service nova] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:00:15.118569 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.compute.server_external_events [req-5e40c74c-b969-42fb-8e14-50bc58dfe997 req-8945ca59-e073-4950-89cb-8ed81bee6b17 service nova] Creating event network-vif-deleted:4011c2e6-769b-4586-8b40-1da7764504df for instance 8715736d-99f1-4f4c-af1f-c4bf3fc295d3 on hv-cinder-83987 Apr 29 09:00:15.124230 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [req-5e40c74c-b969-42fb-8e14-50bc58dfe997 req-8945ca59-e073-4950-89cb-8ed81bee6b17 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051905 Apr 29 09:00:15.124960 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 465/928] 10.222.0.31 () {64 vars in 1317 bytes} [Fri Apr 29 09:00:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 29 09:00:15.744730 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-9b0cf396-0e7d-420f-9908-d538f268ab1a tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Calling method '>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 09:00:15.745349 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-9b0cf396-0e7d-420f-9908-d538f268ab1a tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] [instance: 8715736d-99f1-4f4c-af1f-c4bf3fc295d3] Fetching instance by UUID {{(pid=123459) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 09:00:15.752373 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-9b0cf396-0e7d-420f-9908-d538f268ab1a tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:00:15.752820 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-9b0cf396-0e7d-420f-9908-d538f268ab1a tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:00:15.753608 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-9b0cf396-0e7d-420f-9908-d538f268ab1a tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:00:15.754054 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-9b0cf396-0e7d-420f-9908-d538f268ab1a tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:00:15.768861 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.wsgi [None req-9b0cf396-0e7d-420f-9908-d538f268ab1a tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] HTTP exception thrown: Instance 8715736d-99f1-4f4c-af1f-c4bf3fc295d3 could not be found. Apr 29 09:00:15.769461 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-9b0cf396-0e7d-420f-9908-d538f268ab1a tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Returning 404 to user: Instance 8715736d-99f1-4f4c-af1f-c4bf3fc295d3 could not be found. {{(pid=123459) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 29 09:00:15.770307 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-9b0cf396-0e7d-420f-9908-d538f268ab1a tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] 10.222.0.31 "GET /compute/v2.1/servers/8715736d-99f1-4f4c-af1f-c4bf3fc295d3" status: 404 len: 111 microversion: 2.1 time: 0.030162 Apr 29 09:00:15.770866 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 464/929] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 09:00:15 2022] GET /compute/v2.1/servers/8715736d-99f1-4f4c-af1f-c4bf3fc295d3 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 29 09:00:15.781613 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-c4e04f7f-2f41-4dc7-85d4-6ef76c67b11d tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Calling method '>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 09:00:15.782214 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-c4e04f7f-2f41-4dc7-85d4-6ef76c67b11d tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] [instance: 4e972e2b-7b5e-4a5f-87a1-3642aad3ac24] Fetching instance by UUID {{(pid=123458) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 09:00:15.789904 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-c4e04f7f-2f41-4dc7-85d4-6ef76c67b11d tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:00:15.790525 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-c4e04f7f-2f41-4dc7-85d4-6ef76c67b11d tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:00:15.791385 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-c4e04f7f-2f41-4dc7-85d4-6ef76c67b11d tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:00:15.791939 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-c4e04f7f-2f41-4dc7-85d4-6ef76c67b11d tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:00:15.819732 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-c4e04f7f-2f41-4dc7-85d4-6ef76c67b11d tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] [instance: 4e972e2b-7b5e-4a5f-87a1-3642aad3ac24] Going to try to terminate instance {{(pid=123458) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 29 09:00:15.911748 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-c4e04f7f-2f41-4dc7-85d4-6ef76c67b11d tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] 10.222.0.31 "DELETE /compute/v2.1/servers/4e972e2b-7b5e-4a5f-87a1-3642aad3ac24" status: 204 len: 0 microversion: 2.1 time: 0.134565 Apr 29 09:00:15.912422 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 466/930] 10.222.0.31 () {58 vars in 1238 bytes} [Fri Apr 29 09:00:15 2022] DELETE /compute/v2.1/servers/4e972e2b-7b5e-4a5f-87a1-3642aad3ac24 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Apr 29 09:00:15.921655 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-a334b45c-deb4-4cba-827c-c8180ca84943 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Calling method '>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 09:00:15.922263 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-a334b45c-deb4-4cba-827c-c8180ca84943 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] [instance: 4e972e2b-7b5e-4a5f-87a1-3642aad3ac24] Fetching instance by UUID {{(pid=123459) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 09:00:15.928824 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-a334b45c-deb4-4cba-827c-c8180ca84943 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:00:15.929325 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-a334b45c-deb4-4cba-827c-c8180ca84943 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:00:15.930275 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-a334b45c-deb4-4cba-827c-c8180ca84943 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:00:15.930719 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-a334b45c-deb4-4cba-827c-c8180ca84943 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:00:16.081442 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-a334b45c-deb4-4cba-827c-c8180ca84943 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c18e88436f14dc7a2001220b87ce9ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60998f08c40446e787ead285e40665b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 09:00:16.091124 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-a334b45c-deb4-4cba-827c-c8180ca84943 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] 10.222.0.31 "GET /compute/v2.1/servers/4e972e2b-7b5e-4a5f-87a1-3642aad3ac24" status: 200 len: 1522 microversion: 2.1 time: 0.173328 Apr 29 09:00:16.091753 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 465/931] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 09:00:15 2022] GET /compute/v2.1/servers/4e972e2b-7b5e-4a5f-87a1-3642aad3ac24 => generated 1522 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 29 09:00:17.111495 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-bd9ef6ec-0dd0-40ce-8838-1398e1769ffd tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Calling method '>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 09:00:17.112947 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-bd9ef6ec-0dd0-40ce-8838-1398e1769ffd tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] [instance: 4e972e2b-7b5e-4a5f-87a1-3642aad3ac24] Fetching instance by UUID {{(pid=123458) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 09:00:17.123377 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-bd9ef6ec-0dd0-40ce-8838-1398e1769ffd tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:00:17.124197 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-bd9ef6ec-0dd0-40ce-8838-1398e1769ffd tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:00:17.125600 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-bd9ef6ec-0dd0-40ce-8838-1398e1769ffd tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:00:17.126406 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-bd9ef6ec-0dd0-40ce-8838-1398e1769ffd tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:00:17.275578 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-bd9ef6ec-0dd0-40ce-8838-1398e1769ffd tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c18e88436f14dc7a2001220b87ce9ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60998f08c40446e787ead285e40665b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 09:00:17.283460 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-bd9ef6ec-0dd0-40ce-8838-1398e1769ffd tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] 10.222.0.31 "GET /compute/v2.1/servers/4e972e2b-7b5e-4a5f-87a1-3642aad3ac24" status: 200 len: 1522 microversion: 2.1 time: 0.178040 Apr 29 09:00:17.284042 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 467/932] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 09:00:17 2022] GET /compute/v2.1/servers/4e972e2b-7b5e-4a5f-87a1-3642aad3ac24 => generated 1522 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 09:00:18.301743 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-fc428e63-45aa-4188-b142-7028029d89f0 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Calling method '>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 09:00:18.302426 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-fc428e63-45aa-4188-b142-7028029d89f0 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] [instance: 4e972e2b-7b5e-4a5f-87a1-3642aad3ac24] Fetching instance by UUID {{(pid=123459) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 09:00:18.310655 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-fc428e63-45aa-4188-b142-7028029d89f0 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:00:18.311429 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-fc428e63-45aa-4188-b142-7028029d89f0 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:00:18.312515 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-fc428e63-45aa-4188-b142-7028029d89f0 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:00:18.312964 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-fc428e63-45aa-4188-b142-7028029d89f0 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:00:18.551609 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-fc428e63-45aa-4188-b142-7028029d89f0 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c18e88436f14dc7a2001220b87ce9ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60998f08c40446e787ead285e40665b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 09:00:18.561542 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-fc428e63-45aa-4188-b142-7028029d89f0 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] 10.222.0.31 "GET /compute/v2.1/servers/4e972e2b-7b5e-4a5f-87a1-3642aad3ac24" status: 200 len: 1522 microversion: 2.1 time: 0.263717 Apr 29 09:00:18.562236 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 466/933] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 09:00:18 2022] GET /compute/v2.1/servers/4e972e2b-7b5e-4a5f-87a1-3642aad3ac24 => generated 1522 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 09:00:18.952973 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [req-a700313b-3ad8-4b7c-bca1-01e73380f425 req-57eb87a9-57e0-46c2-a688-aa63c53097ef service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4e972e2b-7b5e-4a5f-87a1-3642aad3ac24", "name": "network-vif-deleted", "tag": "59575408-22b1-4ee7-9c81-bef3610d56b7"}]} {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 29 09:00:18.966379 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [req-a700313b-3ad8-4b7c-bca1-01e73380f425 req-57eb87a9-57e0-46c2-a688-aa63c53097ef service nova] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:00:18.967312 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [req-a700313b-3ad8-4b7c-bca1-01e73380f425 req-57eb87a9-57e0-46c2-a688-aa63c53097ef service nova] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:00:18.988639 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.compute.server_external_events [req-a700313b-3ad8-4b7c-bca1-01e73380f425 req-57eb87a9-57e0-46c2-a688-aa63c53097ef service nova] Creating event network-vif-deleted:59575408-22b1-4ee7-9c81-bef3610d56b7 for instance 4e972e2b-7b5e-4a5f-87a1-3642aad3ac24 on hv-cinder-83987 Apr 29 09:00:18.998225 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [req-a700313b-3ad8-4b7c-bca1-01e73380f425 req-57eb87a9-57e0-46c2-a688-aa63c53097ef service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048391 Apr 29 09:00:18.999851 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 468/934] 10.222.0.31 () {64 vars in 1317 bytes} [Fri Apr 29 09:00:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 29 09:00:19.284885 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-60111749-dde9-4773-ac86-e1d1a1ef205f tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3ae9ccf3-f74c-465a-affe-9cf04dcf5306"}} {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 29 09:00:19.286047 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-60111749-dde9-4773-ac86-e1d1a1ef205f tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] [instance: 6722378c-3c16-480e-b7de-4f9c8696fa03] Fetching instance by UUID {{(pid=123459) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 09:00:19.292918 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-60111749-dde9-4773-ac86-e1d1a1ef205f tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:00:19.293371 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-60111749-dde9-4773-ac86-e1d1a1ef205f tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:00:19.294158 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-60111749-dde9-4773-ac86-e1d1a1ef205f tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:00:19.294598 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-60111749-dde9-4773-ac86-e1d1a1ef205f tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:00:19.386092 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.wsgi [None req-60111749-dde9-4773-ac86-e1d1a1ef205f tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] HTTP exception thrown: Invalid volume: volume 3ae9ccf3-f74c-465a-affe-9cf04dcf5306 is already attached to instances: 6722378c-3c16-480e-b7de-4f9c8696fa03 Apr 29 09:00:19.387138 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-60111749-dde9-4773-ac86-e1d1a1ef205f tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Returning 400 to user: Invalid volume: volume 3ae9ccf3-f74c-465a-affe-9cf04dcf5306 is already attached to instances: 6722378c-3c16-480e-b7de-4f9c8696fa03 {{(pid=123459) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 29 09:00:19.388807 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-60111749-dde9-4773-ac86-e1d1a1ef205f tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] 10.222.0.31 "POST /compute/v2.1/servers/6722378c-3c16-480e-b7de-4f9c8696fa03/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.107650 Apr 29 09:00:19.389901 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 467/935] 10.222.0.31 () {60 vars in 1322 bytes} [Fri Apr 29 09:00:19 2022] POST /compute/v2.1/servers/6722378c-3c16-480e-b7de-4f9c8696fa03/os-volume_attachments => generated 174 bytes in 110 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 29 09:00:19.474303 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-90695357-01cc-4fe5-9563-9c4e85bbe875 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Calling method '>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 09:00:19.475376 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-90695357-01cc-4fe5-9563-9c4e85bbe875 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] [instance: 6722378c-3c16-480e-b7de-4f9c8696fa03] Fetching instance by UUID {{(pid=123458) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 09:00:19.483915 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-90695357-01cc-4fe5-9563-9c4e85bbe875 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:00:19.484556 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-90695357-01cc-4fe5-9563-9c4e85bbe875 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:00:19.485852 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-90695357-01cc-4fe5-9563-9c4e85bbe875 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:00:19.486589 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-90695357-01cc-4fe5-9563-9c4e85bbe875 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:00:19.590651 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-c79de5ce-1355-49de-89e1-c2278c3fab01 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Calling method '>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 09:00:19.593340 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-c79de5ce-1355-49de-89e1-c2278c3fab01 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] [instance: 4e972e2b-7b5e-4a5f-87a1-3642aad3ac24] Fetching instance by UUID {{(pid=123459) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 09:00:19.605526 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-c79de5ce-1355-49de-89e1-c2278c3fab01 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:00:19.606078 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-c79de5ce-1355-49de-89e1-c2278c3fab01 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:00:19.606949 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-c79de5ce-1355-49de-89e1-c2278c3fab01 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:00:19.607651 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-c79de5ce-1355-49de-89e1-c2278c3fab01 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:00:19.611767 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.objects.instance [None req-90695357-01cc-4fe5-9563-9c4e85bbe875 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lazy-loading 'services' on Instance uuid 6722378c-3c16-480e-b7de-4f9c8696fa03 {{(pid=123458) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 29 09:00:19.627897 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.wsgi [None req-c79de5ce-1355-49de-89e1-c2278c3fab01 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] HTTP exception thrown: Instance 4e972e2b-7b5e-4a5f-87a1-3642aad3ac24 could not be found. Apr 29 09:00:19.628523 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-c79de5ce-1355-49de-89e1-c2278c3fab01 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] Returning 404 to user: Instance 4e972e2b-7b5e-4a5f-87a1-3642aad3ac24 could not be found. {{(pid=123459) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 29 09:00:19.629352 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-c79de5ce-1355-49de-89e1-c2278c3fab01 tempest-ServerRescueNegativeTestJSON-420241381 tempest-ServerRescueNegativeTestJSON-420241381-project] 10.222.0.31 "GET /compute/v2.1/servers/4e972e2b-7b5e-4a5f-87a1-3642aad3ac24" status: 404 len: 111 microversion: 2.1 time: 0.047140 Apr 29 09:00:19.630491 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 468/936] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 09:00:19 2022] GET /compute/v2.1/servers/4e972e2b-7b5e-4a5f-87a1-3642aad3ac24 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Apr 29 09:00:19.710150 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-90695357-01cc-4fe5-9563-9c4e85bbe875 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] 10.222.0.31 "DELETE /compute/v2.1/servers/6722378c-3c16-480e-b7de-4f9c8696fa03/os-volume_attachments/3ae9ccf3-f74c-465a-affe-9cf04dcf5306" status: 202 len: 0 microversion: 2.1 time: 0.241648 Apr 29 09:00:19.711135 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 469/937] 10.222.0.31 () {58 vars in 1415 bytes} [Fri Apr 29 09:00:19 2022] DELETE /compute/v2.1/servers/6722378c-3c16-480e-b7de-4f9c8696fa03/os-volume_attachments/3ae9ccf3-f74c-465a-affe-9cf04dcf5306 => generated 0 bytes in 245 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Apr 29 09:00:19.724710 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-ba53e4ae-cd07-4d02-9c2f-0e74eed08549 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Calling method '>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 09:00:19.727162 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-ba53e4ae-cd07-4d02-9c2f-0e74eed08549 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] [instance: 6722378c-3c16-480e-b7de-4f9c8696fa03] Fetching instance by UUID {{(pid=123459) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 09:00:19.738499 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-ba53e4ae-cd07-4d02-9c2f-0e74eed08549 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:00:19.739429 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-ba53e4ae-cd07-4d02-9c2f-0e74eed08549 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:00:19.740938 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-ba53e4ae-cd07-4d02-9c2f-0e74eed08549 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:00:19.742799 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-ba53e4ae-cd07-4d02-9c2f-0e74eed08549 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:00:19.798887 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-ba53e4ae-cd07-4d02-9c2f-0e74eed08549 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] 10.222.0.31 "GET /compute/v2.1/servers/6722378c-3c16-480e-b7de-4f9c8696fa03/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.081614 Apr 29 09:00:19.799899 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 469/938] 10.222.0.31 () {58 vars in 1301 bytes} [Fri Apr 29 09:00:19 2022] GET /compute/v2.1/servers/6722378c-3c16-480e-b7de-4f9c8696fa03/os-volume_attachments => generated 197 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 29 09:00:20.819255 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-3cc6c002-1bc5-4fe3-b6a8-30bde45d9338 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Calling method '>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 09:00:20.821825 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-3cc6c002-1bc5-4fe3-b6a8-30bde45d9338 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] [instance: 6722378c-3c16-480e-b7de-4f9c8696fa03] Fetching instance by UUID {{(pid=123458) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 09:00:20.831554 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-3cc6c002-1bc5-4fe3-b6a8-30bde45d9338 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:00:20.832230 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-3cc6c002-1bc5-4fe3-b6a8-30bde45d9338 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:00:20.833198 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-3cc6c002-1bc5-4fe3-b6a8-30bde45d9338 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:00:20.833755 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-3cc6c002-1bc5-4fe3-b6a8-30bde45d9338 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:00:20.881599 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-3cc6c002-1bc5-4fe3-b6a8-30bde45d9338 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] 10.222.0.31 "GET /compute/v2.1/servers/6722378c-3c16-480e-b7de-4f9c8696fa03/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.070265 Apr 29 09:00:20.882370 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 470/939] 10.222.0.31 () {58 vars in 1301 bytes} [Fri Apr 29 09:00:20 2022] GET /compute/v2.1/servers/6722378c-3c16-480e-b7de-4f9c8696fa03/os-volume_attachments => generated 25 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 29 09:00:20.968744 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-9dcf2e82-3766-4c2c-bc57-d1e4675cb2ef tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Calling method '>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 09:00:20.969367 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-9dcf2e82-3766-4c2c-bc57-d1e4675cb2ef tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] [instance: 6722378c-3c16-480e-b7de-4f9c8696fa03] Fetching instance by UUID {{(pid=123459) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 09:00:20.977247 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-9dcf2e82-3766-4c2c-bc57-d1e4675cb2ef tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:00:20.977890 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-9dcf2e82-3766-4c2c-bc57-d1e4675cb2ef tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:00:20.978508 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-9dcf2e82-3766-4c2c-bc57-d1e4675cb2ef tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:00:20.979388 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-9dcf2e82-3766-4c2c-bc57-d1e4675cb2ef tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:00:21.008758 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-9dcf2e82-3766-4c2c-bc57-d1e4675cb2ef tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] [instance: 6722378c-3c16-480e-b7de-4f9c8696fa03] Going to try to terminate instance {{(pid=123459) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 29 09:00:21.131565 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-9dcf2e82-3766-4c2c-bc57-d1e4675cb2ef tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] 10.222.0.31 "DELETE /compute/v2.1/servers/6722378c-3c16-480e-b7de-4f9c8696fa03" status: 204 len: 0 microversion: 2.1 time: 0.165408 Apr 29 09:00:21.135994 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 470/940] 10.222.0.31 () {58 vars in 1238 bytes} [Fri Apr 29 09:00:20 2022] DELETE /compute/v2.1/servers/6722378c-3c16-480e-b7de-4f9c8696fa03 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 29 09:00:21.141758 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-3f430587-325d-485c-9ae0-b0b198a35050 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Calling method '>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 09:00:21.142520 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-3f430587-325d-485c-9ae0-b0b198a35050 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] [instance: 6722378c-3c16-480e-b7de-4f9c8696fa03] Fetching instance by UUID {{(pid=123458) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 09:00:21.152094 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-3f430587-325d-485c-9ae0-b0b198a35050 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:00:21.152725 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-3f430587-325d-485c-9ae0-b0b198a35050 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:00:21.154105 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-3f430587-325d-485c-9ae0-b0b198a35050 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:00:21.154914 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-3f430587-325d-485c-9ae0-b0b198a35050 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:00:21.316527 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-3f430587-325d-485c-9ae0-b0b198a35050 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e47ecdfb01f447699275b13255c15d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578e6a35974d4e5c8a0cd4e5fa994259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 09:00:21.326280 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-3f430587-325d-485c-9ae0-b0b198a35050 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] 10.222.0.31 "GET /compute/v2.1/servers/6722378c-3c16-480e-b7de-4f9c8696fa03" status: 200 len: 1682 microversion: 2.1 time: 0.188788 Apr 29 09:00:21.327259 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 471/941] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 09:00:21 2022] GET /compute/v2.1/servers/6722378c-3c16-480e-b7de-4f9c8696fa03 => generated 1682 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 09:00:22.345931 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-61d8f164-87ce-4fe4-ab40-586580517286 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Calling method '>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 09:00:22.347007 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-61d8f164-87ce-4fe4-ab40-586580517286 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] [instance: 6722378c-3c16-480e-b7de-4f9c8696fa03] Fetching instance by UUID {{(pid=123459) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 09:00:22.353987 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-61d8f164-87ce-4fe4-ab40-586580517286 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:00:22.354526 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-61d8f164-87ce-4fe4-ab40-586580517286 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:00:22.355404 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-61d8f164-87ce-4fe4-ab40-586580517286 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:00:22.355925 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-61d8f164-87ce-4fe4-ab40-586580517286 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:00:22.922999 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-61d8f164-87ce-4fe4-ab40-586580517286 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e47ecdfb01f447699275b13255c15d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578e6a35974d4e5c8a0cd4e5fa994259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 09:00:22.931614 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-61d8f164-87ce-4fe4-ab40-586580517286 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] 10.222.0.31 "GET /compute/v2.1/servers/6722378c-3c16-480e-b7de-4f9c8696fa03" status: 200 len: 1682 microversion: 2.1 time: 0.589884 Apr 29 09:00:22.932446 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 471/942] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 09:00:22 2022] GET /compute/v2.1/servers/6722378c-3c16-480e-b7de-4f9c8696fa03 => generated 1682 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 09:00:23.406933 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-26fd3f39-c375-4c94-8ae2-e07f18502293 tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1005192867"}} {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 29 09:00:23.406933 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-26fd3f39-c375-4c94-8ae2-e07f18502293 tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] [instance: c3ad1103-185b-4f84-beb9-e1d0e546b2ed] Fetching instance by UUID {{(pid=123458) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 09:00:23.419130 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-26fd3f39-c375-4c94-8ae2-e07f18502293 tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:00:23.422463 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-26fd3f39-c375-4c94-8ae2-e07f18502293 tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:00:23.424408 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-26fd3f39-c375-4c94-8ae2-e07f18502293 tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:00:23.425289 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-26fd3f39-c375-4c94-8ae2-e07f18502293 tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:00:23.709574 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.network.security_group_api [None req-26fd3f39-c375-4c94-8ae2-e07f18502293 tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] Removing security group 62934bc3-0993-49cd-9bf9-c9f808b359f6 from port 69230ee3-728d-4825-9b39-4cb903b621cf Apr 29 09:00:23.952170 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-48c934b8-2f5f-4adc-a7ec-de73a0900f81 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Calling method '>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 09:00:23.952982 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-48c934b8-2f5f-4adc-a7ec-de73a0900f81 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] [instance: 6722378c-3c16-480e-b7de-4f9c8696fa03] Fetching instance by UUID {{(pid=123459) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 09:00:23.962366 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-48c934b8-2f5f-4adc-a7ec-de73a0900f81 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:00:23.964244 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-48c934b8-2f5f-4adc-a7ec-de73a0900f81 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:00:23.967583 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-48c934b8-2f5f-4adc-a7ec-de73a0900f81 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:00:23.968398 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-48c934b8-2f5f-4adc-a7ec-de73a0900f81 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:00:24.209946 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-48c934b8-2f5f-4adc-a7ec-de73a0900f81 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e47ecdfb01f447699275b13255c15d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578e6a35974d4e5c8a0cd4e5fa994259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 09:00:24.219414 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-48c934b8-2f5f-4adc-a7ec-de73a0900f81 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] 10.222.0.31 "GET /compute/v2.1/servers/6722378c-3c16-480e-b7de-4f9c8696fa03" status: 200 len: 1682 microversion: 2.1 time: 0.274097 Apr 29 09:00:24.230787 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 472/943] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 09:00:23 2022] GET /compute/v2.1/servers/6722378c-3c16-480e-b7de-4f9c8696fa03 => generated 1682 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 29 09:00:24.388566 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-f8aa86c8-1970-4de7-83ad-5501703db6eb tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] Calling method '>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 09:00:24.389268 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-f8aa86c8-1970-4de7-83ad-5501703db6eb tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] [instance: 8d96abf8-36ee-48bc-a692-27682f8c1c2e] Fetching instance by UUID {{(pid=123459) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 09:00:24.423515 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-f8aa86c8-1970-4de7-83ad-5501703db6eb tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:00:24.424177 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-f8aa86c8-1970-4de7-83ad-5501703db6eb tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:00:24.425043 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-f8aa86c8-1970-4de7-83ad-5501703db6eb tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:00:24.425499 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-f8aa86c8-1970-4de7-83ad-5501703db6eb tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:00:24.450888 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-26fd3f39-c375-4c94-8ae2-e07f18502293 tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] 10.222.0.31 "POST /compute/v2.1/servers/c3ad1103-185b-4f84-beb9-e1d0e546b2ed/action" status: 202 len: 0 microversion: 2.1 time: 1.054051 Apr 29 09:00:24.452490 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 472/944] 10.222.0.31 () {60 vars in 1277 bytes} [Fri Apr 29 09:00:23 2022] POST /compute/v2.1/servers/c3ad1103-185b-4f84-beb9-e1d0e546b2ed/action => generated 0 bytes in 1057 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 29 09:00:24.467618 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [req-33495902-42ae-4c51-801b-5dda64f30eb5 req-a2643e93-d614-4705-8061-385be2d4d1ca service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c3ad1103-185b-4f84-beb9-e1d0e546b2ed", "tag": "69230ee3-728d-4825-9b39-4cb903b621cf"}]} {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 29 09:00:24.479331 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [req-33495902-42ae-4c51-801b-5dda64f30eb5 req-a2643e93-d614-4705-8061-385be2d4d1ca service nova] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:00:24.480069 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [req-33495902-42ae-4c51-801b-5dda64f30eb5 req-a2643e93-d614-4705-8061-385be2d4d1ca service nova] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:00:24.492745 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-f8aa86c8-1970-4de7-83ad-5501703db6eb tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] [instance: 8d96abf8-36ee-48bc-a692-27682f8c1c2e] Going to try to terminate instance {{(pid=123459) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 29 09:00:24.502340 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.compute.server_external_events [req-33495902-42ae-4c51-801b-5dda64f30eb5 req-a2643e93-d614-4705-8061-385be2d4d1ca service nova] Creating event network-changed:69230ee3-728d-4825-9b39-4cb903b621cf for instance c3ad1103-185b-4f84-beb9-e1d0e546b2ed on hv-cinder-83987 Apr 29 09:00:24.523948 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [req-33495902-42ae-4c51-801b-5dda64f30eb5 req-a2643e93-d614-4705-8061-385be2d4d1ca service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060265 Apr 29 09:00:24.526270 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 473/945] 10.222.0.31 () {64 vars in 1317 bytes} [Fri Apr 29 09:00:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 29 09:00:24.666400 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-f8aa86c8-1970-4de7-83ad-5501703db6eb tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] 10.222.0.31 "DELETE /compute/v2.1/servers/8d96abf8-36ee-48bc-a692-27682f8c1c2e" status: 204 len: 0 microversion: 2.1 time: 0.282285 Apr 29 09:00:24.672347 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 473/946] 10.222.0.31 () {58 vars in 1238 bytes} [Fri Apr 29 09:00:24 2022] DELETE /compute/v2.1/servers/8d96abf8-36ee-48bc-a692-27682f8c1c2e => generated 0 bytes in 286 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 29 09:00:24.677684 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-e0371cb2-8f07-419f-87b4-a58d4f71a67c tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] Calling method '>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 09:00:24.678561 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-e0371cb2-8f07-419f-87b4-a58d4f71a67c tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] [instance: 8d96abf8-36ee-48bc-a692-27682f8c1c2e] Fetching instance by UUID {{(pid=123458) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 09:00:24.688748 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-e0371cb2-8f07-419f-87b4-a58d4f71a67c tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:00:24.689597 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-e0371cb2-8f07-419f-87b4-a58d4f71a67c tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:00:24.690665 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-e0371cb2-8f07-419f-87b4-a58d4f71a67c tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:00:24.691354 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-e0371cb2-8f07-419f-87b4-a58d4f71a67c tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:00:24.975368 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [req-679d82a5-71a0-4eac-acbd-865700de6c02 req-f8ad2809-cd9a-4c53-acd4-f0e1a5a0d78a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6722378c-3c16-480e-b7de-4f9c8696fa03", "name": "network-vif-deleted", "tag": "55ac5c5c-82d5-480e-a4e9-c6ff2f7c561c"}]} {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 29 09:00:25.002467 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [req-679d82a5-71a0-4eac-acbd-865700de6c02 req-f8ad2809-cd9a-4c53-acd4-f0e1a5a0d78a service nova] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:00:25.005172 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [req-679d82a5-71a0-4eac-acbd-865700de6c02 req-f8ad2809-cd9a-4c53-acd4-f0e1a5a0d78a service nova] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:00:25.039369 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.compute.server_external_events [req-679d82a5-71a0-4eac-acbd-865700de6c02 req-f8ad2809-cd9a-4c53-acd4-f0e1a5a0d78a service nova] Creating event network-vif-deleted:55ac5c5c-82d5-480e-a4e9-c6ff2f7c561c for instance 6722378c-3c16-480e-b7de-4f9c8696fa03 on hv-cinder-83987 Apr 29 09:00:25.051635 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [req-679d82a5-71a0-4eac-acbd-865700de6c02 req-f8ad2809-cd9a-4c53-acd4-f0e1a5a0d78a service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086052 Apr 29 09:00:25.053218 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 474/947] 10.222.0.31 () {64 vars in 1317 bytes} [Fri Apr 29 09:00:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 29 09:00:25.067180 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-e0371cb2-8f07-419f-87b4-a58d4f71a67c tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a82490fb17d42bf8c19f676fb687033', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8dd37ae188e415e86f551e3f760319e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 09:00:25.083567 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-e0371cb2-8f07-419f-87b4-a58d4f71a67c tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] 10.222.0.31 "GET /compute/v2.1/servers/8d96abf8-36ee-48bc-a692-27682f8c1c2e" status: 200 len: 1578 microversion: 2.1 time: 0.409974 Apr 29 09:00:25.101895 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 474/948] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 09:00:24 2022] GET /compute/v2.1/servers/8d96abf8-36ee-48bc-a692-27682f8c1c2e => generated 1578 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 29 09:00:25.249244 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-5fc39836-c907-4ca7-a7ca-7f15f18be2c6 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Calling method '>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 09:00:25.250053 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-5fc39836-c907-4ca7-a7ca-7f15f18be2c6 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] [instance: 6722378c-3c16-480e-b7de-4f9c8696fa03] Fetching instance by UUID {{(pid=123459) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 09:00:25.264156 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-5fc39836-c907-4ca7-a7ca-7f15f18be2c6 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:00:25.264957 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-5fc39836-c907-4ca7-a7ca-7f15f18be2c6 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:00:25.266656 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-5fc39836-c907-4ca7-a7ca-7f15f18be2c6 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:00:25.268071 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-5fc39836-c907-4ca7-a7ca-7f15f18be2c6 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:00:25.375913 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-5fc39836-c907-4ca7-a7ca-7f15f18be2c6 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e47ecdfb01f447699275b13255c15d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578e6a35974d4e5c8a0cd4e5fa994259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 09:00:25.395902 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-5fc39836-c907-4ca7-a7ca-7f15f18be2c6 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] 10.222.0.31 "GET /compute/v2.1/servers/6722378c-3c16-480e-b7de-4f9c8696fa03" status: 200 len: 1614 microversion: 2.1 time: 0.162451 Apr 29 09:00:25.396940 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 475/949] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 09:00:25 2022] GET /compute/v2.1/servers/6722378c-3c16-480e-b7de-4f9c8696fa03 => generated 1614 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 09:00:26.119997 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-17765c73-68b9-48d4-bada-5b0bc3360cdd tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] Calling method '>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 09:00:26.122287 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-17765c73-68b9-48d4-bada-5b0bc3360cdd tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] [instance: 8d96abf8-36ee-48bc-a692-27682f8c1c2e] Fetching instance by UUID {{(pid=123458) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 09:00:26.137697 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-17765c73-68b9-48d4-bada-5b0bc3360cdd tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:00:26.138921 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-17765c73-68b9-48d4-bada-5b0bc3360cdd tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:00:26.141016 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-17765c73-68b9-48d4-bada-5b0bc3360cdd tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:00:26.142203 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-17765c73-68b9-48d4-bada-5b0bc3360cdd tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:00:26.421426 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-5e9a0b9c-3de9-4805-8ab7-7b62bddcfd31 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Calling method '>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 09:00:26.422630 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-5e9a0b9c-3de9-4805-8ab7-7b62bddcfd31 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] [instance: 6722378c-3c16-480e-b7de-4f9c8696fa03] Fetching instance by UUID {{(pid=123459) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 09:00:26.433275 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-5e9a0b9c-3de9-4805-8ab7-7b62bddcfd31 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:00:26.434066 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-5e9a0b9c-3de9-4805-8ab7-7b62bddcfd31 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:00:26.435335 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-5e9a0b9c-3de9-4805-8ab7-7b62bddcfd31 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:00:26.435797 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-5e9a0b9c-3de9-4805-8ab7-7b62bddcfd31 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:00:26.486109 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-5e9a0b9c-3de9-4805-8ab7-7b62bddcfd31 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:00:26.486569 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-5e9a0b9c-3de9-4805-8ab7-7b62bddcfd31 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:00:26.487033 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.objects.instance [None req-5e9a0b9c-3de9-4805-8ab7-7b62bddcfd31 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lazy-loading 'fault' on Instance uuid 6722378c-3c16-480e-b7de-4f9c8696fa03 {{(pid=123459) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 29 09:00:26.552816 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-5e9a0b9c-3de9-4805-8ab7-7b62bddcfd31 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e47ecdfb01f447699275b13255c15d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578e6a35974d4e5c8a0cd4e5fa994259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 09:00:26.572373 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-5e9a0b9c-3de9-4805-8ab7-7b62bddcfd31 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] 10.222.0.31 "GET /compute/v2.1/servers/6722378c-3c16-480e-b7de-4f9c8696fa03" status: 200 len: 1331 microversion: 2.1 time: 0.158673 Apr 29 09:00:26.572959 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 476/950] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 09:00:26 2022] GET /compute/v2.1/servers/6722378c-3c16-480e-b7de-4f9c8696fa03 => generated 1331 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 09:00:26.881903 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-17765c73-68b9-48d4-bada-5b0bc3360cdd tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a82490fb17d42bf8c19f676fb687033', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8dd37ae188e415e86f551e3f760319e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 09:00:26.897509 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-17765c73-68b9-48d4-bada-5b0bc3360cdd tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] 10.222.0.31 "GET /compute/v2.1/servers/8d96abf8-36ee-48bc-a692-27682f8c1c2e" status: 200 len: 1578 microversion: 2.1 time: 0.785034 Apr 29 09:00:26.900575 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 475/951] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 09:00:26 2022] GET /compute/v2.1/servers/8d96abf8-36ee-48bc-a692-27682f8c1c2e => generated 1578 bytes in 789 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 09:00:27.471820 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-3df6f730-e694-45b6-847e-0adc0e1230aa tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] Calling method '>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 09:00:27.473690 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-3df6f730-e694-45b6-847e-0adc0e1230aa tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] [instance: c3ad1103-185b-4f84-beb9-e1d0e546b2ed] Fetching instance by UUID {{(pid=123459) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 09:00:27.474452 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [req-d45eca40-4dd6-4f8d-8cb0-e9f52cfd5a86 req-7e646264-9f88-42d8-b4b0-afe67a4b6b6c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c3ad1103-185b-4f84-beb9-e1d0e546b2ed", "tag": "69230ee3-728d-4825-9b39-4cb903b621cf"}]} {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 29 09:00:27.486080 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [req-d45eca40-4dd6-4f8d-8cb0-e9f52cfd5a86 req-7e646264-9f88-42d8-b4b0-afe67a4b6b6c service nova] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:00:27.486530 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [req-d45eca40-4dd6-4f8d-8cb0-e9f52cfd5a86 req-7e646264-9f88-42d8-b4b0-afe67a4b6b6c service nova] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:00:27.488768 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-3df6f730-e694-45b6-847e-0adc0e1230aa tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:00:27.489556 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-3df6f730-e694-45b6-847e-0adc0e1230aa tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:00:27.490888 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-3df6f730-e694-45b6-847e-0adc0e1230aa tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:00:27.491519 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-3df6f730-e694-45b6-847e-0adc0e1230aa tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:00:27.519000 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.compute.server_external_events [req-d45eca40-4dd6-4f8d-8cb0-e9f52cfd5a86 req-7e646264-9f88-42d8-b4b0-afe67a4b6b6c service nova] Creating event network-changed:69230ee3-728d-4825-9b39-4cb903b621cf for instance c3ad1103-185b-4f84-beb9-e1d0e546b2ed on hv-cinder-83987 Apr 29 09:00:27.528971 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [req-d45eca40-4dd6-4f8d-8cb0-e9f52cfd5a86 req-7e646264-9f88-42d8-b4b0-afe67a4b6b6c service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058358 Apr 29 09:00:27.543802 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 476/952] 10.222.0.31 () {64 vars in 1317 bytes} [Fri Apr 29 09:00:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 29 09:00:27.590758 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-efc304fc-f085-48c0-a1b7-a0f8e322c3dc tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Calling method '>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 09:00:27.591671 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-efc304fc-f085-48c0-a1b7-a0f8e322c3dc tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] [instance: 6722378c-3c16-480e-b7de-4f9c8696fa03] Fetching instance by UUID {{(pid=123458) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 09:00:27.600012 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-efc304fc-f085-48c0-a1b7-a0f8e322c3dc tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:00:27.611938 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-efc304fc-f085-48c0-a1b7-a0f8e322c3dc tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:00:27.613316 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-efc304fc-f085-48c0-a1b7-a0f8e322c3dc tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:00:27.613928 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-efc304fc-f085-48c0-a1b7-a0f8e322c3dc tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:00:27.646865 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.wsgi [None req-efc304fc-f085-48c0-a1b7-a0f8e322c3dc tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] HTTP exception thrown: Instance 6722378c-3c16-480e-b7de-4f9c8696fa03 could not be found. Apr 29 09:00:27.647998 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-efc304fc-f085-48c0-a1b7-a0f8e322c3dc tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Returning 404 to user: Instance 6722378c-3c16-480e-b7de-4f9c8696fa03 could not be found. {{(pid=123458) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 29 09:00:27.649045 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-efc304fc-f085-48c0-a1b7-a0f8e322c3dc tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] 10.222.0.31 "GET /compute/v2.1/servers/6722378c-3c16-480e-b7de-4f9c8696fa03" status: 404 len: 111 microversion: 2.1 time: 0.063140 Apr 29 09:00:27.649794 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 477/953] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 09:00:27 2022] GET /compute/v2.1/servers/6722378c-3c16-480e-b7de-4f9c8696fa03 => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Apr 29 09:00:27.668513 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-beecd313-a358-464c-971a-9a2850165282 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Calling method '.version_select at 0x7f623822e670>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 09:00:27.673374 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.objects.instance [None req-3df6f730-e694-45b6-847e-0adc0e1230aa tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] Lazy-loading 'services' on Instance uuid c3ad1103-185b-4f84-beb9-e1d0e546b2ed {{(pid=123459) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 29 09:00:27.697734 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-beecd313-a358-464c-971a-9a2850165282 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] 10.222.0.31 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1969647991" status: 202 len: 0 microversion: 2.1 time: 0.043182 Apr 29 09:00:27.705935 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 478/954] 10.222.0.31 () {58 vars in 1220 bytes} [Fri Apr 29 09:00:27 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1969647991 => generated 0 bytes in 52 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Apr 29 09:00:27.848708 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-3df6f730-e694-45b6-847e-0adc0e1230aa tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] 10.222.0.31 "DELETE /compute/v2.1/servers/c3ad1103-185b-4f84-beb9-e1d0e546b2ed/os-volume_attachments/e76a9153-da86-43ab-83b5-66b453741034" status: 202 len: 0 microversion: 2.1 time: 0.382858 Apr 29 09:00:27.855539 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 477/955] 10.222.0.31 () {58 vars in 1415 bytes} [Fri Apr 29 09:00:27 2022] DELETE /compute/v2.1/servers/c3ad1103-185b-4f84-beb9-e1d0e546b2ed/os-volume_attachments/e76a9153-da86-43ab-83b5-66b453741034 => generated 0 bytes in 391 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 29 09:00:27.861597 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-93172a98-1188-45be-a791-97f533858399 tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] Calling method '>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 09:00:27.863114 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-93172a98-1188-45be-a791-97f533858399 tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] [instance: c3ad1103-185b-4f84-beb9-e1d0e546b2ed] Fetching instance by UUID {{(pid=123458) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 09:00:27.877487 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-93172a98-1188-45be-a791-97f533858399 tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:00:27.879281 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-93172a98-1188-45be-a791-97f533858399 tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:00:27.881965 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-93172a98-1188-45be-a791-97f533858399 tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:00:27.883046 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-93172a98-1188-45be-a791-97f533858399 tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:00:27.919712 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-e9ba95df-a5a1-4981-885b-4b2ce5e673b2 tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] Calling method '>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 09:00:27.920459 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-e9ba95df-a5a1-4981-885b-4b2ce5e673b2 tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] [instance: 8d96abf8-36ee-48bc-a692-27682f8c1c2e] Fetching instance by UUID {{(pid=123459) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 09:00:27.933245 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-e9ba95df-a5a1-4981-885b-4b2ce5e673b2 tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:00:27.935736 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-e9ba95df-a5a1-4981-885b-4b2ce5e673b2 tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:00:27.937048 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-e9ba95df-a5a1-4981-885b-4b2ce5e673b2 tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:00:27.938310 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-e9ba95df-a5a1-4981-885b-4b2ce5e673b2 tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:00:27.994018 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-93172a98-1188-45be-a791-97f533858399 tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] 10.222.0.31 "GET /compute/v2.1/servers/c3ad1103-185b-4f84-beb9-e1d0e546b2ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.136530 Apr 29 09:00:28.001028 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 479/956] 10.222.0.31 () {58 vars in 1301 bytes} [Fri Apr 29 09:00:27 2022] GET /compute/v2.1/servers/c3ad1103-185b-4f84-beb9-e1d0e546b2ed/os-volume_attachments => generated 197 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 29 09:00:28.088278 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-e9ba95df-a5a1-4981-885b-4b2ce5e673b2 tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a82490fb17d42bf8c19f676fb687033', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8dd37ae188e415e86f551e3f760319e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 09:00:28.112854 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-e9ba95df-a5a1-4981-885b-4b2ce5e673b2 tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] 10.222.0.31 "GET /compute/v2.1/servers/8d96abf8-36ee-48bc-a692-27682f8c1c2e" status: 200 len: 1510 microversion: 2.1 time: 0.198713 Apr 29 09:00:28.113707 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 478/957] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 09:00:27 2022] GET /compute/v2.1/servers/8d96abf8-36ee-48bc-a692-27682f8c1c2e => generated 1510 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 29 09:00:28.365912 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [req-54e1d485-a6a6-4cd1-a93f-fd3e5df152ac req-7f9d1df5-89db-4655-9043-f5dda4f0bd7d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8d96abf8-36ee-48bc-a692-27682f8c1c2e", "name": "network-vif-deleted", "tag": "7fcb9366-b893-4162-8459-0a266ed77525"}]} {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 29 09:00:28.378700 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [req-54e1d485-a6a6-4cd1-a93f-fd3e5df152ac req-7f9d1df5-89db-4655-9043-f5dda4f0bd7d service nova] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:00:28.379677 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [req-54e1d485-a6a6-4cd1-a93f-fd3e5df152ac req-7f9d1df5-89db-4655-9043-f5dda4f0bd7d service nova] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:00:28.415724 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.compute.server_external_events [req-54e1d485-a6a6-4cd1-a93f-fd3e5df152ac req-7f9d1df5-89db-4655-9043-f5dda4f0bd7d service nova] Creating event network-vif-deleted:7fcb9366-b893-4162-8459-0a266ed77525 for instance 8d96abf8-36ee-48bc-a692-27682f8c1c2e on hv-cinder-83987 Apr 29 09:00:28.425797 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [req-54e1d485-a6a6-4cd1-a93f-fd3e5df152ac req-7f9d1df5-89db-4655-9043-f5dda4f0bd7d service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066446 Apr 29 09:00:28.427064 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 480/958] 10.222.0.31 () {64 vars in 1317 bytes} [Fri Apr 29 09:00:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 29 09:00:28.886335 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-82a0bf2c-683f-45ed-8cad-212c8f6c4028 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Action: 'create', calling method: .version_select at 0x7f623ca79790>, body: {"keypair": {"name": "tempest-keypair-900471435"}} {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 29 09:00:28.915892 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.quota [None req-82a0bf2c-683f-45ed-8cad-212c8f6c4028 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Getting quotas for project 578e6a35974d4e5c8a0cd4e5fa994259. Resources: {'key_pairs'} {{(pid=123459) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 29 09:00:28.927917 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.quota [None req-82a0bf2c-683f-45ed-8cad-212c8f6c4028 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Getting quotas for user 8e47ecdfb01f447699275b13255c15d4 and project 578e6a35974d4e5c8a0cd4e5fa994259. Resources: {'key_pairs'} {{(pid=123459) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 29 09:00:29.020215 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-42f4ac71-206c-488f-beef-36736587c24e tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] Calling method '>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 09:00:29.052638 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-42f4ac71-206c-488f-beef-36736587c24e tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] [instance: c3ad1103-185b-4f84-beb9-e1d0e546b2ed] Fetching instance by UUID {{(pid=123458) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 09:00:29.064282 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-42f4ac71-206c-488f-beef-36736587c24e tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:00:29.064734 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-42f4ac71-206c-488f-beef-36736587c24e tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:00:29.066934 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-42f4ac71-206c-488f-beef-36736587c24e tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:00:29.067549 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-42f4ac71-206c-488f-beef-36736587c24e tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:00:29.120770 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-42f4ac71-206c-488f-beef-36736587c24e tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] 10.222.0.31 "GET /compute/v2.1/servers/c3ad1103-185b-4f84-beb9-e1d0e546b2ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.111130 Apr 29 09:00:29.121776 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 481/959] 10.222.0.31 () {58 vars in 1301 bytes} [Fri Apr 29 09:00:29 2022] GET /compute/v2.1/servers/c3ad1103-185b-4f84-beb9-e1d0e546b2ed/os-volume_attachments => generated 197 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 29 09:00:29.136262 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-2f0ebc23-def6-4a78-8ce2-eeacafdf36be tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] Calling method '>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 09:00:29.136948 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-2f0ebc23-def6-4a78-8ce2-eeacafdf36be tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] [instance: 8d96abf8-36ee-48bc-a692-27682f8c1c2e] Fetching instance by UUID {{(pid=123458) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 09:00:29.143045 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-2f0ebc23-def6-4a78-8ce2-eeacafdf36be tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:00:29.143759 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-2f0ebc23-def6-4a78-8ce2-eeacafdf36be tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:00:29.144823 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-2f0ebc23-def6-4a78-8ce2-eeacafdf36be tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:00:29.145555 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-2f0ebc23-def6-4a78-8ce2-eeacafdf36be tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:00:29.150837 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.quota [None req-82a0bf2c-683f-45ed-8cad-212c8f6c4028 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Getting quotas for project 578e6a35974d4e5c8a0cd4e5fa994259. Resources: {'key_pairs'} {{(pid=123459) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 29 09:00:29.155096 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.quota [None req-82a0bf2c-683f-45ed-8cad-212c8f6c4028 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Getting quotas for user 8e47ecdfb01f447699275b13255c15d4 and project 578e6a35974d4e5c8a0cd4e5fa994259. Resources: {'key_pairs'} {{(pid=123459) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 29 09:00:29.173101 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-82a0bf2c-683f-45ed-8cad-212c8f6c4028 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] 10.222.0.31 "POST /compute/v2.1/os-keypairs" status: 200 len: 2304 microversion: 2.1 time: 0.298984 Apr 29 09:00:29.174312 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 479/960] 10.222.0.31 () {60 vars in 1157 bytes} [Fri Apr 29 09:00:28 2022] POST /compute/v2.1/os-keypairs => generated 2304 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 09:00:29.185808 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-2f0ebc23-def6-4a78-8ce2-eeacafdf36be tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:00:29.186265 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-2f0ebc23-def6-4a78-8ce2-eeacafdf36be tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:00:29.186725 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.objects.instance [None req-2f0ebc23-def6-4a78-8ce2-eeacafdf36be tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] Lazy-loading 'fault' on Instance uuid 8d96abf8-36ee-48bc-a692-27682f8c1c2e {{(pid=123458) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 29 09:00:29.245080 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-2f0ebc23-def6-4a78-8ce2-eeacafdf36be tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a82490fb17d42bf8c19f676fb687033', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8dd37ae188e415e86f551e3f760319e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 09:00:29.256653 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-2f0ebc23-def6-4a78-8ce2-eeacafdf36be tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] 10.222.0.31 "GET /compute/v2.1/servers/8d96abf8-36ee-48bc-a692-27682f8c1c2e" status: 200 len: 1230 microversion: 2.1 time: 0.126780 Apr 29 09:00:29.258544 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 482/961] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 09:00:29 2022] GET /compute/v2.1/servers/8d96abf8-36ee-48bc-a692-27682f8c1c2e => generated 1230 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 09:00:30.133755 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-405dcb9b-e2d8-4850-9160-2071b9045830 tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] Calling method '>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 09:00:30.134668 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-405dcb9b-e2d8-4850-9160-2071b9045830 tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] [instance: c3ad1103-185b-4f84-beb9-e1d0e546b2ed] Fetching instance by UUID {{(pid=123459) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 09:00:30.141473 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-405dcb9b-e2d8-4850-9160-2071b9045830 tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:00:30.142031 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-405dcb9b-e2d8-4850-9160-2071b9045830 tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:00:30.142902 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-405dcb9b-e2d8-4850-9160-2071b9045830 tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:00:30.143416 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-405dcb9b-e2d8-4850-9160-2071b9045830 tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:00:30.173953 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-405dcb9b-e2d8-4850-9160-2071b9045830 tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] 10.222.0.31 "GET /compute/v2.1/servers/c3ad1103-185b-4f84-beb9-e1d0e546b2ed/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045303 Apr 29 09:00:30.174514 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 480/962] 10.222.0.31 () {58 vars in 1301 bytes} [Fri Apr 29 09:00:30 2022] GET /compute/v2.1/servers/c3ad1103-185b-4f84-beb9-e1d0e546b2ed/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 29 09:00:30.184982 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-53ca632f-5894-40fc-8f7d-26f5ec272094 tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] Calling method '>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 09:00:30.185508 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-53ca632f-5894-40fc-8f7d-26f5ec272094 tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] [instance: c3ad1103-185b-4f84-beb9-e1d0e546b2ed] Fetching instance by UUID {{(pid=123458) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 09:00:30.191880 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-53ca632f-5894-40fc-8f7d-26f5ec272094 tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:00:30.192254 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-53ca632f-5894-40fc-8f7d-26f5ec272094 tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:00:30.193041 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-53ca632f-5894-40fc-8f7d-26f5ec272094 tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:00:30.193497 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-53ca632f-5894-40fc-8f7d-26f5ec272094 tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:00:30.277071 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-0510715d-3918-4204-a7fa-3b5ef805721c tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] Calling method '>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 09:00:30.277945 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-0510715d-3918-4204-a7fa-3b5ef805721c tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] [instance: 8d96abf8-36ee-48bc-a692-27682f8c1c2e] Fetching instance by UUID {{(pid=123459) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 09:00:30.278781 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.wsgi [None req-53ca632f-5894-40fc-8f7d-26f5ec272094 tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] HTTP exception thrown: Instance c3ad1103-185b-4f84-beb9-e1d0e546b2ed is not attached to volume e76a9153-da86-43ab-83b5-66b453741034 Apr 29 09:00:30.279382 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-53ca632f-5894-40fc-8f7d-26f5ec272094 tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] Returning 404 to user: Instance c3ad1103-185b-4f84-beb9-e1d0e546b2ed is not attached to volume e76a9153-da86-43ab-83b5-66b453741034 {{(pid=123458) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 29 09:00:30.280323 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-53ca632f-5894-40fc-8f7d-26f5ec272094 tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] 10.222.0.31 "DELETE /compute/v2.1/servers/c3ad1103-185b-4f84-beb9-e1d0e546b2ed/os-volume_attachments/e76a9153-da86-43ab-83b5-66b453741034" status: 404 len: 154 microversion: 2.1 time: 0.099302 Apr 29 09:00:30.280884 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 483/963] 10.222.0.31 () {58 vars in 1415 bytes} [Fri Apr 29 09:00:30 2022] DELETE /compute/v2.1/servers/c3ad1103-185b-4f84-beb9-e1d0e546b2ed/os-volume_attachments/e76a9153-da86-43ab-83b5-66b453741034 => generated 154 bytes in 101 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Apr 29 09:00:30.286164 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-0510715d-3918-4204-a7fa-3b5ef805721c tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:00:30.286717 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-0510715d-3918-4204-a7fa-3b5ef805721c tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:00:30.287704 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-0510715d-3918-4204-a7fa-3b5ef805721c tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:00:30.288267 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-0510715d-3918-4204-a7fa-3b5ef805721c tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:00:30.305033 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.wsgi [None req-0510715d-3918-4204-a7fa-3b5ef805721c tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] HTTP exception thrown: Instance 8d96abf8-36ee-48bc-a692-27682f8c1c2e could not be found. Apr 29 09:00:30.306013 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-0510715d-3918-4204-a7fa-3b5ef805721c tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] Returning 404 to user: Instance 8d96abf8-36ee-48bc-a692-27682f8c1c2e could not be found. {{(pid=123459) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 29 09:00:30.307389 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-0510715d-3918-4204-a7fa-3b5ef805721c tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] 10.222.0.31 "GET /compute/v2.1/servers/8d96abf8-36ee-48bc-a692-27682f8c1c2e" status: 404 len: 111 microversion: 2.1 time: 0.035872 Apr 29 09:00:30.308164 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 481/964] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 09:00:30 2022] GET /compute/v2.1/servers/8d96abf8-36ee-48bc-a692-27682f8c1c2e => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 29 09:00:30.416432 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-8633a202-2180-4f53-aba4-aaa7d932c0a0 tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1762121265", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1636555824", "security_groups": [{"name": "tempest-secgroup-smoke-1667238243"}], "block_device_mapping_v2": [{"uuid": "3ee20dee-5eb4-46a4-9534-200a878651d8", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "1a8d7fea-92bf-4f68-8779-641df4ec3db8"}]}} {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 29 09:00:30.536443 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.network.neutron [None req-8633a202-2180-4f53-aba4-aaa7d932c0a0 tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] validate_networks() for [('1a8d7fea-92bf-4f68-8779-641df4ec3db8', None, None, None, None, None)] {{(pid=123458) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 29 09:00:30.718914 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-995685e7-2088-4342-9065-200231e7a693 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-191198161", "imageRef": "e0678f88-0b68-4453-b569-29fd065e544e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "b24838f8-74fc-43df-860b-f0934d3ce2df"}], "security_groups": [{"name": "tempest-securitygroup--1743773331"}], "key_name": "tempest-keypair-900471435", "user_data": "}} {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 29 09:00:30.848098 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.network.neutron [None req-995685e7-2088-4342-9065-200231e7a693 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] validate_networks() for [('b24838f8-74fc-43df-860b-f0934d3ce2df', None, None, None, None, None)] {{(pid=123459) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 29 09:00:30.945296 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.virt.hardware [None req-8633a202-2180-4f53-aba4-aaa7d932c0a0 tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] Flavor limits 0:0:0 {{(pid=123458) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 29 09:00:30.946011 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.virt.hardware [None req-8633a202-2180-4f53-aba4-aaa7d932c0a0 tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] Image limits 0:0:0 {{(pid=123458) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 29 09:00:30.946604 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.virt.hardware [None req-8633a202-2180-4f53-aba4-aaa7d932c0a0 tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] Flavor pref 0:0:0 {{(pid=123458) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 29 09:00:30.947020 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.virt.hardware [None req-8633a202-2180-4f53-aba4-aaa7d932c0a0 tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] Image pref 0:0:0 {{(pid=123458) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 29 09:00:30.947681 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.virt.hardware [None req-8633a202-2180-4f53-aba4-aaa7d932c0a0 tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123458) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 29 09:00:30.957053 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-8633a202-2180-4f53-aba4-aaa7d932c0a0 tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:00:30.957499 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-8633a202-2180-4f53-aba4-aaa7d932c0a0 tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:00:30.958308 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-8633a202-2180-4f53-aba4-aaa7d932c0a0 tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:00:30.958744 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-8633a202-2180-4f53-aba4-aaa7d932c0a0 tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:00:30.977387 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.quota [None req-8633a202-2180-4f53-aba4-aaa7d932c0a0 tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] Getting quotas for project d8dd37ae188e415e86f551e3f760319e. Resources: {'instances', 'cores', 'ram'} {{(pid=123458) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 29 09:00:30.982454 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.quota [None req-8633a202-2180-4f53-aba4-aaa7d932c0a0 tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] Getting quotas for user 3a82490fb17d42bf8c19f676fb687033 and project d8dd37ae188e415e86f551e3f760319e. Resources: {'instances', 'cores', 'ram'} {{(pid=123458) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 29 09:00:31.056989 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-8633a202-2180-4f53-aba4-aaa7d932c0a0 tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] Going to run 1 instances... {{(pid=123458) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 29 09:00:31.059546 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-8633a202-2180-4f53-aba4-aaa7d932c0a0 tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] [instance: 887e5a2b-9898-497b-b429-8f3e0aed0911] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='3ee20dee-5eb4-46a4-9534-200a878651d8',volume_size=None,volume_type=None)] {{(pid=123458) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 29 09:00:31.223878 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-8633a202-2180-4f53-aba4-aaa7d932c0a0 tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] 10.222.0.31 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.811855 Apr 29 09:00:31.228432 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 484/965] 10.222.0.31 () {60 vars in 1146 bytes} [Fri Apr 29 09:00:30 2022] POST /compute/v2.1/servers => generated 406 bytes in 813 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 29 09:00:31.249202 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-07298151-3e39-424b-af38-bb6fb835613e tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] Calling method '>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 09:00:31.249896 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-07298151-3e39-424b-af38-bb6fb835613e tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] [instance: 887e5a2b-9898-497b-b429-8f3e0aed0911] Fetching instance by UUID {{(pid=123458) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 09:00:31.319133 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-07298151-3e39-424b-af38-bb6fb835613e tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a82490fb17d42bf8c19f676fb687033', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8dd37ae188e415e86f551e3f760319e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 09:00:31.326978 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-07298151-3e39-424b-af38-bb6fb835613e tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] 10.222.0.31 "GET /compute/v2.1/servers/887e5a2b-9898-497b-b429-8f3e0aed0911" status: 200 len: 1095 microversion: 2.1 time: 0.091340 Apr 29 09:00:31.327721 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 485/966] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 09:00:31 2022] GET /compute/v2.1/servers/887e5a2b-9898-497b-b429-8f3e0aed0911 => generated 1095 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 09:00:31.429108 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-d79e3f09-7576-46c1-9ab8-f9ddd0b75b8e tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] Calling method '>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 09:00:31.430124 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-d79e3f09-7576-46c1-9ab8-f9ddd0b75b8e tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] [instance: c3ad1103-185b-4f84-beb9-e1d0e546b2ed] Fetching instance by UUID {{(pid=123458) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 09:00:31.437440 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-d79e3f09-7576-46c1-9ab8-f9ddd0b75b8e tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:00:31.438070 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-d79e3f09-7576-46c1-9ab8-f9ddd0b75b8e tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:00:31.440220 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-d79e3f09-7576-46c1-9ab8-f9ddd0b75b8e tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:00:31.440220 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-d79e3f09-7576-46c1-9ab8-f9ddd0b75b8e tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:00:31.502414 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-d79e3f09-7576-46c1-9ab8-f9ddd0b75b8e tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] [instance: c3ad1103-185b-4f84-beb9-e1d0e546b2ed] Going to try to terminate instance {{(pid=123458) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 29 09:00:31.643401 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.virt.hardware [None req-995685e7-2088-4342-9065-200231e7a693 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Flavor limits 0:0:0 {{(pid=123459) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 29 09:00:31.644956 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.virt.hardware [None req-995685e7-2088-4342-9065-200231e7a693 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Image limits 0:0:0 {{(pid=123459) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 29 09:00:31.646416 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.virt.hardware [None req-995685e7-2088-4342-9065-200231e7a693 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Flavor pref 0:0:0 {{(pid=123459) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 29 09:00:31.650110 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.virt.hardware [None req-995685e7-2088-4342-9065-200231e7a693 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Image pref 0:0:0 {{(pid=123459) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 29 09:00:31.650567 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.virt.hardware [None req-995685e7-2088-4342-9065-200231e7a693 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123459) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 29 09:00:31.660707 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-d79e3f09-7576-46c1-9ab8-f9ddd0b75b8e tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] 10.222.0.31 "DELETE /compute/v2.1/servers/c3ad1103-185b-4f84-beb9-e1d0e546b2ed" status: 204 len: 0 microversion: 2.1 time: 0.237216 Apr 29 09:00:31.662013 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 486/967] 10.222.0.31 () {58 vars in 1238 bytes} [Fri Apr 29 09:00:31 2022] DELETE /compute/v2.1/servers/c3ad1103-185b-4f84-beb9-e1d0e546b2ed => generated 0 bytes in 240 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 29 09:00:31.666855 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-995685e7-2088-4342-9065-200231e7a693 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:00:31.667212 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-995685e7-2088-4342-9065-200231e7a693 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:00:31.668507 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-995685e7-2088-4342-9065-200231e7a693 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:00:31.669322 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-995685e7-2088-4342-9065-200231e7a693 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:00:31.674879 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-a0b275a3-5f97-45b5-bb46-c3f86da278c7 tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] Calling method '>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 09:00:31.676396 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-a0b275a3-5f97-45b5-bb46-c3f86da278c7 tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] [instance: c3ad1103-185b-4f84-beb9-e1d0e546b2ed] Fetching instance by UUID {{(pid=123458) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 09:00:31.683138 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-a0b275a3-5f97-45b5-bb46-c3f86da278c7 tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:00:31.684001 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-a0b275a3-5f97-45b5-bb46-c3f86da278c7 tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:00:31.685226 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-a0b275a3-5f97-45b5-bb46-c3f86da278c7 tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:00:31.685937 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-a0b275a3-5f97-45b5-bb46-c3f86da278c7 tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:00:31.690645 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.quota [None req-995685e7-2088-4342-9065-200231e7a693 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Getting quotas for project 578e6a35974d4e5c8a0cd4e5fa994259. Resources: {'instances', 'cores', 'ram'} {{(pid=123459) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 29 09:00:31.696993 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.quota [None req-995685e7-2088-4342-9065-200231e7a693 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Getting quotas for user 8e47ecdfb01f447699275b13255c15d4 and project 578e6a35974d4e5c8a0cd4e5fa994259. Resources: {'instances', 'cores', 'ram'} {{(pid=123459) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 29 09:00:31.713172 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-995685e7-2088-4342-9065-200231e7a693 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Going to run 1 instances... {{(pid=123459) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 29 09:00:31.715551 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-995685e7-2088-4342-9065-200231e7a693 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] [instance: 1fa7d94e-9ddd-4cf7-a7c5-072231c6d0bb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e0678f88-0b68-4453-b569-29fd065e544e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123459) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 29 09:00:31.765981 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-995685e7-2088-4342-9065-200231e7a693 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] 10.222.0.31 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.052196 Apr 29 09:00:31.767395 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 482/968] 10.222.0.31 () {60 vars in 1146 bytes} [Fri Apr 29 09:00:30 2022] POST /compute/v2.1/servers => generated 402 bytes in 1054 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Apr 29 09:00:31.778046 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-fbd2be59-7fff-4361-abf9-a9e3448ccad5 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Calling method '>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 09:00:31.778867 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-fbd2be59-7fff-4361-abf9-a9e3448ccad5 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] [instance: 1fa7d94e-9ddd-4cf7-a7c5-072231c6d0bb] Fetching instance by UUID {{(pid=123459) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 09:00:31.831129 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-a0b275a3-5f97-45b5-bb46-c3f86da278c7 tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5571352a755f45efa76b6720eb81c9c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6abb4912c175406ca0cefd03e327b7f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 09:00:31.842582 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-fbd2be59-7fff-4361-abf9-a9e3448ccad5 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e47ecdfb01f447699275b13255c15d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578e6a35974d4e5c8a0cd4e5fa994259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 09:00:31.844872 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-a0b275a3-5f97-45b5-bb46-c3f86da278c7 tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] 10.222.0.31 "GET /compute/v2.1/servers/c3ad1103-185b-4f84-beb9-e1d0e546b2ed" status: 200 len: 1555 microversion: 2.1 time: 0.171771 Apr 29 09:00:31.845644 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 487/969] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 09:00:31 2022] GET /compute/v2.1/servers/c3ad1103-185b-4f84-beb9-e1d0e546b2ed => generated 1555 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 29 09:00:31.858229 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-fbd2be59-7fff-4361-abf9-a9e3448ccad5 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] 10.222.0.31 "GET /compute/v2.1/servers/1fa7d94e-9ddd-4cf7-a7c5-072231c6d0bb" status: 200 len: 1240 microversion: 2.1 time: 0.085342 Apr 29 09:00:31.858800 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 483/970] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 09:00:31 2022] GET /compute/v2.1/servers/1fa7d94e-9ddd-4cf7-a7c5-072231c6d0bb => generated 1240 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 29 09:00:32.346913 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-7e0169c5-fa2a-40d7-aa38-cefdbf809e59 tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] Calling method '>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 09:00:32.347523 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-7e0169c5-fa2a-40d7-aa38-cefdbf809e59 tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] [instance: 887e5a2b-9898-497b-b429-8f3e0aed0911] Fetching instance by UUID {{(pid=123458) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 09:00:32.354135 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-7e0169c5-fa2a-40d7-aa38-cefdbf809e59 tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:00:32.354585 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-7e0169c5-fa2a-40d7-aa38-cefdbf809e59 tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:00:32.355357 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-7e0169c5-fa2a-40d7-aa38-cefdbf809e59 tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:00:32.355794 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-7e0169c5-fa2a-40d7-aa38-cefdbf809e59 tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:00:32.419597 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-7e0169c5-fa2a-40d7-aa38-cefdbf809e59 tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a82490fb17d42bf8c19f676fb687033', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8dd37ae188e415e86f551e3f760319e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 09:00:32.426941 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-7e0169c5-fa2a-40d7-aa38-cefdbf809e59 tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] 10.222.0.31 "GET /compute/v2.1/servers/887e5a2b-9898-497b-b429-8f3e0aed0911" status: 200 len: 1145 microversion: 2.1 time: 0.083910 Apr 29 09:00:32.427674 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 488/971] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 09:00:32 2022] GET /compute/v2.1/servers/887e5a2b-9898-497b-b429-8f3e0aed0911 => generated 1145 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 09:00:32.862458 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-2f247c75-ad79-4bb0-810d-0ee77115811f tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] Calling method '>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 09:00:32.862986 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-2f247c75-ad79-4bb0-810d-0ee77115811f tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] [instance: c3ad1103-185b-4f84-beb9-e1d0e546b2ed] Fetching instance by UUID {{(pid=123459) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 09:00:32.870235 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-2f247c75-ad79-4bb0-810d-0ee77115811f tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:00:32.870803 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-2f247c75-ad79-4bb0-810d-0ee77115811f tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:00:32.872329 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-2f247c75-ad79-4bb0-810d-0ee77115811f tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:00:32.872329 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-2f247c75-ad79-4bb0-810d-0ee77115811f tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:00:32.875416 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-b458ec98-f8b3-4ad2-b364-e26eeb8dbbe0 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Calling method '>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 09:00:32.876028 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-b458ec98-f8b3-4ad2-b364-e26eeb8dbbe0 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] [instance: 1fa7d94e-9ddd-4cf7-a7c5-072231c6d0bb] Fetching instance by UUID {{(pid=123458) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 09:00:32.883376 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-b458ec98-f8b3-4ad2-b364-e26eeb8dbbe0 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:00:32.883839 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-b458ec98-f8b3-4ad2-b364-e26eeb8dbbe0 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:00:32.884672 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-b458ec98-f8b3-4ad2-b364-e26eeb8dbbe0 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:00:32.885247 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-b458ec98-f8b3-4ad2-b364-e26eeb8dbbe0 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:00:32.953916 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-b458ec98-f8b3-4ad2-b364-e26eeb8dbbe0 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e47ecdfb01f447699275b13255c15d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578e6a35974d4e5c8a0cd4e5fa994259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 09:00:32.964445 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-b458ec98-f8b3-4ad2-b364-e26eeb8dbbe0 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] 10.222.0.31 "GET /compute/v2.1/servers/1fa7d94e-9ddd-4cf7-a7c5-072231c6d0bb" status: 200 len: 1244 microversion: 2.1 time: 0.093221 Apr 29 09:00:32.972283 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 489/972] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 09:00:32 2022] GET /compute/v2.1/servers/1fa7d94e-9ddd-4cf7-a7c5-072231c6d0bb => generated 1244 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 29 09:00:33.017075 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-2f247c75-ad79-4bb0-810d-0ee77115811f tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5571352a755f45efa76b6720eb81c9c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6abb4912c175406ca0cefd03e327b7f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 09:00:33.025432 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-2f247c75-ad79-4bb0-810d-0ee77115811f tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] 10.222.0.31 "GET /compute/v2.1/servers/c3ad1103-185b-4f84-beb9-e1d0e546b2ed" status: 200 len: 1555 microversion: 2.1 time: 0.166860 Apr 29 09:00:33.026006 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 484/973] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 09:00:32 2022] GET /compute/v2.1/servers/c3ad1103-185b-4f84-beb9-e1d0e546b2ed => generated 1555 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 09:00:33.445237 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-3708b818-13d0-43e0-8195-9fbdd221eb4e tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] Calling method '>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 09:00:33.446024 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-3708b818-13d0-43e0-8195-9fbdd221eb4e tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] [instance: 887e5a2b-9898-497b-b429-8f3e0aed0911] Fetching instance by UUID {{(pid=123458) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 09:00:33.452427 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-3708b818-13d0-43e0-8195-9fbdd221eb4e tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:00:33.452877 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-3708b818-13d0-43e0-8195-9fbdd221eb4e tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:00:33.453661 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-3708b818-13d0-43e0-8195-9fbdd221eb4e tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:00:33.454081 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-3708b818-13d0-43e0-8195-9fbdd221eb4e tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:00:33.514938 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-3708b818-13d0-43e0-8195-9fbdd221eb4e tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a82490fb17d42bf8c19f676fb687033', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8dd37ae188e415e86f551e3f760319e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 09:00:33.522266 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-3708b818-13d0-43e0-8195-9fbdd221eb4e tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] 10.222.0.31 "GET /compute/v2.1/servers/887e5a2b-9898-497b-b429-8f3e0aed0911" status: 200 len: 1145 microversion: 2.1 time: 0.081392 Apr 29 09:00:33.522837 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 490/974] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 09:00:33 2022] GET /compute/v2.1/servers/887e5a2b-9898-497b-b429-8f3e0aed0911 => generated 1145 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 09:00:33.984911 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-3437c33a-3943-4465-a6c5-dd598c0fc3be tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Calling method '>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 09:00:33.985524 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-3437c33a-3943-4465-a6c5-dd598c0fc3be tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] [instance: 1fa7d94e-9ddd-4cf7-a7c5-072231c6d0bb] Fetching instance by UUID {{(pid=123459) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 09:00:33.992751 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-3437c33a-3943-4465-a6c5-dd598c0fc3be tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:00:33.993127 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-3437c33a-3943-4465-a6c5-dd598c0fc3be tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:00:33.993911 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-3437c33a-3943-4465-a6c5-dd598c0fc3be tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:00:33.994356 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-3437c33a-3943-4465-a6c5-dd598c0fc3be tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:00:34.042840 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-dfd4eb51-c0dd-4e19-af7e-de3f230fea0f tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] Calling method '>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 09:00:34.043431 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-dfd4eb51-c0dd-4e19-af7e-de3f230fea0f tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] [instance: c3ad1103-185b-4f84-beb9-e1d0e546b2ed] Fetching instance by UUID {{(pid=123458) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 09:00:34.050207 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-dfd4eb51-c0dd-4e19-af7e-de3f230fea0f tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:00:34.050648 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-dfd4eb51-c0dd-4e19-af7e-de3f230fea0f tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:00:34.051414 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-dfd4eb51-c0dd-4e19-af7e-de3f230fea0f tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:00:34.051844 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-dfd4eb51-c0dd-4e19-af7e-de3f230fea0f tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:00:34.056950 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-3437c33a-3943-4465-a6c5-dd598c0fc3be tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e47ecdfb01f447699275b13255c15d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578e6a35974d4e5c8a0cd4e5fa994259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 09:00:34.064415 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-3437c33a-3943-4465-a6c5-dd598c0fc3be tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] 10.222.0.31 "GET /compute/v2.1/servers/1fa7d94e-9ddd-4cf7-a7c5-072231c6d0bb" status: 200 len: 1244 microversion: 2.1 time: 0.083266 Apr 29 09:00:34.064983 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 485/975] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 09:00:33 2022] GET /compute/v2.1/servers/1fa7d94e-9ddd-4cf7-a7c5-072231c6d0bb => generated 1244 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 09:00:34.180108 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-dfd4eb51-c0dd-4e19-af7e-de3f230fea0f tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5571352a755f45efa76b6720eb81c9c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6abb4912c175406ca0cefd03e327b7f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 09:00:34.187622 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-dfd4eb51-c0dd-4e19-af7e-de3f230fea0f tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] 10.222.0.31 "GET /compute/v2.1/servers/c3ad1103-185b-4f84-beb9-e1d0e546b2ed" status: 200 len: 1555 microversion: 2.1 time: 0.149453 Apr 29 09:00:34.188140 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 491/976] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 09:00:34 2022] GET /compute/v2.1/servers/c3ad1103-185b-4f84-beb9-e1d0e546b2ed => generated 1555 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 29 09:00:34.540563 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-5d063667-7e98-414d-812a-1c152df1a0b2 tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] Calling method '>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 09:00:34.541185 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-5d063667-7e98-414d-812a-1c152df1a0b2 tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] [instance: 887e5a2b-9898-497b-b429-8f3e0aed0911] Fetching instance by UUID {{(pid=123459) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 09:00:34.547390 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-5d063667-7e98-414d-812a-1c152df1a0b2 tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:00:34.547840 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-5d063667-7e98-414d-812a-1c152df1a0b2 tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:00:34.548661 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-5d063667-7e98-414d-812a-1c152df1a0b2 tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:00:34.549105 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-5d063667-7e98-414d-812a-1c152df1a0b2 tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:00:34.611982 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-5d063667-7e98-414d-812a-1c152df1a0b2 tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a82490fb17d42bf8c19f676fb687033', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8dd37ae188e415e86f551e3f760319e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 09:00:34.619817 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-5d063667-7e98-414d-812a-1c152df1a0b2 tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] 10.222.0.31 "GET /compute/v2.1/servers/887e5a2b-9898-497b-b429-8f3e0aed0911" status: 200 len: 1145 microversion: 2.1 time: 0.083885 Apr 29 09:00:34.620419 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 486/977] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 09:00:34 2022] GET /compute/v2.1/servers/887e5a2b-9898-497b-b429-8f3e0aed0911 => generated 1145 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 09:00:35.080503 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-03afd60d-2b01-403e-98e8-ba4c7b443fbb tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Calling method '>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 09:00:35.081118 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-03afd60d-2b01-403e-98e8-ba4c7b443fbb tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] [instance: 1fa7d94e-9ddd-4cf7-a7c5-072231c6d0bb] Fetching instance by UUID {{(pid=123458) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 09:00:35.087800 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-03afd60d-2b01-403e-98e8-ba4c7b443fbb tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:00:35.088277 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-03afd60d-2b01-403e-98e8-ba4c7b443fbb tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:00:35.089063 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-03afd60d-2b01-403e-98e8-ba4c7b443fbb tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:00:35.089502 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-03afd60d-2b01-403e-98e8-ba4c7b443fbb tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:00:35.152355 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-03afd60d-2b01-403e-98e8-ba4c7b443fbb tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e47ecdfb01f447699275b13255c15d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578e6a35974d4e5c8a0cd4e5fa994259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 09:00:35.159733 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-03afd60d-2b01-403e-98e8-ba4c7b443fbb tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] 10.222.0.31 "GET /compute/v2.1/servers/1fa7d94e-9ddd-4cf7-a7c5-072231c6d0bb" status: 200 len: 1244 microversion: 2.1 time: 0.083084 Apr 29 09:00:35.160324 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 492/978] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 09:00:35 2022] GET /compute/v2.1/servers/1fa7d94e-9ddd-4cf7-a7c5-072231c6d0bb => generated 1244 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 29 09:00:35.204251 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-30e0661f-bb24-462d-a7af-51f356e79c89 tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] Calling method '>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 09:00:35.204857 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-30e0661f-bb24-462d-a7af-51f356e79c89 tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] [instance: c3ad1103-185b-4f84-beb9-e1d0e546b2ed] Fetching instance by UUID {{(pid=123459) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 09:00:35.211118 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-30e0661f-bb24-462d-a7af-51f356e79c89 tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:00:35.211576 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-30e0661f-bb24-462d-a7af-51f356e79c89 tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:00:35.212366 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-30e0661f-bb24-462d-a7af-51f356e79c89 tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:00:35.212801 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-30e0661f-bb24-462d-a7af-51f356e79c89 tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:00:35.343495 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-30e0661f-bb24-462d-a7af-51f356e79c89 tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5571352a755f45efa76b6720eb81c9c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6abb4912c175406ca0cefd03e327b7f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 09:00:35.350799 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-30e0661f-bb24-462d-a7af-51f356e79c89 tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] 10.222.0.31 "GET /compute/v2.1/servers/c3ad1103-185b-4f84-beb9-e1d0e546b2ed" status: 200 len: 1555 microversion: 2.1 time: 0.150422 Apr 29 09:00:35.351356 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 487/979] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 09:00:35 2022] GET /compute/v2.1/servers/c3ad1103-185b-4f84-beb9-e1d0e546b2ed => generated 1555 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 09:00:35.642030 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-11e5f1fc-3b4b-464f-acea-fbf85f2fa07a tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] Calling method '>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 09:00:35.643038 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-11e5f1fc-3b4b-464f-acea-fbf85f2fa07a tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] [instance: 887e5a2b-9898-497b-b429-8f3e0aed0911] Fetching instance by UUID {{(pid=123458) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 09:00:35.654141 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-11e5f1fc-3b4b-464f-acea-fbf85f2fa07a tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:00:35.654938 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-11e5f1fc-3b4b-464f-acea-fbf85f2fa07a tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:00:35.656547 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-11e5f1fc-3b4b-464f-acea-fbf85f2fa07a tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:00:35.657351 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-11e5f1fc-3b4b-464f-acea-fbf85f2fa07a tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:00:35.906360 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-11e5f1fc-3b4b-464f-acea-fbf85f2fa07a tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a82490fb17d42bf8c19f676fb687033', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8dd37ae188e415e86f551e3f760319e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 09:00:35.914165 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-11e5f1fc-3b4b-464f-acea-fbf85f2fa07a tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] 10.222.0.31 "GET /compute/v2.1/servers/887e5a2b-9898-497b-b429-8f3e0aed0911" status: 200 len: 1137 microversion: 2.1 time: 0.280767 Apr 29 09:00:35.914840 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 493/980] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 09:00:35 2022] GET /compute/v2.1/servers/887e5a2b-9898-497b-b429-8f3e0aed0911 => generated 1137 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 29 09:00:36.177954 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-82a7b3ed-254d-479a-8f21-fc2ea37bb73a tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Calling method '>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 09:00:36.178485 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-82a7b3ed-254d-479a-8f21-fc2ea37bb73a tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] [instance: 1fa7d94e-9ddd-4cf7-a7c5-072231c6d0bb] Fetching instance by UUID {{(pid=123459) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 09:00:36.184942 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-82a7b3ed-254d-479a-8f21-fc2ea37bb73a tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:00:36.185392 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-82a7b3ed-254d-479a-8f21-fc2ea37bb73a tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:00:36.186182 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-82a7b3ed-254d-479a-8f21-fc2ea37bb73a tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:00:36.186620 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-82a7b3ed-254d-479a-8f21-fc2ea37bb73a tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:00:36.251319 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-82a7b3ed-254d-479a-8f21-fc2ea37bb73a tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e47ecdfb01f447699275b13255c15d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578e6a35974d4e5c8a0cd4e5fa994259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 09:00:36.259496 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-82a7b3ed-254d-479a-8f21-fc2ea37bb73a tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] 10.222.0.31 "GET /compute/v2.1/servers/1fa7d94e-9ddd-4cf7-a7c5-072231c6d0bb" status: 200 len: 1292 microversion: 2.1 time: 0.085589 Apr 29 09:00:36.260296 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 488/981] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 09:00:36 2022] GET /compute/v2.1/servers/1fa7d94e-9ddd-4cf7-a7c5-072231c6d0bb => generated 1292 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 09:00:36.367289 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-c8a1298b-b2fe-4452-8666-ef2fe6939542 tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] Calling method '>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 09:00:36.367915 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-c8a1298b-b2fe-4452-8666-ef2fe6939542 tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] [instance: c3ad1103-185b-4f84-beb9-e1d0e546b2ed] Fetching instance by UUID {{(pid=123458) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 09:00:36.376719 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-c8a1298b-b2fe-4452-8666-ef2fe6939542 tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:00:36.377228 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-c8a1298b-b2fe-4452-8666-ef2fe6939542 tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:00:36.378070 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-c8a1298b-b2fe-4452-8666-ef2fe6939542 tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:00:36.378578 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-c8a1298b-b2fe-4452-8666-ef2fe6939542 tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:00:36.533225 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-c8a1298b-b2fe-4452-8666-ef2fe6939542 tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5571352a755f45efa76b6720eb81c9c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6abb4912c175406ca0cefd03e327b7f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 09:00:36.541150 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-c8a1298b-b2fe-4452-8666-ef2fe6939542 tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] 10.222.0.31 "GET /compute/v2.1/servers/c3ad1103-185b-4f84-beb9-e1d0e546b2ed" status: 200 len: 1555 microversion: 2.1 time: 0.177936 Apr 29 09:00:36.541854 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 494/982] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 09:00:36 2022] GET /compute/v2.1/servers/c3ad1103-185b-4f84-beb9-e1d0e546b2ed => generated 1555 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 09:00:36.939886 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-bd8e38f1-f612-4c59-8d7f-14b9865a91ae tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] Calling method '>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 09:00:36.940566 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-bd8e38f1-f612-4c59-8d7f-14b9865a91ae tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] [instance: 887e5a2b-9898-497b-b429-8f3e0aed0911] Fetching instance by UUID {{(pid=123459) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 09:00:36.958020 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-bd8e38f1-f612-4c59-8d7f-14b9865a91ae tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:00:36.958646 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-bd8e38f1-f612-4c59-8d7f-14b9865a91ae tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:00:36.959577 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-bd8e38f1-f612-4c59-8d7f-14b9865a91ae tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:00:36.959841 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-bd8e38f1-f612-4c59-8d7f-14b9865a91ae tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:00:37.072834 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-bd8e38f1-f612-4c59-8d7f-14b9865a91ae tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a82490fb17d42bf8c19f676fb687033', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8dd37ae188e415e86f551e3f760319e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 09:00:37.081868 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-bd8e38f1-f612-4c59-8d7f-14b9865a91ae tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] 10.222.0.31 "GET /compute/v2.1/servers/887e5a2b-9898-497b-b429-8f3e0aed0911" status: 200 len: 1201 microversion: 2.1 time: 0.152159 Apr 29 09:00:37.082440 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 489/983] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 09:00:36 2022] GET /compute/v2.1/servers/887e5a2b-9898-497b-b429-8f3e0aed0911 => generated 1201 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 09:00:37.278930 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-6b43df40-4ce3-4491-934e-e82f231dd129 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Calling method '>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 09:00:37.279558 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-6b43df40-4ce3-4491-934e-e82f231dd129 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] [instance: 1fa7d94e-9ddd-4cf7-a7c5-072231c6d0bb] Fetching instance by UUID {{(pid=123458) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 09:00:37.286319 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-6b43df40-4ce3-4491-934e-e82f231dd129 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:00:37.294580 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-6b43df40-4ce3-4491-934e-e82f231dd129 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:00:37.295614 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-6b43df40-4ce3-4491-934e-e82f231dd129 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:00:37.296587 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-6b43df40-4ce3-4491-934e-e82f231dd129 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:00:37.389619 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-6b43df40-4ce3-4491-934e-e82f231dd129 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e47ecdfb01f447699275b13255c15d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578e6a35974d4e5c8a0cd4e5fa994259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 09:00:37.397489 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-6b43df40-4ce3-4491-934e-e82f231dd129 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] 10.222.0.31 "GET /compute/v2.1/servers/1fa7d94e-9ddd-4cf7-a7c5-072231c6d0bb" status: 200 len: 1298 microversion: 2.1 time: 0.123567 Apr 29 09:00:37.398166 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 495/984] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 09:00:37 2022] GET /compute/v2.1/servers/1fa7d94e-9ddd-4cf7-a7c5-072231c6d0bb => generated 1298 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 09:00:37.561191 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-69bfaf1f-7922-4eb6-874d-fb95fb37e31b tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] Calling method '>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 09:00:37.562739 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-69bfaf1f-7922-4eb6-874d-fb95fb37e31b tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] [instance: c3ad1103-185b-4f84-beb9-e1d0e546b2ed] Fetching instance by UUID {{(pid=123459) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 09:00:37.569856 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-69bfaf1f-7922-4eb6-874d-fb95fb37e31b tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:00:37.570302 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-69bfaf1f-7922-4eb6-874d-fb95fb37e31b tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:00:37.572043 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-69bfaf1f-7922-4eb6-874d-fb95fb37e31b tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:00:37.572390 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-69bfaf1f-7922-4eb6-874d-fb95fb37e31b tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:00:37.777245 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-69bfaf1f-7922-4eb6-874d-fb95fb37e31b tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5571352a755f45efa76b6720eb81c9c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6abb4912c175406ca0cefd03e327b7f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 09:00:37.787885 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-69bfaf1f-7922-4eb6-874d-fb95fb37e31b tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] 10.222.0.31 "GET /compute/v2.1/servers/c3ad1103-185b-4f84-beb9-e1d0e546b2ed" status: 200 len: 1555 microversion: 2.1 time: 0.232162 Apr 29 09:00:37.789526 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 490/985] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 09:00:37 2022] GET /compute/v2.1/servers/c3ad1103-185b-4f84-beb9-e1d0e546b2ed => generated 1555 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 09:00:38.002860 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [req-b08bfc50-276f-4876-b405-008b8c07ff04 req-e77a7548-fc3c-4b58-b066-93c6ff7d3a3d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c3ad1103-185b-4f84-beb9-e1d0e546b2ed", "name": "network-vif-deleted", "tag": "69230ee3-728d-4825-9b39-4cb903b621cf"}]} {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 29 09:00:38.017609 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [req-b08bfc50-276f-4876-b405-008b8c07ff04 req-e77a7548-fc3c-4b58-b066-93c6ff7d3a3d service nova] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:00:38.018197 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [req-b08bfc50-276f-4876-b405-008b8c07ff04 req-e77a7548-fc3c-4b58-b066-93c6ff7d3a3d service nova] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:00:38.032640 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.compute.server_external_events [req-b08bfc50-276f-4876-b405-008b8c07ff04 req-e77a7548-fc3c-4b58-b066-93c6ff7d3a3d service nova] Creating event network-vif-deleted:69230ee3-728d-4825-9b39-4cb903b621cf for instance c3ad1103-185b-4f84-beb9-e1d0e546b2ed on hv-cinder-83987 Apr 29 09:00:38.039331 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [req-b08bfc50-276f-4876-b405-008b8c07ff04 req-e77a7548-fc3c-4b58-b066-93c6ff7d3a3d service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040232 Apr 29 09:00:38.040705 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 496/986] 10.222.0.31 () {64 vars in 1317 bytes} [Fri Apr 29 09:00:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 29 09:00:38.100544 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-8d578acf-af04-4148-a065-ca126f60638f tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] Calling method '>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 09:00:38.101305 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-8d578acf-af04-4148-a065-ca126f60638f tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] [instance: 887e5a2b-9898-497b-b429-8f3e0aed0911] Fetching instance by UUID {{(pid=123459) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 09:00:38.118205 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-8d578acf-af04-4148-a065-ca126f60638f tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:00:38.118743 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-8d578acf-af04-4148-a065-ca126f60638f tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:00:38.119606 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-8d578acf-af04-4148-a065-ca126f60638f tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:00:38.120429 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-8d578acf-af04-4148-a065-ca126f60638f tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:00:38.244494 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-57513691-0df6-4ed8-8272-50a42e8c80f0 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Calling method '>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 09:00:38.247607 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-57513691-0df6-4ed8-8272-50a42e8c80f0 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] [instance: e74dc909-2e3d-4acb-a05a-ed18d4c0f699] Fetching instance by UUID {{(pid=123458) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 09:00:38.267049 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-57513691-0df6-4ed8-8272-50a42e8c80f0 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:00:38.267631 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-57513691-0df6-4ed8-8272-50a42e8c80f0 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:00:38.269847 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-57513691-0df6-4ed8-8272-50a42e8c80f0 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:00:38.271697 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-57513691-0df6-4ed8-8272-50a42e8c80f0 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:00:38.338728 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-57513691-0df6-4ed8-8272-50a42e8c80f0 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] 10.222.0.31 "GET /compute/v2.1/servers/e74dc909-2e3d-4acb-a05a-ed18d4c0f699/ips" status: 200 len: 152 microversion: 2.20 time: 0.109724 Apr 29 09:00:38.344218 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 497/987] 10.222.0.31 () {60 vars in 1288 bytes} [Fri Apr 29 09:00:38 2022] GET /compute/v2.1/servers/e74dc909-2e3d-4acb-a05a-ed18d4c0f699/ips => generated 152 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Apr 29 09:00:38.415704 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-cd9fd23c-1f8c-4154-9a25-1d1dabf62984 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Calling method '>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 09:00:38.416966 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-cd9fd23c-1f8c-4154-9a25-1d1dabf62984 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] [instance: 1fa7d94e-9ddd-4cf7-a7c5-072231c6d0bb] Fetching instance by UUID {{(pid=123458) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 09:00:38.425188 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-8d578acf-af04-4148-a065-ca126f60638f tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a82490fb17d42bf8c19f676fb687033', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8dd37ae188e415e86f551e3f760319e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 09:00:38.429814 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-cd9fd23c-1f8c-4154-9a25-1d1dabf62984 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:00:38.431017 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-cd9fd23c-1f8c-4154-9a25-1d1dabf62984 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:00:38.431758 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-cd9fd23c-1f8c-4154-9a25-1d1dabf62984 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:00:38.432231 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-cd9fd23c-1f8c-4154-9a25-1d1dabf62984 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:00:38.435054 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-8d578acf-af04-4148-a065-ca126f60638f tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] 10.222.0.31 "GET /compute/v2.1/servers/887e5a2b-9898-497b-b429-8f3e0aed0911" status: 200 len: 1279 microversion: 2.1 time: 0.338333 Apr 29 09:00:38.437356 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 491/988] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 09:00:38 2022] GET /compute/v2.1/servers/887e5a2b-9898-497b-b429-8f3e0aed0911 => generated 1279 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 09:00:38.731088 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-cd9fd23c-1f8c-4154-9a25-1d1dabf62984 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e47ecdfb01f447699275b13255c15d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578e6a35974d4e5c8a0cd4e5fa994259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 09:00:38.752630 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-cd9fd23c-1f8c-4154-9a25-1d1dabf62984 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] 10.222.0.31 "GET /compute/v2.1/servers/1fa7d94e-9ddd-4cf7-a7c5-072231c6d0bb" status: 200 len: 1366 microversion: 2.1 time: 0.341532 Apr 29 09:00:38.756206 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 498/989] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 09:00:38 2022] GET /compute/v2.1/servers/1fa7d94e-9ddd-4cf7-a7c5-072231c6d0bb => generated 1366 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 29 09:00:38.809479 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-6c6517de-60f2-4c9a-8e05-f0a877107de2 tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] Calling method '>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 09:00:38.810097 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-6c6517de-60f2-4c9a-8e05-f0a877107de2 tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] [instance: c3ad1103-185b-4f84-beb9-e1d0e546b2ed] Fetching instance by UUID {{(pid=123459) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 09:00:38.829811 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-6c6517de-60f2-4c9a-8e05-f0a877107de2 tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:00:38.830504 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-6c6517de-60f2-4c9a-8e05-f0a877107de2 tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:00:38.844590 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-6c6517de-60f2-4c9a-8e05-f0a877107de2 tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:00:38.845460 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-6c6517de-60f2-4c9a-8e05-f0a877107de2 tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:00:38.937454 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-6c6517de-60f2-4c9a-8e05-f0a877107de2 tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:00:38.937454 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-6c6517de-60f2-4c9a-8e05-f0a877107de2 tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:00:38.938221 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.objects.instance [None req-6c6517de-60f2-4c9a-8e05-f0a877107de2 tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] Lazy-loading 'fault' on Instance uuid c3ad1103-185b-4f84-beb9-e1d0e546b2ed {{(pid=123459) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 29 09:00:39.061548 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-6c6517de-60f2-4c9a-8e05-f0a877107de2 tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5571352a755f45efa76b6720eb81c9c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6abb4912c175406ca0cefd03e327b7f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 09:00:39.076841 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-6c6517de-60f2-4c9a-8e05-f0a877107de2 tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] 10.222.0.31 "GET /compute/v2.1/servers/c3ad1103-185b-4f84-beb9-e1d0e546b2ed" status: 200 len: 1348 microversion: 2.1 time: 0.273590 Apr 29 09:00:39.077615 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 492/990] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 09:00:38 2022] GET /compute/v2.1/servers/c3ad1103-185b-4f84-beb9-e1d0e546b2ed => generated 1348 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 09:00:39.250282 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [req-8467ae9f-a525-4b2f-8a70-52b02a7925ff req-74cd8267-1998-4216-80b4-b102cb311396 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "887e5a2b-9898-497b-b429-8f3e0aed0911", "tag": "1200c404-ce4f-4d5e-8e49-4db86d488ad8"}]} {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 29 09:00:39.266681 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [req-8467ae9f-a525-4b2f-8a70-52b02a7925ff req-74cd8267-1998-4216-80b4-b102cb311396 service nova] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:00:39.267418 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [req-8467ae9f-a525-4b2f-8a70-52b02a7925ff req-74cd8267-1998-4216-80b4-b102cb311396 service nova] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:00:39.301612 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.compute.server_external_events [req-8467ae9f-a525-4b2f-8a70-52b02a7925ff req-74cd8267-1998-4216-80b4-b102cb311396 service nova] Creating event network-changed:1200c404-ce4f-4d5e-8e49-4db86d488ad8 for instance 887e5a2b-9898-497b-b429-8f3e0aed0911 on hv-cinder-83987 Apr 29 09:00:39.309897 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [req-8467ae9f-a525-4b2f-8a70-52b02a7925ff req-74cd8267-1998-4216-80b4-b102cb311396 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063162 Apr 29 09:00:39.311492 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 499/991] 10.222.0.31 () {64 vars in 1317 bytes} [Fri Apr 29 09:00:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 29 09:00:39.453696 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-6e25a940-9922-436c-9c3b-ff2006416d51 tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] Calling method '>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 09:00:39.454565 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-6e25a940-9922-436c-9c3b-ff2006416d51 tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] [instance: 887e5a2b-9898-497b-b429-8f3e0aed0911] Fetching instance by UUID {{(pid=123459) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 09:00:39.463424 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-6e25a940-9922-436c-9c3b-ff2006416d51 tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:00:39.464472 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-6e25a940-9922-436c-9c3b-ff2006416d51 tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:00:39.465507 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-6e25a940-9922-436c-9c3b-ff2006416d51 tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:00:39.466019 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-6e25a940-9922-436c-9c3b-ff2006416d51 tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:00:39.742339 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-6e25a940-9922-436c-9c3b-ff2006416d51 tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a82490fb17d42bf8c19f676fb687033', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8dd37ae188e415e86f551e3f760319e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 09:00:39.752835 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-6e25a940-9922-436c-9c3b-ff2006416d51 tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] 10.222.0.31 "GET /compute/v2.1/servers/887e5a2b-9898-497b-b429-8f3e0aed0911" status: 200 len: 1267 microversion: 2.1 time: 0.303368 Apr 29 09:00:39.766063 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 493/992] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 09:00:39 2022] GET /compute/v2.1/servers/887e5a2b-9898-497b-b429-8f3e0aed0911 => generated 1267 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 09:00:39.775199 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-50da22bd-1848-4c9d-b064-0c4022d3660a tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Calling method '>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 09:00:39.776607 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-50da22bd-1848-4c9d-b064-0c4022d3660a tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] [instance: 1fa7d94e-9ddd-4cf7-a7c5-072231c6d0bb] Fetching instance by UUID {{(pid=123458) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 09:00:39.784631 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-50da22bd-1848-4c9d-b064-0c4022d3660a tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:00:39.785166 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-50da22bd-1848-4c9d-b064-0c4022d3660a tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:00:39.785992 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-50da22bd-1848-4c9d-b064-0c4022d3660a tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:00:39.786390 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-50da22bd-1848-4c9d-b064-0c4022d3660a tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:00:40.008087 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-50da22bd-1848-4c9d-b064-0c4022d3660a tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e47ecdfb01f447699275b13255c15d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578e6a35974d4e5c8a0cd4e5fa994259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 09:00:40.016844 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-50da22bd-1848-4c9d-b064-0c4022d3660a tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] 10.222.0.31 "GET /compute/v2.1/servers/1fa7d94e-9ddd-4cf7-a7c5-072231c6d0bb" status: 200 len: 1366 microversion: 2.1 time: 0.246809 Apr 29 09:00:40.017457 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 500/993] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 09:00:39 2022] GET /compute/v2.1/servers/1fa7d94e-9ddd-4cf7-a7c5-072231c6d0bb => generated 1366 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 09:00:40.060555 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [req-64990f0d-edb5-4ed1-8bae-6c61c17c5d57 req-f6dd9dd7-9ec6-439b-9867-f61a8979afca service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1fa7d94e-9ddd-4cf7-a7c5-072231c6d0bb", "tag": "6c3b1255-2e99-4681-a117-5f4062b2074f"}]} {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 29 09:00:40.073196 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [req-64990f0d-edb5-4ed1-8bae-6c61c17c5d57 req-f6dd9dd7-9ec6-439b-9867-f61a8979afca service nova] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:00:40.073647 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [req-64990f0d-edb5-4ed1-8bae-6c61c17c5d57 req-f6dd9dd7-9ec6-439b-9867-f61a8979afca service nova] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:00:40.086074 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.compute.server_external_events [req-64990f0d-edb5-4ed1-8bae-6c61c17c5d57 req-f6dd9dd7-9ec6-439b-9867-f61a8979afca service nova] Creating event network-changed:6c3b1255-2e99-4681-a117-5f4062b2074f for instance 1fa7d94e-9ddd-4cf7-a7c5-072231c6d0bb on hv-cinder-83987 Apr 29 09:00:40.099929 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-e7954d32-64db-4e04-a66d-398be28a55b6 tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] Calling method '>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 09:00:40.100152 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [req-64990f0d-edb5-4ed1-8bae-6c61c17c5d57 req-f6dd9dd7-9ec6-439b-9867-f61a8979afca service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044801 Apr 29 09:00:40.100791 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 494/994] 10.222.0.31 () {64 vars in 1317 bytes} [Fri Apr 29 09:00:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 29 09:00:40.101190 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-e7954d32-64db-4e04-a66d-398be28a55b6 tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] [instance: c3ad1103-185b-4f84-beb9-e1d0e546b2ed] Fetching instance by UUID {{(pid=123458) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 09:00:40.108298 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-e7954d32-64db-4e04-a66d-398be28a55b6 tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:00:40.108754 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-e7954d32-64db-4e04-a66d-398be28a55b6 tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:00:40.109549 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-e7954d32-64db-4e04-a66d-398be28a55b6 tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:00:40.109997 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-e7954d32-64db-4e04-a66d-398be28a55b6 tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:00:40.127032 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.wsgi [None req-e7954d32-64db-4e04-a66d-398be28a55b6 tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] HTTP exception thrown: Instance c3ad1103-185b-4f84-beb9-e1d0e546b2ed could not be found. Apr 29 09:00:40.127688 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-e7954d32-64db-4e04-a66d-398be28a55b6 tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] Returning 404 to user: Instance c3ad1103-185b-4f84-beb9-e1d0e546b2ed could not be found. {{(pid=123458) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 29 09:00:40.129018 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-e7954d32-64db-4e04-a66d-398be28a55b6 tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] 10.222.0.31 "GET /compute/v2.1/servers/c3ad1103-185b-4f84-beb9-e1d0e546b2ed" status: 404 len: 111 microversion: 2.1 time: 0.033031 Apr 29 09:00:40.129716 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 501/995] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 09:00:40 2022] GET /compute/v2.1/servers/c3ad1103-185b-4f84-beb9-e1d0e546b2ed => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 29 09:00:40.139914 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-b0bab41c-998d-4d66-bf90-16ca77e2002b tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] Calling method '.version_select at 0x7f623ca8a8b0>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 09:00:40.158168 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-b0bab41c-998d-4d66-bf90-16ca77e2002b tempest-TestMinimumBasicScenario-201824680 tempest-TestMinimumBasicScenario-201824680-project] 10.222.0.31 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1171703312" status: 202 len: 0 microversion: 2.1 time: 0.022357 Apr 29 09:00:40.158648 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 495/996] 10.222.0.31 () {58 vars in 1271 bytes} [Fri Apr 29 09:00:40 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1171703312 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 29 09:00:40.460256 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-75d5c296-3d6e-4513-bfd7-ce43d9dd81b5 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 29 09:00:40.461190 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-75d5c296-3d6e-4513-bfd7-ce43d9dd81b5 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] [instance: e74dc909-2e3d-4acb-a05a-ed18d4c0f699] Fetching instance by UUID {{(pid=123458) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 09:00:40.467341 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-75d5c296-3d6e-4513-bfd7-ce43d9dd81b5 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:00:40.467892 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-75d5c296-3d6e-4513-bfd7-ce43d9dd81b5 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:00:40.468577 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-75d5c296-3d6e-4513-bfd7-ce43d9dd81b5 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:00:40.469016 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-75d5c296-3d6e-4513-bfd7-ce43d9dd81b5 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:00:40.493548 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.objects.instance [None req-75d5c296-3d6e-4513-bfd7-ce43d9dd81b5 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lazy-loading 'flavor' on Instance uuid e74dc909-2e3d-4acb-a05a-ed18d4c0f699 {{(pid=123458) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 29 09:00:40.776846 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-99f78cb3-0a06-4644-bb63-ea649ed46baa tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] Calling method '>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 09:00:40.777404 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-99f78cb3-0a06-4644-bb63-ea649ed46baa tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] [instance: 887e5a2b-9898-497b-b429-8f3e0aed0911] Fetching instance by UUID {{(pid=123459) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 09:00:40.786549 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-99f78cb3-0a06-4644-bb63-ea649ed46baa tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:00:40.788040 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-99f78cb3-0a06-4644-bb63-ea649ed46baa tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:00:40.794324 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-99f78cb3-0a06-4644-bb63-ea649ed46baa tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:00:40.795297 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-99f78cb3-0a06-4644-bb63-ea649ed46baa tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:00:40.851129 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-75d5c296-3d6e-4513-bfd7-ce43d9dd81b5 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] 10.222.0.31 "POST /compute/v2.1/servers/e74dc909-2e3d-4acb-a05a-ed18d4c0f699/action" status: 202 len: 0 microversion: 2.20 time: 0.394623 Apr 29 09:00:40.855156 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 502/997] 10.222.0.31 () {62 vars in 1318 bytes} [Fri Apr 29 09:00:40 2022] POST /compute/v2.1/servers/e74dc909-2e3d-4acb-a05a-ed18d4c0f699/action => generated 0 bytes in 398 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Apr 29 09:00:40.865938 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-fb3e2b0d-e6fd-445c-a915-05193a818f58 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Calling method '>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 09:00:40.866601 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-fb3e2b0d-e6fd-445c-a915-05193a818f58 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] [instance: e74dc909-2e3d-4acb-a05a-ed18d4c0f699] Fetching instance by UUID {{(pid=123458) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 09:00:40.881211 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-fb3e2b0d-e6fd-445c-a915-05193a818f58 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:00:40.881669 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-fb3e2b0d-e6fd-445c-a915-05193a818f58 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:00:40.882555 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-fb3e2b0d-e6fd-445c-a915-05193a818f58 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:00:40.894026 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-fb3e2b0d-e6fd-445c-a915-05193a818f58 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:00:41.119475 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-99f78cb3-0a06-4644-bb63-ea649ed46baa tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a82490fb17d42bf8c19f676fb687033', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8dd37ae188e415e86f551e3f760319e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 09:00:41.133041 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-99f78cb3-0a06-4644-bb63-ea649ed46baa tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] 10.222.0.31 "GET /compute/v2.1/servers/887e5a2b-9898-497b-b429-8f3e0aed0911" status: 200 len: 1267 microversion: 2.1 time: 0.362773 Apr 29 09:00:41.136024 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 496/998] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 09:00:40 2022] GET /compute/v2.1/servers/887e5a2b-9898-497b-b429-8f3e0aed0911 => generated 1267 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 09:00:41.149186 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-fbce0027-b62a-472e-ac75-36c12005161e tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Calling method '>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 09:00:41.150170 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-fbce0027-b62a-472e-ac75-36c12005161e tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] [instance: 1fa7d94e-9ddd-4cf7-a7c5-072231c6d0bb] Fetching instance by UUID {{(pid=123459) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 09:00:41.174818 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-fbce0027-b62a-472e-ac75-36c12005161e tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:00:41.179075 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-fbce0027-b62a-472e-ac75-36c12005161e tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:00:41.181397 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-fbce0027-b62a-472e-ac75-36c12005161e tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:00:41.182950 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-fbce0027-b62a-472e-ac75-36c12005161e tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:00:41.528625 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-fb3e2b0d-e6fd-445c-a915-05193a818f58 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 09:00:41.544072 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-fb3e2b0d-e6fd-445c-a915-05193a818f58 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 09:00:41.545665 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-fb3e2b0d-e6fd-445c-a915-05193a818f58 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 09:00:41.546899 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-fb3e2b0d-e6fd-445c-a915-05193a818f58 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] 10.222.0.31 "GET /compute/v2.1/servers/e74dc909-2e3d-4acb-a05a-ed18d4c0f699" status: 200 len: 1724 microversion: 2.20 time: 0.690284 Apr 29 09:00:41.547468 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 503/999] 10.222.0.31 () {60 vars in 1276 bytes} [Fri Apr 29 09:00:40 2022] GET /compute/v2.1/servers/e74dc909-2e3d-4acb-a05a-ed18d4c0f699 => generated 1724 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 29 09:00:41.605257 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-fbce0027-b62a-472e-ac75-36c12005161e tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e47ecdfb01f447699275b13255c15d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578e6a35974d4e5c8a0cd4e5fa994259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 09:00:41.614846 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-fbce0027-b62a-472e-ac75-36c12005161e tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] 10.222.0.31 "GET /compute/v2.1/servers/1fa7d94e-9ddd-4cf7-a7c5-072231c6d0bb" status: 200 len: 1366 microversion: 2.1 time: 0.477050 Apr 29 09:00:41.625086 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 497/1000] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 09:00:41 2022] GET /compute/v2.1/servers/1fa7d94e-9ddd-4cf7-a7c5-072231c6d0bb => generated 1366 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 09:00:42.151698 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-75811011-62c9-4835-b2b8-e6818e849261 tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] Calling method '>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 09:00:42.152690 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-75811011-62c9-4835-b2b8-e6818e849261 tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] [instance: 887e5a2b-9898-497b-b429-8f3e0aed0911] Fetching instance by UUID {{(pid=123458) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 09:00:42.160063 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-75811011-62c9-4835-b2b8-e6818e849261 tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:00:42.160874 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-75811011-62c9-4835-b2b8-e6818e849261 tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:00:42.161769 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-75811011-62c9-4835-b2b8-e6818e849261 tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:00:42.162217 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-75811011-62c9-4835-b2b8-e6818e849261 tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:00:42.310708 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-75811011-62c9-4835-b2b8-e6818e849261 tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a82490fb17d42bf8c19f676fb687033', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8dd37ae188e415e86f551e3f760319e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 09:00:42.318796 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-75811011-62c9-4835-b2b8-e6818e849261 tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] 10.222.0.31 "GET /compute/v2.1/servers/887e5a2b-9898-497b-b429-8f3e0aed0911" status: 200 len: 1267 microversion: 2.1 time: 0.171647 Apr 29 09:00:42.329467 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 504/1001] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 09:00:42 2022] GET /compute/v2.1/servers/887e5a2b-9898-497b-b429-8f3e0aed0911 => generated 1267 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 09:00:42.569630 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-74418a2d-facf-4ba9-b1d3-c72f1f865d37 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Calling method '>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 09:00:42.570426 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-74418a2d-facf-4ba9-b1d3-c72f1f865d37 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] [instance: e74dc909-2e3d-4acb-a05a-ed18d4c0f699] Fetching instance by UUID {{(pid=123459) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 09:00:42.579584 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-74418a2d-facf-4ba9-b1d3-c72f1f865d37 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:00:42.580212 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-74418a2d-facf-4ba9-b1d3-c72f1f865d37 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:00:42.581042 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-74418a2d-facf-4ba9-b1d3-c72f1f865d37 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:00:42.581477 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-74418a2d-facf-4ba9-b1d3-c72f1f865d37 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:00:42.635057 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-188e1f94-a43e-4874-9d2e-16a1b9545c25 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Calling method '>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 09:00:42.635692 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-188e1f94-a43e-4874-9d2e-16a1b9545c25 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] [instance: 1fa7d94e-9ddd-4cf7-a7c5-072231c6d0bb] Fetching instance by UUID {{(pid=123458) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 09:00:42.642241 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-188e1f94-a43e-4874-9d2e-16a1b9545c25 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:00:42.642961 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-188e1f94-a43e-4874-9d2e-16a1b9545c25 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:00:42.644502 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-188e1f94-a43e-4874-9d2e-16a1b9545c25 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:00:42.644957 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-188e1f94-a43e-4874-9d2e-16a1b9545c25 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:00:42.810503 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-188e1f94-a43e-4874-9d2e-16a1b9545c25 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e47ecdfb01f447699275b13255c15d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578e6a35974d4e5c8a0cd4e5fa994259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 09:00:42.818530 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-188e1f94-a43e-4874-9d2e-16a1b9545c25 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] 10.222.0.31 "GET /compute/v2.1/servers/1fa7d94e-9ddd-4cf7-a7c5-072231c6d0bb" status: 200 len: 1366 microversion: 2.1 time: 0.188437 Apr 29 09:00:42.819115 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 505/1002] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 09:00:42 2022] GET /compute/v2.1/servers/1fa7d94e-9ddd-4cf7-a7c5-072231c6d0bb => generated 1366 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 09:00:43.059202 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-74418a2d-facf-4ba9-b1d3-c72f1f865d37 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 09:00:43.069039 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-74418a2d-facf-4ba9-b1d3-c72f1f865d37 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 09:00:43.070770 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-74418a2d-facf-4ba9-b1d3-c72f1f865d37 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 09:00:43.073187 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-74418a2d-facf-4ba9-b1d3-c72f1f865d37 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] 10.222.0.31 "GET /compute/v2.1/servers/e74dc909-2e3d-4acb-a05a-ed18d4c0f699" status: 200 len: 1724 microversion: 2.20 time: 0.510077 Apr 29 09:00:43.073853 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 498/1003] 10.222.0.31 () {60 vars in 1276 bytes} [Fri Apr 29 09:00:42 2022] GET /compute/v2.1/servers/e74dc909-2e3d-4acb-a05a-ed18d4c0f699 => generated 1724 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 29 09:00:43.339152 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-0274892d-f829-4928-ba6c-3a3ec7c93f5e tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] Calling method '>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 09:00:43.341892 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-0274892d-f829-4928-ba6c-3a3ec7c93f5e tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] [instance: 887e5a2b-9898-497b-b429-8f3e0aed0911] Fetching instance by UUID {{(pid=123458) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 09:00:43.353099 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-0274892d-f829-4928-ba6c-3a3ec7c93f5e tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:00:43.354691 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-0274892d-f829-4928-ba6c-3a3ec7c93f5e tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:00:43.356383 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-0274892d-f829-4928-ba6c-3a3ec7c93f5e tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:00:43.356974 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-0274892d-f829-4928-ba6c-3a3ec7c93f5e tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:00:43.637226 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-0274892d-f829-4928-ba6c-3a3ec7c93f5e tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a82490fb17d42bf8c19f676fb687033', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8dd37ae188e415e86f551e3f760319e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 09:00:43.648981 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-0274892d-f829-4928-ba6c-3a3ec7c93f5e tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] 10.222.0.31 "GET /compute/v2.1/servers/887e5a2b-9898-497b-b429-8f3e0aed0911" status: 200 len: 1267 microversion: 2.1 time: 0.316318 Apr 29 09:00:43.649848 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 506/1004] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 09:00:43 2022] GET /compute/v2.1/servers/887e5a2b-9898-497b-b429-8f3e0aed0911 => generated 1267 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 09:00:43.837760 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-07efb3e4-e66f-4e25-8631-774455a050f3 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Calling method '>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 09:00:43.839806 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-07efb3e4-e66f-4e25-8631-774455a050f3 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] [instance: 1fa7d94e-9ddd-4cf7-a7c5-072231c6d0bb] Fetching instance by UUID {{(pid=123459) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 09:00:43.858409 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-07efb3e4-e66f-4e25-8631-774455a050f3 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:00:43.858880 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-07efb3e4-e66f-4e25-8631-774455a050f3 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:00:43.860345 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-07efb3e4-e66f-4e25-8631-774455a050f3 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:00:43.861088 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-07efb3e4-e66f-4e25-8631-774455a050f3 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:00:44.103481 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-07efb3e4-e66f-4e25-8631-774455a050f3 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e47ecdfb01f447699275b13255c15d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578e6a35974d4e5c8a0cd4e5fa994259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 09:00:44.108926 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-a532ccf8-31ae-4db9-9669-5ff1e7934881 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Calling method '>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 09:00:44.110285 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-a532ccf8-31ae-4db9-9669-5ff1e7934881 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] [instance: e74dc909-2e3d-4acb-a05a-ed18d4c0f699] Fetching instance by UUID {{(pid=123458) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 09:00:44.122687 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-07efb3e4-e66f-4e25-8631-774455a050f3 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] 10.222.0.31 "GET /compute/v2.1/servers/1fa7d94e-9ddd-4cf7-a7c5-072231c6d0bb" status: 200 len: 1366 microversion: 2.1 time: 0.290228 Apr 29 09:00:44.123575 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 499/1005] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 09:00:43 2022] GET /compute/v2.1/servers/1fa7d94e-9ddd-4cf7-a7c5-072231c6d0bb => generated 1366 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 09:00:44.138794 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-a532ccf8-31ae-4db9-9669-5ff1e7934881 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:00:44.138794 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-a532ccf8-31ae-4db9-9669-5ff1e7934881 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:00:44.138794 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-a532ccf8-31ae-4db9-9669-5ff1e7934881 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:00:44.138794 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-a532ccf8-31ae-4db9-9669-5ff1e7934881 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:00:44.420842 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-a532ccf8-31ae-4db9-9669-5ff1e7934881 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 09:00:44.430002 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-a532ccf8-31ae-4db9-9669-5ff1e7934881 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 09:00:44.432239 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-a532ccf8-31ae-4db9-9669-5ff1e7934881 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 09:00:44.433830 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-a532ccf8-31ae-4db9-9669-5ff1e7934881 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] 10.222.0.31 "GET /compute/v2.1/servers/e74dc909-2e3d-4acb-a05a-ed18d4c0f699" status: 200 len: 1724 microversion: 2.20 time: 0.343569 Apr 29 09:00:44.434581 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 507/1006] 10.222.0.31 () {60 vars in 1276 bytes} [Fri Apr 29 09:00:44 2022] GET /compute/v2.1/servers/e74dc909-2e3d-4acb-a05a-ed18d4c0f699 => generated 1724 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 29 09:00:44.666797 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-10fc50fe-3af6-4d8e-af41-91d48a3b1907 tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] Calling method '>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 09:00:44.667427 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-10fc50fe-3af6-4d8e-af41-91d48a3b1907 tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] [instance: 887e5a2b-9898-497b-b429-8f3e0aed0911] Fetching instance by UUID {{(pid=123459) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 09:00:44.674035 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-10fc50fe-3af6-4d8e-af41-91d48a3b1907 tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:00:44.674491 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-10fc50fe-3af6-4d8e-af41-91d48a3b1907 tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:00:44.675281 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-10fc50fe-3af6-4d8e-af41-91d48a3b1907 tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:00:44.675723 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-10fc50fe-3af6-4d8e-af41-91d48a3b1907 tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:00:44.825655 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-10fc50fe-3af6-4d8e-af41-91d48a3b1907 tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a82490fb17d42bf8c19f676fb687033', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8dd37ae188e415e86f551e3f760319e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 09:00:44.834126 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-10fc50fe-3af6-4d8e-af41-91d48a3b1907 tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] 10.222.0.31 "GET /compute/v2.1/servers/887e5a2b-9898-497b-b429-8f3e0aed0911" status: 200 len: 1267 microversion: 2.1 time: 0.171192 Apr 29 09:00:44.838252 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 500/1007] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 09:00:44 2022] GET /compute/v2.1/servers/887e5a2b-9898-497b-b429-8f3e0aed0911 => generated 1267 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 09:00:45.147770 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-58110b44-e829-4812-8743-c198d77291bf tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Calling method '>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 09:00:45.149490 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-58110b44-e829-4812-8743-c198d77291bf tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] [instance: 1fa7d94e-9ddd-4cf7-a7c5-072231c6d0bb] Fetching instance by UUID {{(pid=123458) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 09:00:45.168734 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-58110b44-e829-4812-8743-c198d77291bf tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:00:45.169518 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-58110b44-e829-4812-8743-c198d77291bf tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:00:45.174604 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-58110b44-e829-4812-8743-c198d77291bf tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:00:45.175046 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-58110b44-e829-4812-8743-c198d77291bf tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:00:45.327019 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-58110b44-e829-4812-8743-c198d77291bf tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e47ecdfb01f447699275b13255c15d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578e6a35974d4e5c8a0cd4e5fa994259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 09:00:45.335303 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-58110b44-e829-4812-8743-c198d77291bf tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] 10.222.0.31 "GET /compute/v2.1/servers/1fa7d94e-9ddd-4cf7-a7c5-072231c6d0bb" status: 200 len: 1366 microversion: 2.1 time: 0.192188 Apr 29 09:00:45.335907 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 508/1008] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 09:00:45 2022] GET /compute/v2.1/servers/1fa7d94e-9ddd-4cf7-a7c5-072231c6d0bb => generated 1366 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 29 09:00:45.454209 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-3dbd41d2-fe5a-4d14-9519-db54c3328200 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Calling method '>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 09:00:45.455074 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-3dbd41d2-fe5a-4d14-9519-db54c3328200 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] [instance: e74dc909-2e3d-4acb-a05a-ed18d4c0f699] Fetching instance by UUID {{(pid=123459) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 09:00:45.462458 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-3dbd41d2-fe5a-4d14-9519-db54c3328200 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:00:45.463317 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-3dbd41d2-fe5a-4d14-9519-db54c3328200 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:00:45.464568 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-3dbd41d2-fe5a-4d14-9519-db54c3328200 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:00:45.465246 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-3dbd41d2-fe5a-4d14-9519-db54c3328200 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:00:45.682104 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-3dbd41d2-fe5a-4d14-9519-db54c3328200 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 09:00:45.694072 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-3dbd41d2-fe5a-4d14-9519-db54c3328200 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 09:00:45.696811 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-3dbd41d2-fe5a-4d14-9519-db54c3328200 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 09:00:45.698119 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-3dbd41d2-fe5a-4d14-9519-db54c3328200 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] 10.222.0.31 "GET /compute/v2.1/servers/e74dc909-2e3d-4acb-a05a-ed18d4c0f699" status: 200 len: 1724 microversion: 2.20 time: 0.248011 Apr 29 09:00:45.698925 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 501/1009] 10.222.0.31 () {60 vars in 1276 bytes} [Fri Apr 29 09:00:45 2022] GET /compute/v2.1/servers/e74dc909-2e3d-4acb-a05a-ed18d4c0f699 => generated 1724 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 29 09:00:45.858588 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-8ef846f7-3a60-4d6e-95c3-0a4fdbd64108 tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] Calling method '>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 09:00:45.859336 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-8ef846f7-3a60-4d6e-95c3-0a4fdbd64108 tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] [instance: 887e5a2b-9898-497b-b429-8f3e0aed0911] Fetching instance by UUID {{(pid=123458) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 09:00:45.870289 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-8ef846f7-3a60-4d6e-95c3-0a4fdbd64108 tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:00:45.871451 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-8ef846f7-3a60-4d6e-95c3-0a4fdbd64108 tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:00:45.872775 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-8ef846f7-3a60-4d6e-95c3-0a4fdbd64108 tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:00:45.874336 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-8ef846f7-3a60-4d6e-95c3-0a4fdbd64108 tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:00:46.122849 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-8ef846f7-3a60-4d6e-95c3-0a4fdbd64108 tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a82490fb17d42bf8c19f676fb687033', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8dd37ae188e415e86f551e3f760319e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 09:00:46.130350 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-8ef846f7-3a60-4d6e-95c3-0a4fdbd64108 tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] 10.222.0.31 "GET /compute/v2.1/servers/887e5a2b-9898-497b-b429-8f3e0aed0911" status: 200 len: 1267 microversion: 2.1 time: 0.283192 Apr 29 09:00:46.130923 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 509/1010] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 09:00:45 2022] GET /compute/v2.1/servers/887e5a2b-9898-497b-b429-8f3e0aed0911 => generated 1267 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 09:00:46.357118 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-763af261-cbde-465d-b913-1bff96a77bdf tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Calling method '>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 09:00:46.357674 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-763af261-cbde-465d-b913-1bff96a77bdf tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] [instance: 1fa7d94e-9ddd-4cf7-a7c5-072231c6d0bb] Fetching instance by UUID {{(pid=123459) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 09:00:46.363723 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-763af261-cbde-465d-b913-1bff96a77bdf tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:00:46.364222 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-763af261-cbde-465d-b913-1bff96a77bdf tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:00:46.365007 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-763af261-cbde-465d-b913-1bff96a77bdf tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:00:46.365445 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-763af261-cbde-465d-b913-1bff96a77bdf tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:00:46.517996 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-763af261-cbde-465d-b913-1bff96a77bdf tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e47ecdfb01f447699275b13255c15d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578e6a35974d4e5c8a0cd4e5fa994259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 09:00:46.530697 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-763af261-cbde-465d-b913-1bff96a77bdf tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] 10.222.0.31 "GET /compute/v2.1/servers/1fa7d94e-9ddd-4cf7-a7c5-072231c6d0bb" status: 200 len: 1366 microversion: 2.1 time: 0.178846 Apr 29 09:00:46.532170 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 502/1011] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 09:00:46 2022] GET /compute/v2.1/servers/1fa7d94e-9ddd-4cf7-a7c5-072231c6d0bb => generated 1366 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 09:00:46.718378 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-99fe7f4a-dd7f-4b91-ba89-4e76957073a6 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Calling method '>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 09:00:46.719006 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-99fe7f4a-dd7f-4b91-ba89-4e76957073a6 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] [instance: e74dc909-2e3d-4acb-a05a-ed18d4c0f699] Fetching instance by UUID {{(pid=123458) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 09:00:46.726488 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-99fe7f4a-dd7f-4b91-ba89-4e76957073a6 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:00:46.726946 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-99fe7f4a-dd7f-4b91-ba89-4e76957073a6 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:00:46.728787 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-99fe7f4a-dd7f-4b91-ba89-4e76957073a6 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:00:46.729244 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-99fe7f4a-dd7f-4b91-ba89-4e76957073a6 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:00:47.008648 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-99fe7f4a-dd7f-4b91-ba89-4e76957073a6 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 09:00:47.016958 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-99fe7f4a-dd7f-4b91-ba89-4e76957073a6 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 09:00:47.018450 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-99fe7f4a-dd7f-4b91-ba89-4e76957073a6 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 09:00:47.019684 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-99fe7f4a-dd7f-4b91-ba89-4e76957073a6 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] 10.222.0.31 "GET /compute/v2.1/servers/e74dc909-2e3d-4acb-a05a-ed18d4c0f699" status: 200 len: 1724 microversion: 2.20 time: 0.305508 Apr 29 09:00:47.020264 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 510/1012] 10.222.0.31 () {60 vars in 1276 bytes} [Fri Apr 29 09:00:46 2022] GET /compute/v2.1/servers/e74dc909-2e3d-4acb-a05a-ed18d4c0f699 => generated 1724 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 29 09:00:47.149975 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-4dfebfab-bace-4233-900f-2757ac43c605 tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] Calling method '>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 09:00:47.150614 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-4dfebfab-bace-4233-900f-2757ac43c605 tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] [instance: 887e5a2b-9898-497b-b429-8f3e0aed0911] Fetching instance by UUID {{(pid=123459) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 09:00:47.158056 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-4dfebfab-bace-4233-900f-2757ac43c605 tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:00:47.158511 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-4dfebfab-bace-4233-900f-2757ac43c605 tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:00:47.159310 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-4dfebfab-bace-4233-900f-2757ac43c605 tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:00:47.159753 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-4dfebfab-bace-4233-900f-2757ac43c605 tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:00:47.305407 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-4dfebfab-bace-4233-900f-2757ac43c605 tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a82490fb17d42bf8c19f676fb687033', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8dd37ae188e415e86f551e3f760319e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 09:00:47.313894 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-4dfebfab-bace-4233-900f-2757ac43c605 tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] 10.222.0.31 "GET /compute/v2.1/servers/887e5a2b-9898-497b-b429-8f3e0aed0911" status: 200 len: 1267 microversion: 2.1 time: 0.168613 Apr 29 09:00:47.314589 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 503/1013] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 09:00:47 2022] GET /compute/v2.1/servers/887e5a2b-9898-497b-b429-8f3e0aed0911 => generated 1267 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 09:00:47.548777 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-3df6734d-7b15-48d6-86cd-f5e6a91d9f18 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Calling method '>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 09:00:47.549662 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-3df6734d-7b15-48d6-86cd-f5e6a91d9f18 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] [instance: 1fa7d94e-9ddd-4cf7-a7c5-072231c6d0bb] Fetching instance by UUID {{(pid=123458) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 09:00:47.557709 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-3df6734d-7b15-48d6-86cd-f5e6a91d9f18 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:00:47.558080 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-3df6734d-7b15-48d6-86cd-f5e6a91d9f18 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:00:47.558942 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-3df6734d-7b15-48d6-86cd-f5e6a91d9f18 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:00:47.559384 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-3df6734d-7b15-48d6-86cd-f5e6a91d9f18 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:00:47.576835 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [req-06be19d7-c427-44e6-8189-04342f9b14a6 req-e3068a8f-a6ff-4c1b-a75a-bfbf650687de service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1fa7d94e-9ddd-4cf7-a7c5-072231c6d0bb", "name": "network-vif-plugged", "status": "completed", "tag": "6c3b1255-2e99-4681-a117-5f4062b2074f"}]} {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 29 09:00:47.587337 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [req-06be19d7-c427-44e6-8189-04342f9b14a6 req-e3068a8f-a6ff-4c1b-a75a-bfbf650687de service nova] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:00:47.588294 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [req-06be19d7-c427-44e6-8189-04342f9b14a6 req-e3068a8f-a6ff-4c1b-a75a-bfbf650687de service nova] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:00:47.620611 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.compute.server_external_events [req-06be19d7-c427-44e6-8189-04342f9b14a6 req-e3068a8f-a6ff-4c1b-a75a-bfbf650687de service nova] Creating event network-vif-plugged:6c3b1255-2e99-4681-a117-5f4062b2074f for instance 1fa7d94e-9ddd-4cf7-a7c5-072231c6d0bb on hv-cinder-83987 Apr 29 09:00:47.627905 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [req-06be19d7-c427-44e6-8189-04342f9b14a6 req-e3068a8f-a6ff-4c1b-a75a-bfbf650687de service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055251 Apr 29 09:00:47.629344 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 504/1014] 10.222.0.31 () {64 vars in 1317 bytes} [Fri Apr 29 09:00:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 29 09:00:47.899058 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-3df6734d-7b15-48d6-86cd-f5e6a91d9f18 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e47ecdfb01f447699275b13255c15d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578e6a35974d4e5c8a0cd4e5fa994259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 09:00:47.908950 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-3df6734d-7b15-48d6-86cd-f5e6a91d9f18 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] 10.222.0.31 "GET /compute/v2.1/servers/1fa7d94e-9ddd-4cf7-a7c5-072231c6d0bb" status: 200 len: 1366 microversion: 2.1 time: 0.364258 Apr 29 09:00:47.909533 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 511/1015] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 09:00:47 2022] GET /compute/v2.1/servers/1fa7d94e-9ddd-4cf7-a7c5-072231c6d0bb => generated 1366 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 09:00:48.040472 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-c5bb1821-8fc2-48aa-8fe6-e31c8db19720 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Calling method '>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 09:00:48.043434 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-c5bb1821-8fc2-48aa-8fe6-e31c8db19720 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] [instance: e74dc909-2e3d-4acb-a05a-ed18d4c0f699] Fetching instance by UUID {{(pid=123459) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 09:00:48.047645 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-c5bb1821-8fc2-48aa-8fe6-e31c8db19720 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:00:48.048439 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-c5bb1821-8fc2-48aa-8fe6-e31c8db19720 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:00:48.048925 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-c5bb1821-8fc2-48aa-8fe6-e31c8db19720 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:00:48.049359 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-c5bb1821-8fc2-48aa-8fe6-e31c8db19720 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:00:48.187051 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-c5bb1821-8fc2-48aa-8fe6-e31c8db19720 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 09:00:48.197018 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-c5bb1821-8fc2-48aa-8fe6-e31c8db19720 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 09:00:48.198513 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-c5bb1821-8fc2-48aa-8fe6-e31c8db19720 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 09:00:48.199953 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-c5bb1821-8fc2-48aa-8fe6-e31c8db19720 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] 10.222.0.31 "GET /compute/v2.1/servers/e74dc909-2e3d-4acb-a05a-ed18d4c0f699" status: 200 len: 1724 microversion: 2.20 time: 0.164373 Apr 29 09:00:48.200314 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 505/1016] 10.222.0.31 () {60 vars in 1276 bytes} [Fri Apr 29 09:00:48 2022] GET /compute/v2.1/servers/e74dc909-2e3d-4acb-a05a-ed18d4c0f699 => generated 1724 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 29 09:00:48.333880 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-18f4454f-ec7d-4969-b47e-e68faf0d25a0 tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] Calling method '>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 09:00:48.334518 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-18f4454f-ec7d-4969-b47e-e68faf0d25a0 tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] [instance: 887e5a2b-9898-497b-b429-8f3e0aed0911] Fetching instance by UUID {{(pid=123458) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 09:00:48.342568 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-18f4454f-ec7d-4969-b47e-e68faf0d25a0 tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:00:48.343549 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-18f4454f-ec7d-4969-b47e-e68faf0d25a0 tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:00:48.344680 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-18f4454f-ec7d-4969-b47e-e68faf0d25a0 tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:00:48.345361 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-18f4454f-ec7d-4969-b47e-e68faf0d25a0 tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:00:48.502523 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-18f4454f-ec7d-4969-b47e-e68faf0d25a0 tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a82490fb17d42bf8c19f676fb687033', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8dd37ae188e415e86f551e3f760319e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 09:00:48.510930 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-18f4454f-ec7d-4969-b47e-e68faf0d25a0 tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] 10.222.0.31 "GET /compute/v2.1/servers/887e5a2b-9898-497b-b429-8f3e0aed0911" status: 200 len: 1267 microversion: 2.1 time: 0.182735 Apr 29 09:00:48.511509 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 512/1017] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 09:00:48 2022] GET /compute/v2.1/servers/887e5a2b-9898-497b-b429-8f3e0aed0911 => generated 1267 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 09:00:48.932944 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-8e60ac1d-f2d0-4b80-8e72-0991a9e6cec7 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Calling method '>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 09:00:48.934225 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-8e60ac1d-f2d0-4b80-8e72-0991a9e6cec7 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] [instance: 1fa7d94e-9ddd-4cf7-a7c5-072231c6d0bb] Fetching instance by UUID {{(pid=123459) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 09:00:48.942481 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-8e60ac1d-f2d0-4b80-8e72-0991a9e6cec7 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:00:48.943294 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-8e60ac1d-f2d0-4b80-8e72-0991a9e6cec7 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:00:48.944195 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-8e60ac1d-f2d0-4b80-8e72-0991a9e6cec7 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:00:48.944869 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-8e60ac1d-f2d0-4b80-8e72-0991a9e6cec7 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:00:49.218657 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-8a550106-cc1c-4228-9db3-eeca8edd1145 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Calling method '>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 09:00:49.219298 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-8a550106-cc1c-4228-9db3-eeca8edd1145 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] [instance: e74dc909-2e3d-4acb-a05a-ed18d4c0f699] Fetching instance by UUID {{(pid=123458) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 09:00:49.225960 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-8a550106-cc1c-4228-9db3-eeca8edd1145 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:00:49.226606 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-8a550106-cc1c-4228-9db3-eeca8edd1145 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:00:49.227542 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-8a550106-cc1c-4228-9db3-eeca8edd1145 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:00:49.227906 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-8a550106-cc1c-4228-9db3-eeca8edd1145 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:00:49.251782 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-8e60ac1d-f2d0-4b80-8e72-0991a9e6cec7 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e47ecdfb01f447699275b13255c15d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578e6a35974d4e5c8a0cd4e5fa994259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 09:00:49.261709 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-8e60ac1d-f2d0-4b80-8e72-0991a9e6cec7 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] 10.222.0.31 "GET /compute/v2.1/servers/1fa7d94e-9ddd-4cf7-a7c5-072231c6d0bb" status: 200 len: 1366 microversion: 2.1 time: 0.338130 Apr 29 09:00:49.262461 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 506/1018] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 09:00:48 2022] GET /compute/v2.1/servers/1fa7d94e-9ddd-4cf7-a7c5-072231c6d0bb => generated 1366 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 09:00:49.482816 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-8a550106-cc1c-4228-9db3-eeca8edd1145 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 09:00:49.523772 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-8a550106-cc1c-4228-9db3-eeca8edd1145 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 09:00:49.526727 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-8a550106-cc1c-4228-9db3-eeca8edd1145 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 09:00:49.530361 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-da3feef1-5114-478e-a0a0-c8907e42c9ec tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] Calling method '>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 09:00:49.531064 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-da3feef1-5114-478e-a0a0-c8907e42c9ec tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] [instance: 887e5a2b-9898-497b-b429-8f3e0aed0911] Fetching instance by UUID {{(pid=123459) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 09:00:49.535161 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-8a550106-cc1c-4228-9db3-eeca8edd1145 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] 10.222.0.31 "GET /compute/v2.1/servers/e74dc909-2e3d-4acb-a05a-ed18d4c0f699" status: 200 len: 1724 microversion: 2.20 time: 0.318533 Apr 29 09:00:49.536496 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 513/1019] 10.222.0.31 () {60 vars in 1276 bytes} [Fri Apr 29 09:00:49 2022] GET /compute/v2.1/servers/e74dc909-2e3d-4acb-a05a-ed18d4c0f699 => generated 1724 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 29 09:00:49.553470 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-da3feef1-5114-478e-a0a0-c8907e42c9ec tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:00:49.554023 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-da3feef1-5114-478e-a0a0-c8907e42c9ec tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:00:49.557637 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-da3feef1-5114-478e-a0a0-c8907e42c9ec tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:00:49.564016 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-da3feef1-5114-478e-a0a0-c8907e42c9ec tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:00:49.815710 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-da3feef1-5114-478e-a0a0-c8907e42c9ec tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a82490fb17d42bf8c19f676fb687033', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8dd37ae188e415e86f551e3f760319e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 09:00:49.826599 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-da3feef1-5114-478e-a0a0-c8907e42c9ec tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] 10.222.0.31 "GET /compute/v2.1/servers/887e5a2b-9898-497b-b429-8f3e0aed0911" status: 200 len: 1267 microversion: 2.1 time: 0.302542 Apr 29 09:00:49.840650 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 507/1020] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 09:00:49 2022] GET /compute/v2.1/servers/887e5a2b-9898-497b-b429-8f3e0aed0911 => generated 1267 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 09:00:50.283343 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-7d12cf8d-c738-43cf-8e08-82c8d23cc331 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Calling method '>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 09:00:50.283993 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-7d12cf8d-c738-43cf-8e08-82c8d23cc331 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] [instance: 1fa7d94e-9ddd-4cf7-a7c5-072231c6d0bb] Fetching instance by UUID {{(pid=123458) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 09:00:50.291584 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-7d12cf8d-c738-43cf-8e08-82c8d23cc331 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:00:50.292234 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-7d12cf8d-c738-43cf-8e08-82c8d23cc331 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:00:50.293205 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-7d12cf8d-c738-43cf-8e08-82c8d23cc331 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:00:50.293717 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-7d12cf8d-c738-43cf-8e08-82c8d23cc331 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:00:50.534819 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-7d12cf8d-c738-43cf-8e08-82c8d23cc331 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e47ecdfb01f447699275b13255c15d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578e6a35974d4e5c8a0cd4e5fa994259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 09:00:50.543491 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-7d12cf8d-c738-43cf-8e08-82c8d23cc331 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] 10.222.0.31 "GET /compute/v2.1/servers/1fa7d94e-9ddd-4cf7-a7c5-072231c6d0bb" status: 200 len: 1556 microversion: 2.1 time: 0.264954 Apr 29 09:00:50.545001 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 514/1021] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 09:00:50 2022] GET /compute/v2.1/servers/1fa7d94e-9ddd-4cf7-a7c5-072231c6d0bb => generated 1556 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 09:00:50.559847 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-c210347c-5080-45c2-bc6d-f18e36287590 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Calling method '>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 09:00:50.561185 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-c210347c-5080-45c2-bc6d-f18e36287590 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] [instance: e74dc909-2e3d-4acb-a05a-ed18d4c0f699] Fetching instance by UUID {{(pid=123459) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 09:00:50.567853 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-2d9ea697-b80f-4674-97c7-9d57a8ae7bec tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Calling method '>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 09:00:50.568388 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-2d9ea697-b80f-4674-97c7-9d57a8ae7bec tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] [instance: 1fa7d94e-9ddd-4cf7-a7c5-072231c6d0bb] Fetching instance by UUID {{(pid=123458) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 09:00:50.573521 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-c210347c-5080-45c2-bc6d-f18e36287590 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:00:50.574963 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-c210347c-5080-45c2-bc6d-f18e36287590 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:00:50.577367 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-2d9ea697-b80f-4674-97c7-9d57a8ae7bec tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:00:50.577871 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-2d9ea697-b80f-4674-97c7-9d57a8ae7bec tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:00:50.578891 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-2d9ea697-b80f-4674-97c7-9d57a8ae7bec tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:00:50.579331 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-c210347c-5080-45c2-bc6d-f18e36287590 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:00:50.579464 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-2d9ea697-b80f-4674-97c7-9d57a8ae7bec tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:00:50.580041 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-c210347c-5080-45c2-bc6d-f18e36287590 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:00:50.708062 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-2d9ea697-b80f-4674-97c7-9d57a8ae7bec tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] 10.222.0.31 "GET /compute/v2.1/servers/1fa7d94e-9ddd-4cf7-a7c5-072231c6d0bb/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.150167 Apr 29 09:00:50.709330 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 515/1022] 10.222.0.31 () {58 vars in 1274 bytes} [Fri Apr 29 09:00:50 2022] GET /compute/v2.1/servers/1fa7d94e-9ddd-4cf7-a7c5-072231c6d0bb/os-interface => generated 284 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 29 09:00:50.793747 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-c210347c-5080-45c2-bc6d-f18e36287590 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 09:00:50.801213 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-c210347c-5080-45c2-bc6d-f18e36287590 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 09:00:50.803128 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-c210347c-5080-45c2-bc6d-f18e36287590 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 09:00:50.805000 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-c210347c-5080-45c2-bc6d-f18e36287590 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] 10.222.0.31 "GET /compute/v2.1/servers/e74dc909-2e3d-4acb-a05a-ed18d4c0f699" status: 200 len: 1724 microversion: 2.20 time: 0.253773 Apr 29 09:00:50.811963 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 508/1023] 10.222.0.31 () {60 vars in 1276 bytes} [Fri Apr 29 09:00:50 2022] GET /compute/v2.1/servers/e74dc909-2e3d-4acb-a05a-ed18d4c0f699 => generated 1724 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 29 09:00:50.845741 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-632bcf1d-cf0c-4d0f-8534-9d9810c5a50a tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] Calling method '>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 09:00:50.846158 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-632bcf1d-cf0c-4d0f-8534-9d9810c5a50a tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] [instance: 887e5a2b-9898-497b-b429-8f3e0aed0911] Fetching instance by UUID {{(pid=123458) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 09:00:50.853570 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-632bcf1d-cf0c-4d0f-8534-9d9810c5a50a tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:00:50.854026 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-632bcf1d-cf0c-4d0f-8534-9d9810c5a50a tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:00:50.854889 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-632bcf1d-cf0c-4d0f-8534-9d9810c5a50a tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:00:50.855328 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-632bcf1d-cf0c-4d0f-8534-9d9810c5a50a tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:00:51.040667 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-632bcf1d-cf0c-4d0f-8534-9d9810c5a50a tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a82490fb17d42bf8c19f676fb687033', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8dd37ae188e415e86f551e3f760319e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 09:00:51.049018 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-632bcf1d-cf0c-4d0f-8534-9d9810c5a50a tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] 10.222.0.31 "GET /compute/v2.1/servers/887e5a2b-9898-497b-b429-8f3e0aed0911" status: 200 len: 1267 microversion: 2.1 time: 0.208749 Apr 29 09:00:51.049602 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 516/1024] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 09:00:50 2022] GET /compute/v2.1/servers/887e5a2b-9898-497b-b429-8f3e0aed0911 => generated 1267 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 09:00:51.822087 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [req-72c8345c-8be0-4297-93cb-d09439a88fd4 req-126adf16-eb97-4811-b1f1-30b572af870b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "887e5a2b-9898-497b-b429-8f3e0aed0911", "name": "network-vif-plugged", "status": "completed", "tag": "1200c404-ce4f-4d5e-8e49-4db86d488ad8"}]} {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 29 09:00:51.837455 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-8bc1358b-9100-4d8c-9e50-7ded04e1c039 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Calling method '>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 09:00:51.839944 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [req-72c8345c-8be0-4297-93cb-d09439a88fd4 req-126adf16-eb97-4811-b1f1-30b572af870b service nova] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:00:51.840458 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [req-72c8345c-8be0-4297-93cb-d09439a88fd4 req-126adf16-eb97-4811-b1f1-30b572af870b service nova] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:00:51.848343 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-8bc1358b-9100-4d8c-9e50-7ded04e1c039 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] [instance: e74dc909-2e3d-4acb-a05a-ed18d4c0f699] Fetching instance by UUID {{(pid=123458) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 09:00:51.865726 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-8bc1358b-9100-4d8c-9e50-7ded04e1c039 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:00:51.866512 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-8bc1358b-9100-4d8c-9e50-7ded04e1c039 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:00:51.867512 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-8bc1358b-9100-4d8c-9e50-7ded04e1c039 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:00:51.869037 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-8bc1358b-9100-4d8c-9e50-7ded04e1c039 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:00:51.876020 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.compute.server_external_events [req-72c8345c-8be0-4297-93cb-d09439a88fd4 req-126adf16-eb97-4811-b1f1-30b572af870b service nova] Creating event network-vif-plugged:1200c404-ce4f-4d5e-8e49-4db86d488ad8 for instance 887e5a2b-9898-497b-b429-8f3e0aed0911 on hv-cinder-83987 Apr 29 09:00:51.895344 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [req-72c8345c-8be0-4297-93cb-d09439a88fd4 req-126adf16-eb97-4811-b1f1-30b572af870b service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077580 Apr 29 09:00:51.896647 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 509/1025] 10.222.0.31 () {64 vars in 1317 bytes} [Fri Apr 29 09:00:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 29 09:00:51.953448 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [req-6b3a7211-5030-4cd1-b609-4489555a150f req-2e2cc061-9f1c-4e13-87ca-de0ea08f764f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1fa7d94e-9ddd-4cf7-a7c5-072231c6d0bb", "tag": "6c3b1255-2e99-4681-a117-5f4062b2074f"}]} {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 29 09:00:51.969796 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [req-6b3a7211-5030-4cd1-b609-4489555a150f req-2e2cc061-9f1c-4e13-87ca-de0ea08f764f service nova] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:00:51.970628 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [req-6b3a7211-5030-4cd1-b609-4489555a150f req-2e2cc061-9f1c-4e13-87ca-de0ea08f764f service nova] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:00:51.986656 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.compute.server_external_events [req-6b3a7211-5030-4cd1-b609-4489555a150f req-2e2cc061-9f1c-4e13-87ca-de0ea08f764f service nova] Creating event network-changed:6c3b1255-2e99-4681-a117-5f4062b2074f for instance 1fa7d94e-9ddd-4cf7-a7c5-072231c6d0bb on hv-cinder-83987 Apr 29 09:00:51.991727 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [req-6b3a7211-5030-4cd1-b609-4489555a150f req-2e2cc061-9f1c-4e13-87ca-de0ea08f764f service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047455 Apr 29 09:00:51.993189 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 510/1026] 10.222.0.31 () {64 vars in 1317 bytes} [Fri Apr 29 09:00:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 29 09:00:52.067559 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-709b707b-29fa-4392-9cc4-4ef566def1aa tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] Calling method '>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 09:00:52.068710 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-709b707b-29fa-4392-9cc4-4ef566def1aa tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] [instance: 887e5a2b-9898-497b-b429-8f3e0aed0911] Fetching instance by UUID {{(pid=123459) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 09:00:52.082547 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-709b707b-29fa-4392-9cc4-4ef566def1aa tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:00:52.083390 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-709b707b-29fa-4392-9cc4-4ef566def1aa tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:00:52.084597 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-709b707b-29fa-4392-9cc4-4ef566def1aa tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:00:52.085390 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-709b707b-29fa-4392-9cc4-4ef566def1aa tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:00:52.139561 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-8bc1358b-9100-4d8c-9e50-7ded04e1c039 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 09:00:52.153780 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-8bc1358b-9100-4d8c-9e50-7ded04e1c039 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 09:00:52.155622 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-8bc1358b-9100-4d8c-9e50-7ded04e1c039 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 09:00:52.157006 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-8bc1358b-9100-4d8c-9e50-7ded04e1c039 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] 10.222.0.31 "GET /compute/v2.1/servers/e74dc909-2e3d-4acb-a05a-ed18d4c0f699" status: 200 len: 1724 microversion: 2.20 time: 0.330198 Apr 29 09:00:52.169214 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 517/1027] 10.222.0.31 () {60 vars in 1276 bytes} [Fri Apr 29 09:00:51 2022] GET /compute/v2.1/servers/e74dc909-2e3d-4acb-a05a-ed18d4c0f699 => generated 1724 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 29 09:00:52.388627 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-709b707b-29fa-4392-9cc4-4ef566def1aa tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a82490fb17d42bf8c19f676fb687033', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8dd37ae188e415e86f551e3f760319e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 09:00:52.400730 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-709b707b-29fa-4392-9cc4-4ef566def1aa tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] 10.222.0.31 "GET /compute/v2.1/servers/887e5a2b-9898-497b-b429-8f3e0aed0911" status: 200 len: 1267 microversion: 2.1 time: 0.337652 Apr 29 09:00:52.402957 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 511/1028] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 09:00:52 2022] GET /compute/v2.1/servers/887e5a2b-9898-497b-b429-8f3e0aed0911 => generated 1267 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 29 09:00:53.175600 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-d8624b8c-ad79-4c90-b08a-169686d4ed21 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Calling method '>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 09:00:53.176824 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-d8624b8c-ad79-4c90-b08a-169686d4ed21 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] [instance: e74dc909-2e3d-4acb-a05a-ed18d4c0f699] Fetching instance by UUID {{(pid=123458) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 09:00:53.184006 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-d8624b8c-ad79-4c90-b08a-169686d4ed21 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:00:53.184493 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-d8624b8c-ad79-4c90-b08a-169686d4ed21 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:00:53.185291 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-d8624b8c-ad79-4c90-b08a-169686d4ed21 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:00:53.185735 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-d8624b8c-ad79-4c90-b08a-169686d4ed21 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:00:53.324961 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-d8624b8c-ad79-4c90-b08a-169686d4ed21 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 09:00:53.332986 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-d8624b8c-ad79-4c90-b08a-169686d4ed21 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 09:00:53.334498 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-d8624b8c-ad79-4c90-b08a-169686d4ed21 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 09:00:53.335786 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-d8624b8c-ad79-4c90-b08a-169686d4ed21 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] 10.222.0.31 "GET /compute/v2.1/servers/e74dc909-2e3d-4acb-a05a-ed18d4c0f699" status: 200 len: 1724 microversion: 2.20 time: 0.164397 Apr 29 09:00:53.337352 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 518/1029] 10.222.0.31 () {60 vars in 1276 bytes} [Fri Apr 29 09:00:53 2022] GET /compute/v2.1/servers/e74dc909-2e3d-4acb-a05a-ed18d4c0f699 => generated 1724 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 29 09:00:53.420541 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-cc090e3f-4d0c-4255-b168-603135e5c08d tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] Calling method '>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 09:00:53.421368 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-cc090e3f-4d0c-4255-b168-603135e5c08d tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] [instance: 887e5a2b-9898-497b-b429-8f3e0aed0911] Fetching instance by UUID {{(pid=123459) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 09:00:53.427530 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-cc090e3f-4d0c-4255-b168-603135e5c08d tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:00:53.427973 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-cc090e3f-4d0c-4255-b168-603135e5c08d tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:00:53.428760 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-cc090e3f-4d0c-4255-b168-603135e5c08d tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:00:53.429195 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-cc090e3f-4d0c-4255-b168-603135e5c08d tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:00:53.814376 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-cc090e3f-4d0c-4255-b168-603135e5c08d tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a82490fb17d42bf8c19f676fb687033', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8dd37ae188e415e86f551e3f760319e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 09:00:53.823205 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-cc090e3f-4d0c-4255-b168-603135e5c08d tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] 10.222.0.31 "GET /compute/v2.1/servers/887e5a2b-9898-497b-b429-8f3e0aed0911" status: 200 len: 1267 microversion: 2.1 time: 0.406673 Apr 29 09:00:53.823786 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 512/1030] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 09:00:53 2022] GET /compute/v2.1/servers/887e5a2b-9898-497b-b429-8f3e0aed0911 => generated 1267 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 09:00:54.355803 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-1f17d664-f7f7-4e00-a315-c65ec092e898 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Calling method '>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 09:00:54.356441 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-1f17d664-f7f7-4e00-a315-c65ec092e898 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] [instance: e74dc909-2e3d-4acb-a05a-ed18d4c0f699] Fetching instance by UUID {{(pid=123458) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 09:00:54.362793 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-1f17d664-f7f7-4e00-a315-c65ec092e898 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:00:54.363237 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-1f17d664-f7f7-4e00-a315-c65ec092e898 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:00:54.364008 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-1f17d664-f7f7-4e00-a315-c65ec092e898 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:00:54.364475 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-1f17d664-f7f7-4e00-a315-c65ec092e898 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:00:54.500874 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-1f17d664-f7f7-4e00-a315-c65ec092e898 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 09:00:54.509750 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-1f17d664-f7f7-4e00-a315-c65ec092e898 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 09:00:54.511269 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-1f17d664-f7f7-4e00-a315-c65ec092e898 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 09:00:54.512454 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-1f17d664-f7f7-4e00-a315-c65ec092e898 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] 10.222.0.31 "GET /compute/v2.1/servers/e74dc909-2e3d-4acb-a05a-ed18d4c0f699" status: 200 len: 1724 microversion: 2.20 time: 0.161555 Apr 29 09:00:54.513158 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 519/1031] 10.222.0.31 () {60 vars in 1276 bytes} [Fri Apr 29 09:00:54 2022] GET /compute/v2.1/servers/e74dc909-2e3d-4acb-a05a-ed18d4c0f699 => generated 1724 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 29 09:00:54.840784 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-c1bbe496-9efb-47ae-bdf8-703989014a6a tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] Calling method '>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 09:00:54.841379 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-c1bbe496-9efb-47ae-bdf8-703989014a6a tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] [instance: 887e5a2b-9898-497b-b429-8f3e0aed0911] Fetching instance by UUID {{(pid=123459) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 09:00:54.847702 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-c1bbe496-9efb-47ae-bdf8-703989014a6a tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:00:54.848180 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-c1bbe496-9efb-47ae-bdf8-703989014a6a tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:00:54.848956 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-c1bbe496-9efb-47ae-bdf8-703989014a6a tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:00:54.849426 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-c1bbe496-9efb-47ae-bdf8-703989014a6a tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:00:54.981117 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-c1bbe496-9efb-47ae-bdf8-703989014a6a tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a82490fb17d42bf8c19f676fb687033', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8dd37ae188e415e86f551e3f760319e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 09:00:54.988399 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-c1bbe496-9efb-47ae-bdf8-703989014a6a tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] 10.222.0.31 "GET /compute/v2.1/servers/887e5a2b-9898-497b-b429-8f3e0aed0911" status: 200 len: 1454 microversion: 2.1 time: 0.152160 Apr 29 09:00:54.988961 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 513/1032] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 09:00:54 2022] GET /compute/v2.1/servers/887e5a2b-9898-497b-b429-8f3e0aed0911 => generated 1454 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 09:00:55.005271 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-520121d8-6a72-4e37-a0a7-e595dc0c52ad tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] Calling method '>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 09:00:55.005888 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-520121d8-6a72-4e37-a0a7-e595dc0c52ad tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] [instance: 887e5a2b-9898-497b-b429-8f3e0aed0911] Fetching instance by UUID {{(pid=123458) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 09:00:55.012686 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-520121d8-6a72-4e37-a0a7-e595dc0c52ad tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:00:55.013140 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-520121d8-6a72-4e37-a0a7-e595dc0c52ad tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:00:55.013913 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-520121d8-6a72-4e37-a0a7-e595dc0c52ad tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:00:55.014354 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-520121d8-6a72-4e37-a0a7-e595dc0c52ad tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:00:55.149025 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-520121d8-6a72-4e37-a0a7-e595dc0c52ad tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a82490fb17d42bf8c19f676fb687033', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8dd37ae188e415e86f551e3f760319e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 09:00:55.156453 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-520121d8-6a72-4e37-a0a7-e595dc0c52ad tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] 10.222.0.31 "GET /compute/v2.1/servers/887e5a2b-9898-497b-b429-8f3e0aed0911" status: 200 len: 1454 microversion: 2.1 time: 0.154946 Apr 29 09:00:55.157024 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 520/1033] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 09:00:55 2022] GET /compute/v2.1/servers/887e5a2b-9898-497b-b429-8f3e0aed0911 => generated 1454 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 09:00:55.531112 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-afc3e103-39e5-434f-ba99-6c43dda37a2d tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Calling method '>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 09:00:55.531729 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-afc3e103-39e5-434f-ba99-6c43dda37a2d tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] [instance: e74dc909-2e3d-4acb-a05a-ed18d4c0f699] Fetching instance by UUID {{(pid=123459) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 09:00:55.537571 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-afc3e103-39e5-434f-ba99-6c43dda37a2d tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:00:55.538018 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-afc3e103-39e5-434f-ba99-6c43dda37a2d tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:00:55.538802 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-afc3e103-39e5-434f-ba99-6c43dda37a2d tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:00:55.539248 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-afc3e103-39e5-434f-ba99-6c43dda37a2d tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:00:55.674622 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-afc3e103-39e5-434f-ba99-6c43dda37a2d tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 09:00:55.683696 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-afc3e103-39e5-434f-ba99-6c43dda37a2d tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 09:00:55.685240 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-afc3e103-39e5-434f-ba99-6c43dda37a2d tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 09:00:55.686450 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-afc3e103-39e5-434f-ba99-6c43dda37a2d tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] 10.222.0.31 "GET /compute/v2.1/servers/e74dc909-2e3d-4acb-a05a-ed18d4c0f699" status: 200 len: 1724 microversion: 2.20 time: 0.159235 Apr 29 09:00:55.687217 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 514/1034] 10.222.0.31 () {60 vars in 1276 bytes} [Fri Apr 29 09:00:55 2022] GET /compute/v2.1/servers/e74dc909-2e3d-4acb-a05a-ed18d4c0f699 => generated 1724 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 29 09:00:56.704472 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-d3ff3d95-a50a-4084-9fd6-0d504c6de495 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Calling method '>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 09:00:56.705096 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-d3ff3d95-a50a-4084-9fd6-0d504c6de495 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] [instance: e74dc909-2e3d-4acb-a05a-ed18d4c0f699] Fetching instance by UUID {{(pid=123458) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 09:00:56.711759 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-d3ff3d95-a50a-4084-9fd6-0d504c6de495 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:00:56.712249 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-d3ff3d95-a50a-4084-9fd6-0d504c6de495 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:00:56.713054 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-d3ff3d95-a50a-4084-9fd6-0d504c6de495 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:00:56.713579 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-d3ff3d95-a50a-4084-9fd6-0d504c6de495 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:00:56.950391 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-d3ff3d95-a50a-4084-9fd6-0d504c6de495 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 09:00:56.958489 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-d3ff3d95-a50a-4084-9fd6-0d504c6de495 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 09:00:56.960047 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-d3ff3d95-a50a-4084-9fd6-0d504c6de495 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 09:00:56.961247 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-d3ff3d95-a50a-4084-9fd6-0d504c6de495 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] 10.222.0.31 "GET /compute/v2.1/servers/e74dc909-2e3d-4acb-a05a-ed18d4c0f699" status: 200 len: 1724 microversion: 2.20 time: 0.260668 Apr 29 09:00:56.961823 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 521/1035] 10.222.0.31 () {60 vars in 1276 bytes} [Fri Apr 29 09:00:56 2022] GET /compute/v2.1/servers/e74dc909-2e3d-4acb-a05a-ed18d4c0f699 => generated 1724 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 29 09:00:57.201341 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [req-6558b352-4f5c-4c0a-99c7-fe6d78de04ca req-45fb80ca-5e88-47f7-a5c6-75ebf15e5ff7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "887e5a2b-9898-497b-b429-8f3e0aed0911", "tag": "1200c404-ce4f-4d5e-8e49-4db86d488ad8"}]} {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 29 09:00:57.209919 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [req-6558b352-4f5c-4c0a-99c7-fe6d78de04ca req-45fb80ca-5e88-47f7-a5c6-75ebf15e5ff7 service nova] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:00:57.210370 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [req-6558b352-4f5c-4c0a-99c7-fe6d78de04ca req-45fb80ca-5e88-47f7-a5c6-75ebf15e5ff7 service nova] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:00:57.222918 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.compute.server_external_events [req-6558b352-4f5c-4c0a-99c7-fe6d78de04ca req-45fb80ca-5e88-47f7-a5c6-75ebf15e5ff7 service nova] Creating event network-changed:1200c404-ce4f-4d5e-8e49-4db86d488ad8 for instance 887e5a2b-9898-497b-b429-8f3e0aed0911 on hv-cinder-83987 Apr 29 09:00:57.228604 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [req-6558b352-4f5c-4c0a-99c7-fe6d78de04ca req-45fb80ca-5e88-47f7-a5c6-75ebf15e5ff7 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030895 Apr 29 09:00:57.229371 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 515/1036] 10.222.0.31 () {64 vars in 1317 bytes} [Fri Apr 29 09:00:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 29 09:00:57.980449 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-286800af-a917-479d-a3e2-c542a11392c2 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Calling method '>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 09:00:57.981141 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-286800af-a917-479d-a3e2-c542a11392c2 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] [instance: e74dc909-2e3d-4acb-a05a-ed18d4c0f699] Fetching instance by UUID {{(pid=123458) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 09:00:57.987819 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-286800af-a917-479d-a3e2-c542a11392c2 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:00:57.988283 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-286800af-a917-479d-a3e2-c542a11392c2 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:00:57.988978 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-286800af-a917-479d-a3e2-c542a11392c2 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:00:57.989452 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-286800af-a917-479d-a3e2-c542a11392c2 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:00:58.129341 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-286800af-a917-479d-a3e2-c542a11392c2 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 09:00:58.138960 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-286800af-a917-479d-a3e2-c542a11392c2 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 09:00:58.140476 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-286800af-a917-479d-a3e2-c542a11392c2 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 09:00:58.141666 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-286800af-a917-479d-a3e2-c542a11392c2 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] 10.222.0.31 "GET /compute/v2.1/servers/e74dc909-2e3d-4acb-a05a-ed18d4c0f699" status: 200 len: 1745 microversion: 2.20 time: 0.165731 Apr 29 09:00:58.142244 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 522/1037] 10.222.0.31 () {60 vars in 1276 bytes} [Fri Apr 29 09:00:57 2022] GET /compute/v2.1/servers/e74dc909-2e3d-4acb-a05a-ed18d4c0f699 => generated 1745 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 29 09:00:59.161790 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-f1320574-d51f-4872-ac7c-a839a94ad62c tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Calling method '>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 09:00:59.162654 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-f1320574-d51f-4872-ac7c-a839a94ad62c tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] [instance: e74dc909-2e3d-4acb-a05a-ed18d4c0f699] Fetching instance by UUID {{(pid=123459) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 09:00:59.169278 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-f1320574-d51f-4872-ac7c-a839a94ad62c tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:00:59.169722 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-f1320574-d51f-4872-ac7c-a839a94ad62c tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:00:59.170498 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-f1320574-d51f-4872-ac7c-a839a94ad62c tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:00:59.170929 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-f1320574-d51f-4872-ac7c-a839a94ad62c tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:00:59.319503 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-f1320574-d51f-4872-ac7c-a839a94ad62c tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 09:00:59.329014 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-f1320574-d51f-4872-ac7c-a839a94ad62c tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 09:00:59.330582 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-f1320574-d51f-4872-ac7c-a839a94ad62c tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 09:00:59.331773 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-f1320574-d51f-4872-ac7c-a839a94ad62c tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] 10.222.0.31 "GET /compute/v2.1/servers/e74dc909-2e3d-4acb-a05a-ed18d4c0f699" status: 200 len: 1745 microversion: 2.20 time: 0.174733 Apr 29 09:00:59.332482 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 516/1038] 10.222.0.31 () {60 vars in 1276 bytes} [Fri Apr 29 09:00:59 2022] GET /compute/v2.1/servers/e74dc909-2e3d-4acb-a05a-ed18d4c0f699 => generated 1745 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 29 09:00:59.574141 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-5c220f00-45a8-43e5-9d88-c56509ec5d1e tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] Calling method '>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 09:00:59.574693 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-5c220f00-45a8-43e5-9d88-c56509ec5d1e tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] [instance: d83c29d2-6435-4edc-827b-2c37a66fb199] Fetching instance by UUID {{(pid=123458) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 09:00:59.576824 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [req-b193453f-4d4f-4675-86d1-7d5acf0da3f5 req-5e91aa9a-00ad-4cd5-8a07-341092cda981 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d83c29d2-6435-4edc-827b-2c37a66fb199", "tag": "67bd0bd8-da3b-4ea7-9bf9-bfddba4f2c80"}]} {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 29 09:00:59.580943 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-5c220f00-45a8-43e5-9d88-c56509ec5d1e tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:00:59.581398 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-5c220f00-45a8-43e5-9d88-c56509ec5d1e tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:00:59.582186 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-5c220f00-45a8-43e5-9d88-c56509ec5d1e tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:00:59.582698 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-5c220f00-45a8-43e5-9d88-c56509ec5d1e tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:00:59.585281 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [req-b193453f-4d4f-4675-86d1-7d5acf0da3f5 req-5e91aa9a-00ad-4cd5-8a07-341092cda981 service nova] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:00:59.585726 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [req-b193453f-4d4f-4675-86d1-7d5acf0da3f5 req-5e91aa9a-00ad-4cd5-8a07-341092cda981 service nova] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:00:59.597356 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.compute.server_external_events [req-b193453f-4d4f-4675-86d1-7d5acf0da3f5 req-5e91aa9a-00ad-4cd5-8a07-341092cda981 service nova] Creating event network-changed:67bd0bd8-da3b-4ea7-9bf9-bfddba4f2c80 for instance d83c29d2-6435-4edc-827b-2c37a66fb199 on hv-cinder-83987 Apr 29 09:00:59.602962 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [req-b193453f-4d4f-4675-86d1-7d5acf0da3f5 req-5e91aa9a-00ad-4cd5-8a07-341092cda981 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029400 Apr 29 09:00:59.603885 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 517/1039] 10.222.0.31 () {64 vars in 1317 bytes} [Fri Apr 29 09:00:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 29 09:00:59.625830 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-5c220f00-45a8-43e5-9d88-c56509ec5d1e tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] [instance: d83c29d2-6435-4edc-827b-2c37a66fb199] Going to try to terminate instance {{(pid=123458) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 29 09:00:59.734830 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-5c220f00-45a8-43e5-9d88-c56509ec5d1e tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] 10.222.0.31 "DELETE /compute/v2.1/servers/d83c29d2-6435-4edc-827b-2c37a66fb199" status: 204 len: 0 microversion: 2.1 time: 0.164347 Apr 29 09:00:59.738788 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 523/1040] 10.222.0.31 () {58 vars in 1238 bytes} [Fri Apr 29 09:00:59 2022] DELETE /compute/v2.1/servers/d83c29d2-6435-4edc-827b-2c37a66fb199 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 29 09:00:59.746535 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-b1362dfc-5fb9-4dcc-8520-1bf3e6f97e6c tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] Calling method '>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 09:00:59.748084 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-b1362dfc-5fb9-4dcc-8520-1bf3e6f97e6c tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] [instance: d83c29d2-6435-4edc-827b-2c37a66fb199] Fetching instance by UUID {{(pid=123459) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 09:00:59.755463 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-b1362dfc-5fb9-4dcc-8520-1bf3e6f97e6c tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:00:59.756989 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-b1362dfc-5fb9-4dcc-8520-1bf3e6f97e6c tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:00:59.758208 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-b1362dfc-5fb9-4dcc-8520-1bf3e6f97e6c tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:00:59.759425 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-b1362dfc-5fb9-4dcc-8520-1bf3e6f97e6c tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:00:59.936883 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-b1362dfc-5fb9-4dcc-8520-1bf3e6f97e6c tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcf1c67873b7443084ea183c77698062', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0436edb5348a4ad5a0b6b5979a7c54fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 09:00:59.946207 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-b1362dfc-5fb9-4dcc-8520-1bf3e6f97e6c tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] 10.222.0.31 "GET /compute/v2.1/servers/d83c29d2-6435-4edc-827b-2c37a66fb199" status: 200 len: 1571 microversion: 2.1 time: 0.205783 Apr 29 09:00:59.947145 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 518/1041] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 09:00:59 2022] GET /compute/v2.1/servers/d83c29d2-6435-4edc-827b-2c37a66fb199 => generated 1571 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 29 09:01:00.356611 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-b053e058-68c4-40d2-a59a-68899c8fb092 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Calling method '>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 09:01:00.357359 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-b053e058-68c4-40d2-a59a-68899c8fb092 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] [instance: e74dc909-2e3d-4acb-a05a-ed18d4c0f699] Fetching instance by UUID {{(pid=123458) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 09:01:00.365836 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-b053e058-68c4-40d2-a59a-68899c8fb092 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:01:00.365836 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-b053e058-68c4-40d2-a59a-68899c8fb092 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:01:00.366555 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-b053e058-68c4-40d2-a59a-68899c8fb092 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:01:00.367180 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-b053e058-68c4-40d2-a59a-68899c8fb092 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:01:00.509604 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-b053e058-68c4-40d2-a59a-68899c8fb092 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 09:01:00.518924 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-b053e058-68c4-40d2-a59a-68899c8fb092 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 09:01:00.520572 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-b053e058-68c4-40d2-a59a-68899c8fb092 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 09:01:00.521825 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-b053e058-68c4-40d2-a59a-68899c8fb092 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] 10.222.0.31 "GET /compute/v2.1/servers/e74dc909-2e3d-4acb-a05a-ed18d4c0f699" status: 200 len: 1745 microversion: 2.20 time: 0.169806 Apr 29 09:01:00.522404 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 524/1042] 10.222.0.31 () {60 vars in 1276 bytes} [Fri Apr 29 09:01:00 2022] GET /compute/v2.1/servers/e74dc909-2e3d-4acb-a05a-ed18d4c0f699 => generated 1745 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 29 09:01:00.963905 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-72ec2d5b-bd4c-4ea2-a7b7-6aac17d0efda tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] Calling method '>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 09:01:00.964537 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-72ec2d5b-bd4c-4ea2-a7b7-6aac17d0efda tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] [instance: d83c29d2-6435-4edc-827b-2c37a66fb199] Fetching instance by UUID {{(pid=123459) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 09:01:00.970904 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-72ec2d5b-bd4c-4ea2-a7b7-6aac17d0efda tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:01:00.971344 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-72ec2d5b-bd4c-4ea2-a7b7-6aac17d0efda tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:01:00.972105 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-72ec2d5b-bd4c-4ea2-a7b7-6aac17d0efda tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:01:00.972558 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-72ec2d5b-bd4c-4ea2-a7b7-6aac17d0efda tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:01:01.108675 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-72ec2d5b-bd4c-4ea2-a7b7-6aac17d0efda tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcf1c67873b7443084ea183c77698062', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0436edb5348a4ad5a0b6b5979a7c54fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 09:01:01.118723 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-72ec2d5b-bd4c-4ea2-a7b7-6aac17d0efda tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] 10.222.0.31 "GET /compute/v2.1/servers/d83c29d2-6435-4edc-827b-2c37a66fb199" status: 200 len: 1571 microversion: 2.1 time: 0.157998 Apr 29 09:01:01.119418 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 519/1043] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 09:01:00 2022] GET /compute/v2.1/servers/d83c29d2-6435-4edc-827b-2c37a66fb199 => generated 1571 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 09:01:01.541631 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-feb62ab8-ee23-446d-b6a0-b520c96885b1 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Calling method '>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 09:01:01.542237 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-feb62ab8-ee23-446d-b6a0-b520c96885b1 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] [instance: e74dc909-2e3d-4acb-a05a-ed18d4c0f699] Fetching instance by UUID {{(pid=123458) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 09:01:01.548948 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-feb62ab8-ee23-446d-b6a0-b520c96885b1 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:01:01.549403 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-feb62ab8-ee23-446d-b6a0-b520c96885b1 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:01:01.550217 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-feb62ab8-ee23-446d-b6a0-b520c96885b1 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:01:01.550915 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-feb62ab8-ee23-446d-b6a0-b520c96885b1 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:01:01.687913 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-feb62ab8-ee23-446d-b6a0-b520c96885b1 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 09:01:01.696625 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-feb62ab8-ee23-446d-b6a0-b520c96885b1 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 09:01:01.698641 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-feb62ab8-ee23-446d-b6a0-b520c96885b1 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 09:01:01.699908 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-feb62ab8-ee23-446d-b6a0-b520c96885b1 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] 10.222.0.31 "GET /compute/v2.1/servers/e74dc909-2e3d-4acb-a05a-ed18d4c0f699" status: 200 len: 1745 microversion: 2.20 time: 0.163276 Apr 29 09:01:01.700521 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 525/1044] 10.222.0.31 () {60 vars in 1276 bytes} [Fri Apr 29 09:01:01 2022] GET /compute/v2.1/servers/e74dc909-2e3d-4acb-a05a-ed18d4c0f699 => generated 1745 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 29 09:01:01.825524 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [req-90c8c0b1-3f7f-43fa-8088-eb6b9af1360f req-2f57f6be-1d9e-4f6a-af54-712abcf447a2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e74dc909-2e3d-4acb-a05a-ed18d4c0f699", "name": "network-vif-plugged", "status": "completed", "tag": "440a5656-f549-48bb-8394-679abd59d5c6"}]} {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 29 09:01:01.833745 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [req-90c8c0b1-3f7f-43fa-8088-eb6b9af1360f req-2f57f6be-1d9e-4f6a-af54-712abcf447a2 service nova] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:01:01.834313 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [req-90c8c0b1-3f7f-43fa-8088-eb6b9af1360f req-2f57f6be-1d9e-4f6a-af54-712abcf447a2 service nova] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:01:01.846081 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.compute.server_external_events [req-90c8c0b1-3f7f-43fa-8088-eb6b9af1360f req-2f57f6be-1d9e-4f6a-af54-712abcf447a2 service nova] Creating event network-vif-plugged:440a5656-f549-48bb-8394-679abd59d5c6 for instance e74dc909-2e3d-4acb-a05a-ed18d4c0f699 on hv-cinder-83987 Apr 29 09:01:01.851266 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [req-90c8c0b1-3f7f-43fa-8088-eb6b9af1360f req-2f57f6be-1d9e-4f6a-af54-712abcf447a2 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029551 Apr 29 09:01:01.851865 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 520/1045] 10.222.0.31 () {64 vars in 1317 bytes} [Fri Apr 29 09:01:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 29 09:01:02.136572 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-ccc21caa-dbe3-4b72-a81e-b6ef7158d3ef tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] Calling method '>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 09:01:02.137179 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-ccc21caa-dbe3-4b72-a81e-b6ef7158d3ef tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] [instance: d83c29d2-6435-4edc-827b-2c37a66fb199] Fetching instance by UUID {{(pid=123458) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 09:01:02.143226 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-ccc21caa-dbe3-4b72-a81e-b6ef7158d3ef tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:01:02.143667 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-ccc21caa-dbe3-4b72-a81e-b6ef7158d3ef tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:01:02.144460 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-ccc21caa-dbe3-4b72-a81e-b6ef7158d3ef tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:01:02.144891 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-ccc21caa-dbe3-4b72-a81e-b6ef7158d3ef tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:01:02.370688 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-ccc21caa-dbe3-4b72-a81e-b6ef7158d3ef tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcf1c67873b7443084ea183c77698062', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0436edb5348a4ad5a0b6b5979a7c54fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 09:01:02.379095 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-ccc21caa-dbe3-4b72-a81e-b6ef7158d3ef tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] 10.222.0.31 "GET /compute/v2.1/servers/d83c29d2-6435-4edc-827b-2c37a66fb199" status: 200 len: 1452 microversion: 2.1 time: 0.246379 Apr 29 09:01:02.379638 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 526/1046] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 09:01:02 2022] GET /compute/v2.1/servers/d83c29d2-6435-4edc-827b-2c37a66fb199 => generated 1452 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 09:01:02.720330 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-ffa9dce5-b7a6-42f1-b16e-282c48f2982c tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Calling method '>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 09:01:02.721029 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-ffa9dce5-b7a6-42f1-b16e-282c48f2982c tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] [instance: e74dc909-2e3d-4acb-a05a-ed18d4c0f699] Fetching instance by UUID {{(pid=123459) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 09:01:02.727052 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [req-0c560d8b-5974-4e88-a405-0ef1c17f363e req-c5e5e5bd-c891-4931-8710-38313de5d3dc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d83c29d2-6435-4edc-827b-2c37a66fb199", "name": "network-vif-deleted", "tag": "67bd0bd8-da3b-4ea7-9bf9-bfddba4f2c80"}]} {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 29 09:01:02.727778 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-ffa9dce5-b7a6-42f1-b16e-282c48f2982c tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:01:02.728298 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-ffa9dce5-b7a6-42f1-b16e-282c48f2982c tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:01:02.729099 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-ffa9dce5-b7a6-42f1-b16e-282c48f2982c tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:01:02.729535 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-ffa9dce5-b7a6-42f1-b16e-282c48f2982c tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:01:02.738596 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [req-0c560d8b-5974-4e88-a405-0ef1c17f363e req-c5e5e5bd-c891-4931-8710-38313de5d3dc service nova] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:01:02.739050 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [req-0c560d8b-5974-4e88-a405-0ef1c17f363e req-c5e5e5bd-c891-4931-8710-38313de5d3dc service nova] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:01:02.755032 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.compute.server_external_events [req-0c560d8b-5974-4e88-a405-0ef1c17f363e req-c5e5e5bd-c891-4931-8710-38313de5d3dc service nova] Creating event network-vif-deleted:67bd0bd8-da3b-4ea7-9bf9-bfddba4f2c80 for instance d83c29d2-6435-4edc-827b-2c37a66fb199 on hv-cinder-83987 Apr 29 09:01:02.761613 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [req-0c560d8b-5974-4e88-a405-0ef1c17f363e req-c5e5e5bd-c891-4931-8710-38313de5d3dc service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037883 Apr 29 09:01:02.762387 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 527/1047] 10.222.0.31 () {64 vars in 1317 bytes} [Fri Apr 29 09:01:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 29 09:01:02.875944 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-ffa9dce5-b7a6-42f1-b16e-282c48f2982c tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 09:01:02.885020 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-ffa9dce5-b7a6-42f1-b16e-282c48f2982c tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 09:01:02.886483 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-ffa9dce5-b7a6-42f1-b16e-282c48f2982c tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 09:01:02.887646 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-ffa9dce5-b7a6-42f1-b16e-282c48f2982c tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] 10.222.0.31 "GET /compute/v2.1/servers/e74dc909-2e3d-4acb-a05a-ed18d4c0f699" status: 200 len: 1745 microversion: 2.20 time: 0.172349 Apr 29 09:01:02.888258 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 521/1048] 10.222.0.31 () {60 vars in 1276 bytes} [Fri Apr 29 09:01:02 2022] GET /compute/v2.1/servers/e74dc909-2e3d-4acb-a05a-ed18d4c0f699 => generated 1745 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 29 09:01:03.396748 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-1da5dc93-50d0-495e-a14a-92772c9e15b2 tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] Calling method '>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 09:01:03.397468 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-1da5dc93-50d0-495e-a14a-92772c9e15b2 tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] [instance: d83c29d2-6435-4edc-827b-2c37a66fb199] Fetching instance by UUID {{(pid=123458) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 09:01:03.404199 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-1da5dc93-50d0-495e-a14a-92772c9e15b2 tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:01:03.404571 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-1da5dc93-50d0-495e-a14a-92772c9e15b2 tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:01:03.405344 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-1da5dc93-50d0-495e-a14a-92772c9e15b2 tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:01:03.405778 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-1da5dc93-50d0-495e-a14a-92772c9e15b2 tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:01:03.437764 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-1da5dc93-50d0-495e-a14a-92772c9e15b2 tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:01:03.438219 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-1da5dc93-50d0-495e-a14a-92772c9e15b2 tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:01:03.438670 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.objects.instance [None req-1da5dc93-50d0-495e-a14a-92772c9e15b2 tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] Lazy-loading 'fault' on Instance uuid d83c29d2-6435-4edc-827b-2c37a66fb199 {{(pid=123458) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 29 09:01:03.480537 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-1da5dc93-50d0-495e-a14a-92772c9e15b2 tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcf1c67873b7443084ea183c77698062', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0436edb5348a4ad5a0b6b5979a7c54fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 09:01:03.487893 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-1da5dc93-50d0-495e-a14a-92772c9e15b2 tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] 10.222.0.31 "GET /compute/v2.1/servers/d83c29d2-6435-4edc-827b-2c37a66fb199" status: 200 len: 1225 microversion: 2.1 time: 0.095412 Apr 29 09:01:03.488486 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 528/1049] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 09:01:03 2022] GET /compute/v2.1/servers/d83c29d2-6435-4edc-827b-2c37a66fb199 => generated 1225 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 09:01:03.908918 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-0373d94e-93e6-4a0b-aad3-008a9fee334d tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Calling method '>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 09:01:03.909527 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-0373d94e-93e6-4a0b-aad3-008a9fee334d tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] [instance: e74dc909-2e3d-4acb-a05a-ed18d4c0f699] Fetching instance by UUID {{(pid=123459) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 09:01:03.918707 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-0373d94e-93e6-4a0b-aad3-008a9fee334d tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:01:03.919360 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-0373d94e-93e6-4a0b-aad3-008a9fee334d tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:01:03.920510 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-0373d94e-93e6-4a0b-aad3-008a9fee334d tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:01:03.920961 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-0373d94e-93e6-4a0b-aad3-008a9fee334d tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:01:04.057294 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-0373d94e-93e6-4a0b-aad3-008a9fee334d tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 09:01:04.065266 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-0373d94e-93e6-4a0b-aad3-008a9fee334d tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 09:01:04.066758 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-0373d94e-93e6-4a0b-aad3-008a9fee334d tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 09:01:04.067905 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-0373d94e-93e6-4a0b-aad3-008a9fee334d tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] 10.222.0.31 "GET /compute/v2.1/servers/e74dc909-2e3d-4acb-a05a-ed18d4c0f699" status: 200 len: 1745 microversion: 2.20 time: 0.165053 Apr 29 09:01:04.068498 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 522/1050] 10.222.0.31 () {60 vars in 1276 bytes} [Fri Apr 29 09:01:03 2022] GET /compute/v2.1/servers/e74dc909-2e3d-4acb-a05a-ed18d4c0f699 => generated 1745 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 29 09:01:04.506839 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-80778904-89c5-4b28-a2b4-df3e79611ae0 tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] Calling method '>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 09:01:04.507438 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-80778904-89c5-4b28-a2b4-df3e79611ae0 tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] [instance: d83c29d2-6435-4edc-827b-2c37a66fb199] Fetching instance by UUID {{(pid=123458) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 09:01:04.514501 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-80778904-89c5-4b28-a2b4-df3e79611ae0 tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:01:04.514939 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-80778904-89c5-4b28-a2b4-df3e79611ae0 tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:01:04.515720 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-80778904-89c5-4b28-a2b4-df3e79611ae0 tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:01:04.516173 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-80778904-89c5-4b28-a2b4-df3e79611ae0 tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:01:04.531236 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.wsgi [None req-80778904-89c5-4b28-a2b4-df3e79611ae0 tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] HTTP exception thrown: Instance d83c29d2-6435-4edc-827b-2c37a66fb199 could not be found. Apr 29 09:01:04.531829 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-80778904-89c5-4b28-a2b4-df3e79611ae0 tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] Returning 404 to user: Instance d83c29d2-6435-4edc-827b-2c37a66fb199 could not be found. {{(pid=123458) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 29 09:01:04.532710 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-80778904-89c5-4b28-a2b4-df3e79611ae0 tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] 10.222.0.31 "GET /compute/v2.1/servers/d83c29d2-6435-4edc-827b-2c37a66fb199" status: 404 len: 111 microversion: 2.1 time: 0.030075 Apr 29 09:01:04.533263 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 529/1051] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 09:01:04 2022] GET /compute/v2.1/servers/d83c29d2-6435-4edc-827b-2c37a66fb199 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 29 09:01:04.712351 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-e181b63c-b1f0-4de8-a181-683a102087ea tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] Calling method '.version_select at 0x7f623cc01ee0>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 09:01:04.735196 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-e181b63c-b1f0-4de8-a181-683a102087ea tempest-TestShelveInstance-1070128121 tempest-TestShelveInstance-1070128121-project] 10.222.0.31 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1911035885" status: 202 len: 0 microversion: 2.1 time: 0.030194 Apr 29 09:01:04.735791 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 523/1052] 10.222.0.31 () {58 vars in 1253 bytes} [Fri Apr 29 09:01:04 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1911035885 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 29 09:01:05.087982 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-9b25a007-5235-43a2-848c-c1fcb97f7c9f tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Calling method '>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 09:01:05.088868 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-9b25a007-5235-43a2-848c-c1fcb97f7c9f tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] [instance: e74dc909-2e3d-4acb-a05a-ed18d4c0f699] Fetching instance by UUID {{(pid=123458) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 09:01:05.095503 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-9b25a007-5235-43a2-848c-c1fcb97f7c9f tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:01:05.096889 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-9b25a007-5235-43a2-848c-c1fcb97f7c9f tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:01:05.096889 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-9b25a007-5235-43a2-848c-c1fcb97f7c9f tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:01:05.097151 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-9b25a007-5235-43a2-848c-c1fcb97f7c9f tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:01:05.231796 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-9b25a007-5235-43a2-848c-c1fcb97f7c9f tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 09:01:05.239731 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-9b25a007-5235-43a2-848c-c1fcb97f7c9f tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 09:01:05.241274 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-9b25a007-5235-43a2-848c-c1fcb97f7c9f tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 09:01:05.242469 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-9b25a007-5235-43a2-848c-c1fcb97f7c9f tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] 10.222.0.31 "GET /compute/v2.1/servers/e74dc909-2e3d-4acb-a05a-ed18d4c0f699" status: 200 len: 1745 microversion: 2.20 time: 0.159462 Apr 29 09:01:05.243088 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 530/1053] 10.222.0.31 () {60 vars in 1276 bytes} [Fri Apr 29 09:01:05 2022] GET /compute/v2.1/servers/e74dc909-2e3d-4acb-a05a-ed18d4c0f699 => generated 1745 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 29 09:01:06.262308 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-36f5dca0-b405-4a44-995d-b02feb721f25 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Calling method '>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 09:01:06.263215 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-36f5dca0-b405-4a44-995d-b02feb721f25 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] [instance: e74dc909-2e3d-4acb-a05a-ed18d4c0f699] Fetching instance by UUID {{(pid=123459) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 09:01:06.270133 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-36f5dca0-b405-4a44-995d-b02feb721f25 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:01:06.270576 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-36f5dca0-b405-4a44-995d-b02feb721f25 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:01:06.271377 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-36f5dca0-b405-4a44-995d-b02feb721f25 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:01:06.271837 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-36f5dca0-b405-4a44-995d-b02feb721f25 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:01:06.499006 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-36f5dca0-b405-4a44-995d-b02feb721f25 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 09:01:06.507764 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-36f5dca0-b405-4a44-995d-b02feb721f25 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 09:01:06.509158 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-36f5dca0-b405-4a44-995d-b02feb721f25 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 09:01:06.510365 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-36f5dca0-b405-4a44-995d-b02feb721f25 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] 10.222.0.31 "GET /compute/v2.1/servers/e74dc909-2e3d-4acb-a05a-ed18d4c0f699" status: 200 len: 1745 microversion: 2.20 time: 0.253202 Apr 29 09:01:06.510940 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 524/1054] 10.222.0.31 () {60 vars in 1276 bytes} [Fri Apr 29 09:01:06 2022] GET /compute/v2.1/servers/e74dc909-2e3d-4acb-a05a-ed18d4c0f699 => generated 1745 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 29 09:01:07.532077 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-df3347e1-87b3-4db4-b242-8f1e7fe11778 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Calling method '>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 09:01:07.533455 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-df3347e1-87b3-4db4-b242-8f1e7fe11778 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] [instance: e74dc909-2e3d-4acb-a05a-ed18d4c0f699] Fetching instance by UUID {{(pid=123458) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 09:01:07.543861 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-df3347e1-87b3-4db4-b242-8f1e7fe11778 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:01:07.544697 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-df3347e1-87b3-4db4-b242-8f1e7fe11778 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:01:07.545885 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-df3347e1-87b3-4db4-b242-8f1e7fe11778 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:01:07.546554 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-df3347e1-87b3-4db4-b242-8f1e7fe11778 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:01:08.000983 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-df3347e1-87b3-4db4-b242-8f1e7fe11778 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 09:01:08.011799 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-df3347e1-87b3-4db4-b242-8f1e7fe11778 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 09:01:08.015103 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-df3347e1-87b3-4db4-b242-8f1e7fe11778 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 09:01:08.016696 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-df3347e1-87b3-4db4-b242-8f1e7fe11778 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] 10.222.0.31 "GET /compute/v2.1/servers/e74dc909-2e3d-4acb-a05a-ed18d4c0f699" status: 200 len: 1740 microversion: 2.20 time: 0.490530 Apr 29 09:01:08.031841 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 531/1055] 10.222.0.31 () {60 vars in 1276 bytes} [Fri Apr 29 09:01:07 2022] GET /compute/v2.1/servers/e74dc909-2e3d-4acb-a05a-ed18d4c0f699 => generated 1740 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 29 09:01:09.038595 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-5f70c817-3725-4447-99bb-9aafe336e42e tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Calling method '>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 09:01:09.041310 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-5f70c817-3725-4447-99bb-9aafe336e42e tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] [instance: e74dc909-2e3d-4acb-a05a-ed18d4c0f699] Fetching instance by UUID {{(pid=123459) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 09:01:09.049196 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-5f70c817-3725-4447-99bb-9aafe336e42e tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:01:09.050771 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-5f70c817-3725-4447-99bb-9aafe336e42e tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:01:09.051898 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-5f70c817-3725-4447-99bb-9aafe336e42e tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:01:09.052632 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-5f70c817-3725-4447-99bb-9aafe336e42e tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:01:09.396847 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-5f70c817-3725-4447-99bb-9aafe336e42e tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 09:01:09.407707 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-5f70c817-3725-4447-99bb-9aafe336e42e tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 09:01:09.410092 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-5f70c817-3725-4447-99bb-9aafe336e42e tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 09:01:09.411785 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-5f70c817-3725-4447-99bb-9aafe336e42e tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] 10.222.0.31 "GET /compute/v2.1/servers/e74dc909-2e3d-4acb-a05a-ed18d4c0f699" status: 200 len: 1740 microversion: 2.20 time: 0.377779 Apr 29 09:01:09.425139 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 525/1056] 10.222.0.31 () {60 vars in 1276 bytes} [Fri Apr 29 09:01:09 2022] GET /compute/v2.1/servers/e74dc909-2e3d-4acb-a05a-ed18d4c0f699 => generated 1740 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 29 09:01:10.433066 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-d82d0ff2-7fb2-4232-8494-b2a41cfc7fa6 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Calling method '>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 09:01:10.433865 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-d82d0ff2-7fb2-4232-8494-b2a41cfc7fa6 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] [instance: e74dc909-2e3d-4acb-a05a-ed18d4c0f699] Fetching instance by UUID {{(pid=123458) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 09:01:10.451419 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-d82d0ff2-7fb2-4232-8494-b2a41cfc7fa6 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:01:10.452248 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-d82d0ff2-7fb2-4232-8494-b2a41cfc7fa6 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:01:10.454742 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-d82d0ff2-7fb2-4232-8494-b2a41cfc7fa6 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:01:10.455186 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-d82d0ff2-7fb2-4232-8494-b2a41cfc7fa6 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:01:10.739461 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-d82d0ff2-7fb2-4232-8494-b2a41cfc7fa6 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 09:01:10.756294 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-d82d0ff2-7fb2-4232-8494-b2a41cfc7fa6 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 09:01:10.759522 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-d82d0ff2-7fb2-4232-8494-b2a41cfc7fa6 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 09:01:10.781458 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-d82d0ff2-7fb2-4232-8494-b2a41cfc7fa6 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] 10.222.0.31 "GET /compute/v2.1/servers/e74dc909-2e3d-4acb-a05a-ed18d4c0f699" status: 200 len: 1740 microversion: 2.20 time: 0.352268 Apr 29 09:01:10.784748 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 532/1057] 10.222.0.31 () {60 vars in 1276 bytes} [Fri Apr 29 09:01:10 2022] GET /compute/v2.1/servers/e74dc909-2e3d-4acb-a05a-ed18d4c0f699 => generated 1740 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 29 09:01:11.802810 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-46f918ef-1f82-4456-ad68-a8544180b235 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Calling method '>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 09:01:11.808373 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-46f918ef-1f82-4456-ad68-a8544180b235 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] [instance: e74dc909-2e3d-4acb-a05a-ed18d4c0f699] Fetching instance by UUID {{(pid=123459) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 09:01:11.823566 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-46f918ef-1f82-4456-ad68-a8544180b235 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:01:11.824383 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-46f918ef-1f82-4456-ad68-a8544180b235 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:01:11.827442 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-46f918ef-1f82-4456-ad68-a8544180b235 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:01:11.828124 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-46f918ef-1f82-4456-ad68-a8544180b235 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:01:12.116654 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-46f918ef-1f82-4456-ad68-a8544180b235 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 09:01:12.132673 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-46f918ef-1f82-4456-ad68-a8544180b235 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 09:01:12.137022 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-46f918ef-1f82-4456-ad68-a8544180b235 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 09:01:12.139348 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-46f918ef-1f82-4456-ad68-a8544180b235 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] 10.222.0.31 "GET /compute/v2.1/servers/e74dc909-2e3d-4acb-a05a-ed18d4c0f699" status: 200 len: 1740 microversion: 2.20 time: 0.340950 Apr 29 09:01:12.140969 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 526/1058] 10.222.0.31 () {60 vars in 1276 bytes} [Fri Apr 29 09:01:11 2022] GET /compute/v2.1/servers/e74dc909-2e3d-4acb-a05a-ed18d4c0f699 => generated 1740 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 29 09:01:13.170328 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-ba48ef66-4703-46f1-9557-cbc31c62b5d4 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Calling method '>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 09:01:13.174676 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-ba48ef66-4703-46f1-9557-cbc31c62b5d4 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] [instance: e74dc909-2e3d-4acb-a05a-ed18d4c0f699] Fetching instance by UUID {{(pid=123458) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 09:01:13.203349 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-ba48ef66-4703-46f1-9557-cbc31c62b5d4 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:01:13.208329 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-ba48ef66-4703-46f1-9557-cbc31c62b5d4 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:01:13.210363 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-ba48ef66-4703-46f1-9557-cbc31c62b5d4 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:01:13.212119 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-ba48ef66-4703-46f1-9557-cbc31c62b5d4 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:01:13.492852 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-ba48ef66-4703-46f1-9557-cbc31c62b5d4 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 09:01:13.507754 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-ba48ef66-4703-46f1-9557-cbc31c62b5d4 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 09:01:13.510687 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-ba48ef66-4703-46f1-9557-cbc31c62b5d4 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 09:01:13.512585 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-ba48ef66-4703-46f1-9557-cbc31c62b5d4 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] 10.222.0.31 "GET /compute/v2.1/servers/e74dc909-2e3d-4acb-a05a-ed18d4c0f699" status: 200 len: 1740 microversion: 2.20 time: 0.351251 Apr 29 09:01:13.513733 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 533/1059] 10.222.0.31 () {60 vars in 1276 bytes} [Fri Apr 29 09:01:13 2022] GET /compute/v2.1/servers/e74dc909-2e3d-4acb-a05a-ed18d4c0f699 => generated 1740 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 29 09:01:14.543806 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-52448b52-0ce9-4b3c-8dff-dcd2f9a3b202 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Calling method '>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 09:01:14.545098 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-52448b52-0ce9-4b3c-8dff-dcd2f9a3b202 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] [instance: e74dc909-2e3d-4acb-a05a-ed18d4c0f699] Fetching instance by UUID {{(pid=123459) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 09:01:14.575667 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-52448b52-0ce9-4b3c-8dff-dcd2f9a3b202 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:01:14.576609 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-52448b52-0ce9-4b3c-8dff-dcd2f9a3b202 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:01:14.578053 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-52448b52-0ce9-4b3c-8dff-dcd2f9a3b202 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:01:14.578846 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-52448b52-0ce9-4b3c-8dff-dcd2f9a3b202 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:01:14.818194 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-52448b52-0ce9-4b3c-8dff-dcd2f9a3b202 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 09:01:14.835927 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-52448b52-0ce9-4b3c-8dff-dcd2f9a3b202 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 09:01:14.838214 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-52448b52-0ce9-4b3c-8dff-dcd2f9a3b202 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 09:01:14.839758 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-52448b52-0ce9-4b3c-8dff-dcd2f9a3b202 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] 10.222.0.31 "GET /compute/v2.1/servers/e74dc909-2e3d-4acb-a05a-ed18d4c0f699" status: 200 len: 1740 microversion: 2.20 time: 0.307996 Apr 29 09:01:14.855805 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 527/1060] 10.222.0.31 () {60 vars in 1276 bytes} [Fri Apr 29 09:01:14 2022] GET /compute/v2.1/servers/e74dc909-2e3d-4acb-a05a-ed18d4c0f699 => generated 1740 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 29 09:01:16.313303 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-c7f7a639-c26a-4270-8bcd-b35a720efd3d tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Calling method '>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 09:01:16.313920 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-c7f7a639-c26a-4270-8bcd-b35a720efd3d tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] [instance: e74dc909-2e3d-4acb-a05a-ed18d4c0f699] Fetching instance by UUID {{(pid=123458) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 09:01:16.320147 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-c7f7a639-c26a-4270-8bcd-b35a720efd3d tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:01:16.320651 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-c7f7a639-c26a-4270-8bcd-b35a720efd3d tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:01:16.322052 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-c7f7a639-c26a-4270-8bcd-b35a720efd3d tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:01:16.322672 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-c7f7a639-c26a-4270-8bcd-b35a720efd3d tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:01:16.562637 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-c7f7a639-c26a-4270-8bcd-b35a720efd3d tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 09:01:16.572622 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-c7f7a639-c26a-4270-8bcd-b35a720efd3d tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 09:01:16.574394 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-c7f7a639-c26a-4270-8bcd-b35a720efd3d tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 09:01:16.575614 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-c7f7a639-c26a-4270-8bcd-b35a720efd3d tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] 10.222.0.31 "GET /compute/v2.1/servers/e74dc909-2e3d-4acb-a05a-ed18d4c0f699" status: 200 len: 1740 microversion: 2.20 time: 0.720798 Apr 29 09:01:16.576546 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 534/1061] 10.222.0.31 () {60 vars in 1276 bytes} [Fri Apr 29 09:01:15 2022] GET /compute/v2.1/servers/e74dc909-2e3d-4acb-a05a-ed18d4c0f699 => generated 1740 bytes in 722 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 29 09:01:17.595712 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-f2c1f36e-c951-463b-a1f3-17ba8c473e3e tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Calling method '>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 09:01:17.596548 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-f2c1f36e-c951-463b-a1f3-17ba8c473e3e tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] [instance: e74dc909-2e3d-4acb-a05a-ed18d4c0f699] Fetching instance by UUID {{(pid=123459) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 09:01:17.604166 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-f2c1f36e-c951-463b-a1f3-17ba8c473e3e tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:01:17.604893 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-f2c1f36e-c951-463b-a1f3-17ba8c473e3e tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:01:17.605847 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-f2c1f36e-c951-463b-a1f3-17ba8c473e3e tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:01:17.606449 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-f2c1f36e-c951-463b-a1f3-17ba8c473e3e tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:01:17.792090 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-f2c1f36e-c951-463b-a1f3-17ba8c473e3e tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 09:01:17.801218 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-f2c1f36e-c951-463b-a1f3-17ba8c473e3e tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 09:01:17.803687 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-f2c1f36e-c951-463b-a1f3-17ba8c473e3e tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 09:01:17.805547 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-f2c1f36e-c951-463b-a1f3-17ba8c473e3e tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] 10.222.0.31 "GET /compute/v2.1/servers/e74dc909-2e3d-4acb-a05a-ed18d4c0f699" status: 200 len: 1740 microversion: 2.20 time: 0.214081 Apr 29 09:01:17.816703 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 528/1062] 10.222.0.31 () {60 vars in 1276 bytes} [Fri Apr 29 09:01:17 2022] GET /compute/v2.1/servers/e74dc909-2e3d-4acb-a05a-ed18d4c0f699 => generated 1740 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 29 09:01:18.827055 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-4d6e4509-d1f0-42e2-93b6-47c0a8d5226a tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Calling method '>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 09:01:18.828700 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-4d6e4509-d1f0-42e2-93b6-47c0a8d5226a tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] [instance: e74dc909-2e3d-4acb-a05a-ed18d4c0f699] Fetching instance by UUID {{(pid=123458) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 09:01:18.839560 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-4d6e4509-d1f0-42e2-93b6-47c0a8d5226a tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:01:18.840011 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-4d6e4509-d1f0-42e2-93b6-47c0a8d5226a tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:01:18.840877 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-4d6e4509-d1f0-42e2-93b6-47c0a8d5226a tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:01:18.841301 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-4d6e4509-d1f0-42e2-93b6-47c0a8d5226a tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:01:19.081719 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-4d6e4509-d1f0-42e2-93b6-47c0a8d5226a tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 09:01:19.102591 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-4d6e4509-d1f0-42e2-93b6-47c0a8d5226a tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 09:01:19.104270 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-4d6e4509-d1f0-42e2-93b6-47c0a8d5226a tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 09:01:19.105498 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-4d6e4509-d1f0-42e2-93b6-47c0a8d5226a tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] 10.222.0.31 "GET /compute/v2.1/servers/e74dc909-2e3d-4acb-a05a-ed18d4c0f699" status: 200 len: 1740 microversion: 2.20 time: 0.285172 Apr 29 09:01:19.106059 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 535/1063] 10.222.0.31 () {60 vars in 1276 bytes} [Fri Apr 29 09:01:18 2022] GET /compute/v2.1/servers/e74dc909-2e3d-4acb-a05a-ed18d4c0f699 => generated 1740 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 29 09:01:20.126881 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-38ed2703-3440-4682-bd6a-054c8c1e11de tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Calling method '>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 09:01:20.127560 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-38ed2703-3440-4682-bd6a-054c8c1e11de tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] [instance: e74dc909-2e3d-4acb-a05a-ed18d4c0f699] Fetching instance by UUID {{(pid=123459) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 09:01:20.135003 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-38ed2703-3440-4682-bd6a-054c8c1e11de tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:01:20.135455 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-38ed2703-3440-4682-bd6a-054c8c1e11de tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:01:20.136276 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-38ed2703-3440-4682-bd6a-054c8c1e11de tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:01:20.136729 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-38ed2703-3440-4682-bd6a-054c8c1e11de tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:01:20.285672 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-38ed2703-3440-4682-bd6a-054c8c1e11de tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 09:01:20.286692 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-dc382569-0f00-4501-8dd4-d84dd4b3dcda tempest-VolumesActionsTest-1161299678 tempest-VolumesActionsTest-1161299678-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1336989673", "imageRef": "e0678f88-0b68-4453-b569-29fd065e544e", "flavorRef": "452", "networks": [{"uuid": "e752ce75-3ff8-4a81-9e57-1d34f86ff501"}]}} {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 29 09:01:20.295719 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-38ed2703-3440-4682-bd6a-054c8c1e11de tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 09:01:20.297327 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-38ed2703-3440-4682-bd6a-054c8c1e11de tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 09:01:20.298528 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-38ed2703-3440-4682-bd6a-054c8c1e11de tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] 10.222.0.31 "GET /compute/v2.1/servers/e74dc909-2e3d-4acb-a05a-ed18d4c0f699" status: 200 len: 1740 microversion: 2.20 time: 0.175669 Apr 29 09:01:20.299094 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 529/1064] 10.222.0.31 () {60 vars in 1276 bytes} [Fri Apr 29 09:01:20 2022] GET /compute/v2.1/servers/e74dc909-2e3d-4acb-a05a-ed18d4c0f699 => generated 1740 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 29 09:01:20.341872 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.network.neutron [None req-dc382569-0f00-4501-8dd4-d84dd4b3dcda tempest-VolumesActionsTest-1161299678 tempest-VolumesActionsTest-1161299678-project] validate_networks() for [('e752ce75-3ff8-4a81-9e57-1d34f86ff501', None, None, None, None, None)] {{(pid=123458) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 29 09:01:20.716114 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.virt.hardware [None req-dc382569-0f00-4501-8dd4-d84dd4b3dcda tempest-VolumesActionsTest-1161299678 tempest-VolumesActionsTest-1161299678-project] Flavor limits 0:0:0 {{(pid=123458) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 29 09:01:20.716570 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.virt.hardware [None req-dc382569-0f00-4501-8dd4-d84dd4b3dcda tempest-VolumesActionsTest-1161299678 tempest-VolumesActionsTest-1161299678-project] Image limits 0:0:0 {{(pid=123458) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 29 09:01:20.717043 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.virt.hardware [None req-dc382569-0f00-4501-8dd4-d84dd4b3dcda tempest-VolumesActionsTest-1161299678 tempest-VolumesActionsTest-1161299678-project] Flavor pref 0:0:0 {{(pid=123458) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 29 09:01:20.717455 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.virt.hardware [None req-dc382569-0f00-4501-8dd4-d84dd4b3dcda tempest-VolumesActionsTest-1161299678 tempest-VolumesActionsTest-1161299678-project] Image pref 0:0:0 {{(pid=123458) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 29 09:01:20.717872 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.virt.hardware [None req-dc382569-0f00-4501-8dd4-d84dd4b3dcda tempest-VolumesActionsTest-1161299678 tempest-VolumesActionsTest-1161299678-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123458) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 29 09:01:20.726785 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-dc382569-0f00-4501-8dd4-d84dd4b3dcda tempest-VolumesActionsTest-1161299678 tempest-VolumesActionsTest-1161299678-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:01:20.727417 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-dc382569-0f00-4501-8dd4-d84dd4b3dcda tempest-VolumesActionsTest-1161299678 tempest-VolumesActionsTest-1161299678-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:01:20.728159 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-dc382569-0f00-4501-8dd4-d84dd4b3dcda tempest-VolumesActionsTest-1161299678 tempest-VolumesActionsTest-1161299678-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:01:20.728642 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-dc382569-0f00-4501-8dd4-d84dd4b3dcda tempest-VolumesActionsTest-1161299678 tempest-VolumesActionsTest-1161299678-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:01:20.746167 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.quota [None req-dc382569-0f00-4501-8dd4-d84dd4b3dcda tempest-VolumesActionsTest-1161299678 tempest-VolumesActionsTest-1161299678-project] Getting quotas for project d538edac912247ebbaf05b22dfa6dad6. Resources: {'instances', 'cores', 'ram'} {{(pid=123458) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 29 09:01:20.750052 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.quota [None req-dc382569-0f00-4501-8dd4-d84dd4b3dcda tempest-VolumesActionsTest-1161299678 tempest-VolumesActionsTest-1161299678-project] Getting quotas for user 69102e11c4bd405eab82f8a1666ebba0 and project d538edac912247ebbaf05b22dfa6dad6. Resources: {'instances', 'cores', 'ram'} {{(pid=123458) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 29 09:01:20.762040 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-dc382569-0f00-4501-8dd4-d84dd4b3dcda tempest-VolumesActionsTest-1161299678 tempest-VolumesActionsTest-1161299678-project] Going to run 1 instances... {{(pid=123458) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 29 09:01:20.764358 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-dc382569-0f00-4501-8dd4-d84dd4b3dcda tempest-VolumesActionsTest-1161299678 tempest-VolumesActionsTest-1161299678-project] [instance: 4240f73c-c195-444d-ab09-34d6a34f7614] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e0678f88-0b68-4453-b569-29fd065e544e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123458) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 29 09:01:20.812166 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-dc382569-0f00-4501-8dd4-d84dd4b3dcda tempest-VolumesActionsTest-1161299678 tempest-VolumesActionsTest-1161299678-project] 10.222.0.31 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.529565 Apr 29 09:01:20.812840 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 536/1065] 10.222.0.31 () {60 vars in 1146 bytes} [Fri Apr 29 09:01:20 2022] POST /compute/v2.1/servers => generated 380 bytes in 531 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Apr 29 09:01:20.824358 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-726c581d-59ac-4cf5-898e-ab3e73cd4b69 tempest-VolumesActionsTest-1161299678 tempest-VolumesActionsTest-1161299678-project] Calling method '>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 09:01:20.824986 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-726c581d-59ac-4cf5-898e-ab3e73cd4b69 tempest-VolumesActionsTest-1161299678 tempest-VolumesActionsTest-1161299678-project] [instance: 4240f73c-c195-444d-ab09-34d6a34f7614] Fetching instance by UUID {{(pid=123459) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 09:01:20.886338 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-726c581d-59ac-4cf5-898e-ab3e73cd4b69 tempest-VolumesActionsTest-1161299678 tempest-VolumesActionsTest-1161299678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69102e11c4bd405eab82f8a1666ebba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd538edac912247ebbaf05b22dfa6dad6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 09:01:20.894687 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-726c581d-59ac-4cf5-898e-ab3e73cd4b69 tempest-VolumesActionsTest-1161299678 tempest-VolumesActionsTest-1161299678-project] 10.222.0.31 "GET /compute/v2.1/servers/4240f73c-c195-444d-ab09-34d6a34f7614" status: 200 len: 1214 microversion: 2.1 time: 0.074935 Apr 29 09:01:20.895294 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 530/1066] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 09:01:20 2022] GET /compute/v2.1/servers/4240f73c-c195-444d-ab09-34d6a34f7614 => generated 1214 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 09:01:21.317684 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-ac313d1d-5295-4a10-8907-8a7fda9803d7 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Calling method '>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 09:01:21.318560 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-ac313d1d-5295-4a10-8907-8a7fda9803d7 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] [instance: e74dc909-2e3d-4acb-a05a-ed18d4c0f699] Fetching instance by UUID {{(pid=123458) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 09:01:21.325641 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-ac313d1d-5295-4a10-8907-8a7fda9803d7 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:01:21.326455 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-ac313d1d-5295-4a10-8907-8a7fda9803d7 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:01:21.327453 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-ac313d1d-5295-4a10-8907-8a7fda9803d7 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:01:21.328114 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-ac313d1d-5295-4a10-8907-8a7fda9803d7 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:01:21.558222 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-ac313d1d-5295-4a10-8907-8a7fda9803d7 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 09:01:21.566773 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-ac313d1d-5295-4a10-8907-8a7fda9803d7 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 09:01:21.568294 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-ac313d1d-5295-4a10-8907-8a7fda9803d7 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 09:01:21.569477 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-ac313d1d-5295-4a10-8907-8a7fda9803d7 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] 10.222.0.31 "GET /compute/v2.1/servers/e74dc909-2e3d-4acb-a05a-ed18d4c0f699" status: 200 len: 1722 microversion: 2.20 time: 0.256289 Apr 29 09:01:21.570030 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 537/1067] 10.222.0.31 () {60 vars in 1276 bytes} [Fri Apr 29 09:01:21 2022] GET /compute/v2.1/servers/e74dc909-2e3d-4acb-a05a-ed18d4c0f699 => generated 1722 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 29 09:01:21.912682 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-d74d6f31-712a-4605-889e-28195ed30b8c tempest-VolumesActionsTest-1161299678 tempest-VolumesActionsTest-1161299678-project] Calling method '>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 09:01:21.913346 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-d74d6f31-712a-4605-889e-28195ed30b8c tempest-VolumesActionsTest-1161299678 tempest-VolumesActionsTest-1161299678-project] [instance: 4240f73c-c195-444d-ab09-34d6a34f7614] Fetching instance by UUID {{(pid=123459) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 09:01:21.921115 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-d74d6f31-712a-4605-889e-28195ed30b8c tempest-VolumesActionsTest-1161299678 tempest-VolumesActionsTest-1161299678-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:01:21.921570 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-d74d6f31-712a-4605-889e-28195ed30b8c tempest-VolumesActionsTest-1161299678 tempest-VolumesActionsTest-1161299678-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:01:21.922364 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-d74d6f31-712a-4605-889e-28195ed30b8c tempest-VolumesActionsTest-1161299678 tempest-VolumesActionsTest-1161299678-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:01:21.922803 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-d74d6f31-712a-4605-889e-28195ed30b8c tempest-VolumesActionsTest-1161299678 tempest-VolumesActionsTest-1161299678-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:01:21.993629 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-d74d6f31-712a-4605-889e-28195ed30b8c tempest-VolumesActionsTest-1161299678 tempest-VolumesActionsTest-1161299678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69102e11c4bd405eab82f8a1666ebba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd538edac912247ebbaf05b22dfa6dad6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 09:01:22.002229 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-d74d6f31-712a-4605-889e-28195ed30b8c tempest-VolumesActionsTest-1161299678 tempest-VolumesActionsTest-1161299678-project] 10.222.0.31 "GET /compute/v2.1/servers/4240f73c-c195-444d-ab09-34d6a34f7614" status: 200 len: 1210 microversion: 2.1 time: 0.093387 Apr 29 09:01:22.002822 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 531/1068] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 09:01:21 2022] GET /compute/v2.1/servers/4240f73c-c195-444d-ab09-34d6a34f7614 => generated 1210 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 09:01:22.589130 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-4cba9851-8557-4534-8f92-eb2da941e581 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Calling method '>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 09:01:22.589854 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-4cba9851-8557-4534-8f92-eb2da941e581 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] [instance: e74dc909-2e3d-4acb-a05a-ed18d4c0f699] Fetching instance by UUID {{(pid=123458) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 09:01:22.596352 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-4cba9851-8557-4534-8f92-eb2da941e581 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:01:22.596807 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-4cba9851-8557-4534-8f92-eb2da941e581 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:01:22.597581 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-4cba9851-8557-4534-8f92-eb2da941e581 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:01:22.598094 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-4cba9851-8557-4534-8f92-eb2da941e581 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:01:22.729026 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-4cba9851-8557-4534-8f92-eb2da941e581 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 09:01:22.736840 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-4cba9851-8557-4534-8f92-eb2da941e581 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 09:01:22.738352 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-4cba9851-8557-4534-8f92-eb2da941e581 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 09:01:22.739510 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-4cba9851-8557-4534-8f92-eb2da941e581 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] 10.222.0.31 "GET /compute/v2.1/servers/e74dc909-2e3d-4acb-a05a-ed18d4c0f699" status: 200 len: 1722 microversion: 2.20 time: 0.154788 Apr 29 09:01:22.740068 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 538/1069] 10.222.0.31 () {60 vars in 1276 bytes} [Fri Apr 29 09:01:22 2022] GET /compute/v2.1/servers/e74dc909-2e3d-4acb-a05a-ed18d4c0f699 => generated 1722 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 29 09:01:23.028547 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-72b967d0-d05b-44bb-8bc5-93b99ca6224c tempest-VolumesActionsTest-1161299678 tempest-VolumesActionsTest-1161299678-project] Calling method '>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 09:01:23.029172 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-72b967d0-d05b-44bb-8bc5-93b99ca6224c tempest-VolumesActionsTest-1161299678 tempest-VolumesActionsTest-1161299678-project] [instance: 4240f73c-c195-444d-ab09-34d6a34f7614] Fetching instance by UUID {{(pid=123459) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 09:01:23.035714 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-72b967d0-d05b-44bb-8bc5-93b99ca6224c tempest-VolumesActionsTest-1161299678 tempest-VolumesActionsTest-1161299678-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:01:23.036203 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-72b967d0-d05b-44bb-8bc5-93b99ca6224c tempest-VolumesActionsTest-1161299678 tempest-VolumesActionsTest-1161299678-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:01:23.036990 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-72b967d0-d05b-44bb-8bc5-93b99ca6224c tempest-VolumesActionsTest-1161299678 tempest-VolumesActionsTest-1161299678-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:01:23.037430 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-72b967d0-d05b-44bb-8bc5-93b99ca6224c tempest-VolumesActionsTest-1161299678 tempest-VolumesActionsTest-1161299678-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:01:23.099827 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-72b967d0-d05b-44bb-8bc5-93b99ca6224c tempest-VolumesActionsTest-1161299678 tempest-VolumesActionsTest-1161299678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69102e11c4bd405eab82f8a1666ebba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd538edac912247ebbaf05b22dfa6dad6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 09:01:23.107851 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-72b967d0-d05b-44bb-8bc5-93b99ca6224c tempest-VolumesActionsTest-1161299678 tempest-VolumesActionsTest-1161299678-project] 10.222.0.31 "GET /compute/v2.1/servers/4240f73c-c195-444d-ab09-34d6a34f7614" status: 200 len: 1210 microversion: 2.1 time: 0.083570 Apr 29 09:01:23.108465 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 532/1070] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 09:01:23 2022] GET /compute/v2.1/servers/4240f73c-c195-444d-ab09-34d6a34f7614 => generated 1210 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 09:01:23.759477 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-19542cc8-a404-48fa-992a-1f2191d059d1 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Calling method '>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 09:01:23.760197 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-19542cc8-a404-48fa-992a-1f2191d059d1 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] [instance: e74dc909-2e3d-4acb-a05a-ed18d4c0f699] Fetching instance by UUID {{(pid=123458) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 09:01:23.766622 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-19542cc8-a404-48fa-992a-1f2191d059d1 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:01:23.767290 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-19542cc8-a404-48fa-992a-1f2191d059d1 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:01:23.768079 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-19542cc8-a404-48fa-992a-1f2191d059d1 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:01:23.768554 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-19542cc8-a404-48fa-992a-1f2191d059d1 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:01:23.848417 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [req-16dc1af4-3df2-4866-9b45-38ded6a40998 req-1e11a0d2-0547-43db-af9c-731cad7e1c7f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e74dc909-2e3d-4acb-a05a-ed18d4c0f699", "name": "network-vif-unplugged", "status": "completed", "tag": "440a5656-f549-48bb-8394-679abd59d5c6"}]} {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 29 09:01:23.858103 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [req-16dc1af4-3df2-4866-9b45-38ded6a40998 req-1e11a0d2-0547-43db-af9c-731cad7e1c7f service nova] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:01:23.859222 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [req-16dc1af4-3df2-4866-9b45-38ded6a40998 req-1e11a0d2-0547-43db-af9c-731cad7e1c7f service nova] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:01:23.873907 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.compute.server_external_events [req-16dc1af4-3df2-4866-9b45-38ded6a40998 req-1e11a0d2-0547-43db-af9c-731cad7e1c7f service nova] Creating event network-vif-unplugged:440a5656-f549-48bb-8394-679abd59d5c6 for instance e74dc909-2e3d-4acb-a05a-ed18d4c0f699 on hv-cinder-83987 Apr 29 09:01:23.879705 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [req-16dc1af4-3df2-4866-9b45-38ded6a40998 req-1e11a0d2-0547-43db-af9c-731cad7e1c7f service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.035363 Apr 29 09:01:23.880568 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 533/1071] 10.222.0.31 () {64 vars in 1317 bytes} [Fri Apr 29 09:01:23 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 29 09:01:23.904414 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-19542cc8-a404-48fa-992a-1f2191d059d1 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 09:01:23.914883 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-19542cc8-a404-48fa-992a-1f2191d059d1 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 09:01:23.916825 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-19542cc8-a404-48fa-992a-1f2191d059d1 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 09:01:23.918082 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-19542cc8-a404-48fa-992a-1f2191d059d1 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] 10.222.0.31 "GET /compute/v2.1/servers/e74dc909-2e3d-4acb-a05a-ed18d4c0f699" status: 200 len: 1725 microversion: 2.20 time: 0.163236 Apr 29 09:01:23.918699 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 539/1072] 10.222.0.31 () {60 vars in 1276 bytes} [Fri Apr 29 09:01:23 2022] GET /compute/v2.1/servers/e74dc909-2e3d-4acb-a05a-ed18d4c0f699 => generated 1725 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 29 09:01:23.938434 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-fa44d04d-febb-4f79-850d-626f218744df tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c36eeeb3-c3d4-4912-878e-aa7fce4de144"}} {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 29 09:01:23.939587 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-fa44d04d-febb-4f79-850d-626f218744df tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] [instance: e74dc909-2e3d-4acb-a05a-ed18d4c0f699] Fetching instance by UUID {{(pid=123459) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 09:01:23.946804 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-fa44d04d-febb-4f79-850d-626f218744df tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:01:23.947280 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-fa44d04d-febb-4f79-850d-626f218744df tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:01:23.948065 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-fa44d04d-febb-4f79-850d-626f218744df tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:01:23.948547 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-fa44d04d-febb-4f79-850d-626f218744df tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:01:24.126631 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-15a26b47-6530-49b6-81f3-52fb13dee22e tempest-VolumesActionsTest-1161299678 tempest-VolumesActionsTest-1161299678-project] Calling method '>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 09:01:24.127603 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-15a26b47-6530-49b6-81f3-52fb13dee22e tempest-VolumesActionsTest-1161299678 tempest-VolumesActionsTest-1161299678-project] [instance: 4240f73c-c195-444d-ab09-34d6a34f7614] Fetching instance by UUID {{(pid=123458) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 09:01:24.137570 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-15a26b47-6530-49b6-81f3-52fb13dee22e tempest-VolumesActionsTest-1161299678 tempest-VolumesActionsTest-1161299678-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:01:24.138509 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-15a26b47-6530-49b6-81f3-52fb13dee22e tempest-VolumesActionsTest-1161299678 tempest-VolumesActionsTest-1161299678-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:01:24.139345 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-15a26b47-6530-49b6-81f3-52fb13dee22e tempest-VolumesActionsTest-1161299678 tempest-VolumesActionsTest-1161299678-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:01:24.139859 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-15a26b47-6530-49b6-81f3-52fb13dee22e tempest-VolumesActionsTest-1161299678 tempest-VolumesActionsTest-1161299678-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:01:24.249843 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-15a26b47-6530-49b6-81f3-52fb13dee22e tempest-VolumesActionsTest-1161299678 tempest-VolumesActionsTest-1161299678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69102e11c4bd405eab82f8a1666ebba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd538edac912247ebbaf05b22dfa6dad6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 09:01:24.261674 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-15a26b47-6530-49b6-81f3-52fb13dee22e tempest-VolumesActionsTest-1161299678 tempest-VolumesActionsTest-1161299678-project] 10.222.0.31 "GET /compute/v2.1/servers/4240f73c-c195-444d-ab09-34d6a34f7614" status: 200 len: 1272 microversion: 2.1 time: 0.139677 Apr 29 09:01:24.262899 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 540/1073] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 09:01:24 2022] GET /compute/v2.1/servers/4240f73c-c195-444d-ab09-34d6a34f7614 => generated 1272 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 09:01:24.276713 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-fa44d04d-febb-4f79-850d-626f218744df tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] 10.222.0.31 "POST /compute/v2.1/servers/e74dc909-2e3d-4acb-a05a-ed18d4c0f699/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.342777 Apr 29 09:01:24.277319 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 534/1074] 10.222.0.31 () {62 vars in 1363 bytes} [Fri Apr 29 09:01:23 2022] POST /compute/v2.1/servers/e74dc909-2e3d-4acb-a05a-ed18d4c0f699/os-volume_attachments => generated 188 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 29 09:01:24.400885 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-0fa9aaed-ee41-4dc1-a1e9-6f622019adfa tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Calling method '>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 09:01:24.401392 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-0fa9aaed-ee41-4dc1-a1e9-6f622019adfa tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] [instance: e74dc909-2e3d-4acb-a05a-ed18d4c0f699] Fetching instance by UUID {{(pid=123458) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 09:01:24.408060 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-0fa9aaed-ee41-4dc1-a1e9-6f622019adfa tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:01:24.408563 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-0fa9aaed-ee41-4dc1-a1e9-6f622019adfa tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:01:24.409391 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-0fa9aaed-ee41-4dc1-a1e9-6f622019adfa tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:01:24.410032 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-0fa9aaed-ee41-4dc1-a1e9-6f622019adfa tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:01:24.672820 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-0fa9aaed-ee41-4dc1-a1e9-6f622019adfa tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] 10.222.0.31 "DELETE /compute/v2.1/servers/e74dc909-2e3d-4acb-a05a-ed18d4c0f699/os-volume_attachments/c36eeeb3-c3d4-4912-878e-aa7fce4de144" status: 202 len: 0 microversion: 2.20 time: 0.276250 Apr 29 09:01:24.673454 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 541/1075] 10.222.0.31 () {60 vars in 1456 bytes} [Fri Apr 29 09:01:24 2022] DELETE /compute/v2.1/servers/e74dc909-2e3d-4acb-a05a-ed18d4c0f699/os-volume_attachments/c36eeeb3-c3d4-4912-878e-aa7fce4de144 => generated 0 bytes in 278 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Apr 29 09:01:24.732275 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-31a77888-ca9a-495d-9839-738e64d8c3ec tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 29 09:01:24.732847 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-31a77888-ca9a-495d-9839-738e64d8c3ec tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] [instance: e74dc909-2e3d-4acb-a05a-ed18d4c0f699] Fetching instance by UUID {{(pid=123459) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 09:01:24.739729 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-31a77888-ca9a-495d-9839-738e64d8c3ec tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:01:24.740193 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-31a77888-ca9a-495d-9839-738e64d8c3ec tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:01:24.740968 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-31a77888-ca9a-495d-9839-738e64d8c3ec tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:01:24.741404 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-31a77888-ca9a-495d-9839-738e64d8c3ec tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:01:24.820588 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-31a77888-ca9a-495d-9839-738e64d8c3ec tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] 10.222.0.31 "POST /compute/v2.1/servers/e74dc909-2e3d-4acb-a05a-ed18d4c0f699/action" status: 202 len: 0 microversion: 2.20 time: 0.091770 Apr 29 09:01:24.824524 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 535/1076] 10.222.0.31 () {62 vars in 1318 bytes} [Fri Apr 29 09:01:24 2022] POST /compute/v2.1/servers/e74dc909-2e3d-4acb-a05a-ed18d4c0f699/action => generated 0 bytes in 98 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Apr 29 09:01:24.829790 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-5ed4fc3f-6cd1-4866-a62b-58b3287c92c2 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Calling method '>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 09:01:24.831152 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-5ed4fc3f-6cd1-4866-a62b-58b3287c92c2 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] [instance: e74dc909-2e3d-4acb-a05a-ed18d4c0f699] Fetching instance by UUID {{(pid=123458) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 09:01:24.838347 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-5ed4fc3f-6cd1-4866-a62b-58b3287c92c2 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:01:24.838807 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-5ed4fc3f-6cd1-4866-a62b-58b3287c92c2 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:01:24.839595 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-5ed4fc3f-6cd1-4866-a62b-58b3287c92c2 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:01:24.840239 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-5ed4fc3f-6cd1-4866-a62b-58b3287c92c2 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:01:25.084964 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-5ed4fc3f-6cd1-4866-a62b-58b3287c92c2 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 09:01:25.093930 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-5ed4fc3f-6cd1-4866-a62b-58b3287c92c2 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 09:01:25.095510 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-5ed4fc3f-6cd1-4866-a62b-58b3287c92c2 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 09:01:25.096804 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-5ed4fc3f-6cd1-4866-a62b-58b3287c92c2 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] 10.222.0.31 "GET /compute/v2.1/servers/e74dc909-2e3d-4acb-a05a-ed18d4c0f699" status: 200 len: 1673 microversion: 2.20 time: 0.271018 Apr 29 09:01:25.097577 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 542/1077] 10.222.0.31 () {60 vars in 1276 bytes} [Fri Apr 29 09:01:24 2022] GET /compute/v2.1/servers/e74dc909-2e3d-4acb-a05a-ed18d4c0f699 => generated 1673 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 29 09:01:25.280749 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-8df7106d-9e90-43eb-bab1-c6905e1f82c0 tempest-VolumesActionsTest-1161299678 tempest-VolumesActionsTest-1161299678-project] Calling method '>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 09:01:25.281983 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-8df7106d-9e90-43eb-bab1-c6905e1f82c0 tempest-VolumesActionsTest-1161299678 tempest-VolumesActionsTest-1161299678-project] [instance: 4240f73c-c195-444d-ab09-34d6a34f7614] Fetching instance by UUID {{(pid=123459) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 09:01:25.289459 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-8df7106d-9e90-43eb-bab1-c6905e1f82c0 tempest-VolumesActionsTest-1161299678 tempest-VolumesActionsTest-1161299678-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:01:25.290630 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-8df7106d-9e90-43eb-bab1-c6905e1f82c0 tempest-VolumesActionsTest-1161299678 tempest-VolumesActionsTest-1161299678-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:01:25.291433 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-8df7106d-9e90-43eb-bab1-c6905e1f82c0 tempest-VolumesActionsTest-1161299678 tempest-VolumesActionsTest-1161299678-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:01:25.291896 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-8df7106d-9e90-43eb-bab1-c6905e1f82c0 tempest-VolumesActionsTest-1161299678 tempest-VolumesActionsTest-1161299678-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:01:25.442183 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-8df7106d-9e90-43eb-bab1-c6905e1f82c0 tempest-VolumesActionsTest-1161299678 tempest-VolumesActionsTest-1161299678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69102e11c4bd405eab82f8a1666ebba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd538edac912247ebbaf05b22dfa6dad6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 09:01:25.452056 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-8df7106d-9e90-43eb-bab1-c6905e1f82c0 tempest-VolumesActionsTest-1161299678 tempest-VolumesActionsTest-1161299678-project] 10.222.0.31 "GET /compute/v2.1/servers/4240f73c-c195-444d-ab09-34d6a34f7614" status: 200 len: 1314 microversion: 2.1 time: 0.175593 Apr 29 09:01:25.453615 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 536/1078] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 09:01:25 2022] GET /compute/v2.1/servers/4240f73c-c195-444d-ab09-34d6a34f7614 => generated 1314 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 09:01:25.523075 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [req-ed99386a-df8c-4d25-9bc2-303921f56797 req-15f6edd4-69d8-42e2-ac9a-322d53629fb9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4240f73c-c195-444d-ab09-34d6a34f7614", "tag": "ff9b8c47-a50f-4aed-abfb-17ad9661e4cc"}]} {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 29 09:01:25.536154 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [req-ed99386a-df8c-4d25-9bc2-303921f56797 req-15f6edd4-69d8-42e2-ac9a-322d53629fb9 service nova] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:01:25.537007 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [req-ed99386a-df8c-4d25-9bc2-303921f56797 req-15f6edd4-69d8-42e2-ac9a-322d53629fb9 service nova] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:01:25.562352 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.compute.server_external_events [req-ed99386a-df8c-4d25-9bc2-303921f56797 req-15f6edd4-69d8-42e2-ac9a-322d53629fb9 service nova] Creating event network-changed:ff9b8c47-a50f-4aed-abfb-17ad9661e4cc for instance 4240f73c-c195-444d-ab09-34d6a34f7614 on hv-cinder-83987 Apr 29 09:01:25.567223 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [req-ed99386a-df8c-4d25-9bc2-303921f56797 req-15f6edd4-69d8-42e2-ac9a-322d53629fb9 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047993 Apr 29 09:01:25.568032 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 543/1079] 10.222.0.31 () {64 vars in 1317 bytes} [Fri Apr 29 09:01:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 29 09:01:26.119101 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-de84664b-1de6-4844-b4fe-569171c2dbf3 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Calling method '>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 09:01:26.119707 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-de84664b-1de6-4844-b4fe-569171c2dbf3 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] [instance: e74dc909-2e3d-4acb-a05a-ed18d4c0f699] Fetching instance by UUID {{(pid=123459) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 09:01:26.126277 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-de84664b-1de6-4844-b4fe-569171c2dbf3 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:01:26.126560 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-de84664b-1de6-4844-b4fe-569171c2dbf3 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:01:26.127362 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-de84664b-1de6-4844-b4fe-569171c2dbf3 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:01:26.127801 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-de84664b-1de6-4844-b4fe-569171c2dbf3 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:01:26.280347 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-de84664b-1de6-4844-b4fe-569171c2dbf3 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 09:01:26.291571 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-de84664b-1de6-4844-b4fe-569171c2dbf3 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 09:01:26.293382 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-de84664b-1de6-4844-b4fe-569171c2dbf3 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 09:01:26.294589 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-de84664b-1de6-4844-b4fe-569171c2dbf3 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] 10.222.0.31 "GET /compute/v2.1/servers/e74dc909-2e3d-4acb-a05a-ed18d4c0f699" status: 200 len: 1731 microversion: 2.20 time: 0.179977 Apr 29 09:01:26.295147 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 537/1080] 10.222.0.31 () {60 vars in 1276 bytes} [Fri Apr 29 09:01:26 2022] GET /compute/v2.1/servers/e74dc909-2e3d-4acb-a05a-ed18d4c0f699 => generated 1731 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 29 09:01:26.471121 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-6dc63b5e-0629-4cd5-9e85-7e1cd960c90e tempest-VolumesActionsTest-1161299678 tempest-VolumesActionsTest-1161299678-project] Calling method '>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 09:01:26.472012 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-6dc63b5e-0629-4cd5-9e85-7e1cd960c90e tempest-VolumesActionsTest-1161299678 tempest-VolumesActionsTest-1161299678-project] [instance: 4240f73c-c195-444d-ab09-34d6a34f7614] Fetching instance by UUID {{(pid=123458) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 09:01:26.479457 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-6dc63b5e-0629-4cd5-9e85-7e1cd960c90e tempest-VolumesActionsTest-1161299678 tempest-VolumesActionsTest-1161299678-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:01:26.479907 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-6dc63b5e-0629-4cd5-9e85-7e1cd960c90e tempest-VolumesActionsTest-1161299678 tempest-VolumesActionsTest-1161299678-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:01:26.480709 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-6dc63b5e-0629-4cd5-9e85-7e1cd960c90e tempest-VolumesActionsTest-1161299678 tempest-VolumesActionsTest-1161299678-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:01:26.481142 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-6dc63b5e-0629-4cd5-9e85-7e1cd960c90e tempest-VolumesActionsTest-1161299678 tempest-VolumesActionsTest-1161299678-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:01:26.609341 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-6dc63b5e-0629-4cd5-9e85-7e1cd960c90e tempest-VolumesActionsTest-1161299678 tempest-VolumesActionsTest-1161299678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69102e11c4bd405eab82f8a1666ebba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd538edac912247ebbaf05b22dfa6dad6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 09:01:26.616680 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-6dc63b5e-0629-4cd5-9e85-7e1cd960c90e tempest-VolumesActionsTest-1161299678 tempest-VolumesActionsTest-1161299678-project] 10.222.0.31 "GET /compute/v2.1/servers/4240f73c-c195-444d-ab09-34d6a34f7614" status: 200 len: 1314 microversion: 2.1 time: 0.150205 Apr 29 09:01:26.617283 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 544/1081] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 09:01:26 2022] GET /compute/v2.1/servers/4240f73c-c195-444d-ab09-34d6a34f7614 => generated 1314 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 09:01:27.314031 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-ef54eb55-df0f-4168-8163-37bd3a13e30a tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Calling method '>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 09:01:27.314748 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-ef54eb55-df0f-4168-8163-37bd3a13e30a tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] [instance: e74dc909-2e3d-4acb-a05a-ed18d4c0f699] Fetching instance by UUID {{(pid=123459) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 09:01:27.321363 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-ef54eb55-df0f-4168-8163-37bd3a13e30a tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:01:27.321815 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-ef54eb55-df0f-4168-8163-37bd3a13e30a tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:01:27.322596 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-ef54eb55-df0f-4168-8163-37bd3a13e30a tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:01:27.323035 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-ef54eb55-df0f-4168-8163-37bd3a13e30a tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:01:27.462160 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-ef54eb55-df0f-4168-8163-37bd3a13e30a tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 09:01:27.470441 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-ef54eb55-df0f-4168-8163-37bd3a13e30a tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 09:01:27.471904 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-ef54eb55-df0f-4168-8163-37bd3a13e30a tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 09:01:27.473104 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-ef54eb55-df0f-4168-8163-37bd3a13e30a tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] 10.222.0.31 "GET /compute/v2.1/servers/e74dc909-2e3d-4acb-a05a-ed18d4c0f699" status: 200 len: 1731 microversion: 2.20 time: 0.163027 Apr 29 09:01:27.473671 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 538/1082] 10.222.0.31 () {60 vars in 1276 bytes} [Fri Apr 29 09:01:27 2022] GET /compute/v2.1/servers/e74dc909-2e3d-4acb-a05a-ed18d4c0f699 => generated 1731 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 29 09:01:27.634390 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-da8df573-d9c4-4600-ac5f-0756640fbf23 tempest-VolumesActionsTest-1161299678 tempest-VolumesActionsTest-1161299678-project] Calling method '>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 09:01:27.634958 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-da8df573-d9c4-4600-ac5f-0756640fbf23 tempest-VolumesActionsTest-1161299678 tempest-VolumesActionsTest-1161299678-project] [instance: 4240f73c-c195-444d-ab09-34d6a34f7614] Fetching instance by UUID {{(pid=123458) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 09:01:27.641578 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-da8df573-d9c4-4600-ac5f-0756640fbf23 tempest-VolumesActionsTest-1161299678 tempest-VolumesActionsTest-1161299678-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:01:27.642027 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-da8df573-d9c4-4600-ac5f-0756640fbf23 tempest-VolumesActionsTest-1161299678 tempest-VolumesActionsTest-1161299678-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:01:27.642819 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-da8df573-d9c4-4600-ac5f-0756640fbf23 tempest-VolumesActionsTest-1161299678 tempest-VolumesActionsTest-1161299678-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:01:27.643262 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-da8df573-d9c4-4600-ac5f-0756640fbf23 tempest-VolumesActionsTest-1161299678 tempest-VolumesActionsTest-1161299678-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:01:28.064537 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-da8df573-d9c4-4600-ac5f-0756640fbf23 tempest-VolumesActionsTest-1161299678 tempest-VolumesActionsTest-1161299678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69102e11c4bd405eab82f8a1666ebba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd538edac912247ebbaf05b22dfa6dad6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 09:01:28.072865 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-da8df573-d9c4-4600-ac5f-0756640fbf23 tempest-VolumesActionsTest-1161299678 tempest-VolumesActionsTest-1161299678-project] 10.222.0.31 "GET /compute/v2.1/servers/4240f73c-c195-444d-ab09-34d6a34f7614" status: 200 len: 1314 microversion: 2.1 time: 0.443041 Apr 29 09:01:28.073864 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 545/1083] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 09:01:27 2022] GET /compute/v2.1/servers/4240f73c-c195-444d-ab09-34d6a34f7614 => generated 1314 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 09:01:28.493167 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-7aa0eadb-b80c-40d1-aa52-e9cddbac40f1 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Calling method '>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 09:01:28.493775 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-7aa0eadb-b80c-40d1-aa52-e9cddbac40f1 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] [instance: e74dc909-2e3d-4acb-a05a-ed18d4c0f699] Fetching instance by UUID {{(pid=123459) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 09:01:28.500538 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-7aa0eadb-b80c-40d1-aa52-e9cddbac40f1 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:01:28.500996 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-7aa0eadb-b80c-40d1-aa52-e9cddbac40f1 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:01:28.501763 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-7aa0eadb-b80c-40d1-aa52-e9cddbac40f1 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:01:28.502200 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-7aa0eadb-b80c-40d1-aa52-e9cddbac40f1 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:01:28.721089 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-7aa0eadb-b80c-40d1-aa52-e9cddbac40f1 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 09:01:28.735428 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-7aa0eadb-b80c-40d1-aa52-e9cddbac40f1 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 09:01:28.738496 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-7aa0eadb-b80c-40d1-aa52-e9cddbac40f1 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 09:01:28.739851 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-7aa0eadb-b80c-40d1-aa52-e9cddbac40f1 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] 10.222.0.31 "GET /compute/v2.1/servers/e74dc909-2e3d-4acb-a05a-ed18d4c0f699" status: 200 len: 1731 microversion: 2.20 time: 0.251175 Apr 29 09:01:28.740463 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 539/1084] 10.222.0.31 () {60 vars in 1276 bytes} [Fri Apr 29 09:01:28 2022] GET /compute/v2.1/servers/e74dc909-2e3d-4acb-a05a-ed18d4c0f699 => generated 1731 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 29 09:01:29.091168 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-464808da-8f9b-4707-8a23-87ca1409a944 tempest-VolumesActionsTest-1161299678 tempest-VolumesActionsTest-1161299678-project] Calling method '>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 09:01:29.091785 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-464808da-8f9b-4707-8a23-87ca1409a944 tempest-VolumesActionsTest-1161299678 tempest-VolumesActionsTest-1161299678-project] [instance: 4240f73c-c195-444d-ab09-34d6a34f7614] Fetching instance by UUID {{(pid=123458) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 09:01:29.098374 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-464808da-8f9b-4707-8a23-87ca1409a944 tempest-VolumesActionsTest-1161299678 tempest-VolumesActionsTest-1161299678-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:01:29.099216 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-464808da-8f9b-4707-8a23-87ca1409a944 tempest-VolumesActionsTest-1161299678 tempest-VolumesActionsTest-1161299678-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:01:29.100101 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-464808da-8f9b-4707-8a23-87ca1409a944 tempest-VolumesActionsTest-1161299678 tempest-VolumesActionsTest-1161299678-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:01:29.100608 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-464808da-8f9b-4707-8a23-87ca1409a944 tempest-VolumesActionsTest-1161299678 tempest-VolumesActionsTest-1161299678-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:01:29.230497 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-464808da-8f9b-4707-8a23-87ca1409a944 tempest-VolumesActionsTest-1161299678 tempest-VolumesActionsTest-1161299678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69102e11c4bd405eab82f8a1666ebba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd538edac912247ebbaf05b22dfa6dad6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 09:01:29.238269 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-464808da-8f9b-4707-8a23-87ca1409a944 tempest-VolumesActionsTest-1161299678 tempest-VolumesActionsTest-1161299678-project] 10.222.0.31 "GET /compute/v2.1/servers/4240f73c-c195-444d-ab09-34d6a34f7614" status: 200 len: 1314 microversion: 2.1 time: 0.152093 Apr 29 09:01:29.239024 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 546/1085] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 09:01:29 2022] GET /compute/v2.1/servers/4240f73c-c195-444d-ab09-34d6a34f7614 => generated 1314 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 09:01:29.763544 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-26603a53-71fb-4d11-bfcf-c70d082d6752 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Calling method '>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 09:01:29.765663 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-26603a53-71fb-4d11-bfcf-c70d082d6752 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] [instance: e74dc909-2e3d-4acb-a05a-ed18d4c0f699] Fetching instance by UUID {{(pid=123459) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 09:01:29.793582 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-26603a53-71fb-4d11-bfcf-c70d082d6752 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:01:29.794192 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-26603a53-71fb-4d11-bfcf-c70d082d6752 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:01:29.797142 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-26603a53-71fb-4d11-bfcf-c70d082d6752 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:01:29.797963 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-26603a53-71fb-4d11-bfcf-c70d082d6752 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:01:30.073643 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-26603a53-71fb-4d11-bfcf-c70d082d6752 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 09:01:30.082703 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-26603a53-71fb-4d11-bfcf-c70d082d6752 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 09:01:30.084255 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-26603a53-71fb-4d11-bfcf-c70d082d6752 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 09:01:30.085539 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-26603a53-71fb-4d11-bfcf-c70d082d6752 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] 10.222.0.31 "GET /compute/v2.1/servers/e74dc909-2e3d-4acb-a05a-ed18d4c0f699" status: 200 len: 1731 microversion: 2.20 time: 0.329557 Apr 29 09:01:30.086966 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 540/1086] 10.222.0.31 () {60 vars in 1276 bytes} [Fri Apr 29 09:01:29 2022] GET /compute/v2.1/servers/e74dc909-2e3d-4acb-a05a-ed18d4c0f699 => generated 1731 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 29 09:01:30.257750 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-09aeb7f9-bea8-446c-9a4b-6de57e67be9f tempest-VolumesActionsTest-1161299678 tempest-VolumesActionsTest-1161299678-project] Calling method '>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 09:01:30.259824 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-09aeb7f9-bea8-446c-9a4b-6de57e67be9f tempest-VolumesActionsTest-1161299678 tempest-VolumesActionsTest-1161299678-project] [instance: 4240f73c-c195-444d-ab09-34d6a34f7614] Fetching instance by UUID {{(pid=123458) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 09:01:30.267342 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-09aeb7f9-bea8-446c-9a4b-6de57e67be9f tempest-VolumesActionsTest-1161299678 tempest-VolumesActionsTest-1161299678-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:01:30.267880 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-09aeb7f9-bea8-446c-9a4b-6de57e67be9f tempest-VolumesActionsTest-1161299678 tempest-VolumesActionsTest-1161299678-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:01:30.268784 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-09aeb7f9-bea8-446c-9a4b-6de57e67be9f tempest-VolumesActionsTest-1161299678 tempest-VolumesActionsTest-1161299678-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:01:30.269295 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-09aeb7f9-bea8-446c-9a4b-6de57e67be9f tempest-VolumesActionsTest-1161299678 tempest-VolumesActionsTest-1161299678-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:01:30.440943 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-09aeb7f9-bea8-446c-9a4b-6de57e67be9f tempest-VolumesActionsTest-1161299678 tempest-VolumesActionsTest-1161299678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69102e11c4bd405eab82f8a1666ebba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd538edac912247ebbaf05b22dfa6dad6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 09:01:30.450306 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-09aeb7f9-bea8-446c-9a4b-6de57e67be9f tempest-VolumesActionsTest-1161299678 tempest-VolumesActionsTest-1161299678-project] 10.222.0.31 "GET /compute/v2.1/servers/4240f73c-c195-444d-ab09-34d6a34f7614" status: 200 len: 1314 microversion: 2.1 time: 0.196970 Apr 29 09:01:30.459575 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 547/1087] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 09:01:30 2022] GET /compute/v2.1/servers/4240f73c-c195-444d-ab09-34d6a34f7614 => generated 1314 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 09:01:31.113002 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-654e1a8d-0030-4d2d-8bea-a698d09d43ef tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Calling method '>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 09:01:31.113684 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-654e1a8d-0030-4d2d-8bea-a698d09d43ef tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] [instance: e74dc909-2e3d-4acb-a05a-ed18d4c0f699] Fetching instance by UUID {{(pid=123459) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 09:01:31.122150 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-654e1a8d-0030-4d2d-8bea-a698d09d43ef tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:01:31.123424 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-654e1a8d-0030-4d2d-8bea-a698d09d43ef tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:01:31.124339 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-654e1a8d-0030-4d2d-8bea-a698d09d43ef tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:01:31.124887 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-654e1a8d-0030-4d2d-8bea-a698d09d43ef tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:01:31.270902 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-654e1a8d-0030-4d2d-8bea-a698d09d43ef tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 09:01:31.280777 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-654e1a8d-0030-4d2d-8bea-a698d09d43ef tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 09:01:31.282396 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-654e1a8d-0030-4d2d-8bea-a698d09d43ef tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 09:01:31.283721 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-654e1a8d-0030-4d2d-8bea-a698d09d43ef tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] 10.222.0.31 "GET /compute/v2.1/servers/e74dc909-2e3d-4acb-a05a-ed18d4c0f699" status: 200 len: 1731 microversion: 2.20 time: 0.175249 Apr 29 09:01:31.284494 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 541/1088] 10.222.0.31 () {60 vars in 1276 bytes} [Fri Apr 29 09:01:31 2022] GET /compute/v2.1/servers/e74dc909-2e3d-4acb-a05a-ed18d4c0f699 => generated 1731 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 29 09:01:31.471338 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-5ffc7271-b6f7-4bad-9742-16165dd39066 tempest-VolumesActionsTest-1161299678 tempest-VolumesActionsTest-1161299678-project] Calling method '>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 09:01:31.472065 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-5ffc7271-b6f7-4bad-9742-16165dd39066 tempest-VolumesActionsTest-1161299678 tempest-VolumesActionsTest-1161299678-project] [instance: 4240f73c-c195-444d-ab09-34d6a34f7614] Fetching instance by UUID {{(pid=123458) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 09:01:31.479256 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-5ffc7271-b6f7-4bad-9742-16165dd39066 tempest-VolumesActionsTest-1161299678 tempest-VolumesActionsTest-1161299678-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:01:31.479819 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-5ffc7271-b6f7-4bad-9742-16165dd39066 tempest-VolumesActionsTest-1161299678 tempest-VolumesActionsTest-1161299678-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:01:31.480734 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-5ffc7271-b6f7-4bad-9742-16165dd39066 tempest-VolumesActionsTest-1161299678 tempest-VolumesActionsTest-1161299678-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:01:31.481292 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-5ffc7271-b6f7-4bad-9742-16165dd39066 tempest-VolumesActionsTest-1161299678 tempest-VolumesActionsTest-1161299678-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:01:31.628005 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-5ffc7271-b6f7-4bad-9742-16165dd39066 tempest-VolumesActionsTest-1161299678 tempest-VolumesActionsTest-1161299678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69102e11c4bd405eab82f8a1666ebba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd538edac912247ebbaf05b22dfa6dad6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 09:01:31.637608 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-5ffc7271-b6f7-4bad-9742-16165dd39066 tempest-VolumesActionsTest-1161299678 tempest-VolumesActionsTest-1161299678-project] 10.222.0.31 "GET /compute/v2.1/servers/4240f73c-c195-444d-ab09-34d6a34f7614" status: 200 len: 1314 microversion: 2.1 time: 0.173338 Apr 29 09:01:31.638217 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 548/1089] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 09:01:31 2022] GET /compute/v2.1/servers/4240f73c-c195-444d-ab09-34d6a34f7614 => generated 1314 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 09:01:31.962345 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [req-62c22e9c-38cb-4c39-85a1-9813686d18f0 req-0ca7eeae-ad36-4bf8-b67b-c19c114b3a22 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4240f73c-c195-444d-ab09-34d6a34f7614", "name": "network-vif-plugged", "status": "completed", "tag": "ff9b8c47-a50f-4aed-abfb-17ad9661e4cc"}]} {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 29 09:01:31.970628 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [req-62c22e9c-38cb-4c39-85a1-9813686d18f0 req-0ca7eeae-ad36-4bf8-b67b-c19c114b3a22 service nova] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:01:31.971106 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [req-62c22e9c-38cb-4c39-85a1-9813686d18f0 req-0ca7eeae-ad36-4bf8-b67b-c19c114b3a22 service nova] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:01:31.985490 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.compute.server_external_events [req-62c22e9c-38cb-4c39-85a1-9813686d18f0 req-0ca7eeae-ad36-4bf8-b67b-c19c114b3a22 service nova] Creating event network-vif-plugged:ff9b8c47-a50f-4aed-abfb-17ad9661e4cc for instance 4240f73c-c195-444d-ab09-34d6a34f7614 on hv-cinder-83987 Apr 29 09:01:31.990624 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [req-62c22e9c-38cb-4c39-85a1-9813686d18f0 req-0ca7eeae-ad36-4bf8-b67b-c19c114b3a22 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032380 Apr 29 09:01:31.991222 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 542/1090] 10.222.0.31 () {64 vars in 1317 bytes} [Fri Apr 29 09:01:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 29 09:01:32.304285 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-29a33ec6-5c3e-4e59-ab38-c971ebb75390 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Calling method '>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 09:01:32.305254 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-29a33ec6-5c3e-4e59-ab38-c971ebb75390 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] [instance: e74dc909-2e3d-4acb-a05a-ed18d4c0f699] Fetching instance by UUID {{(pid=123458) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 09:01:32.312098 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-29a33ec6-5c3e-4e59-ab38-c971ebb75390 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:01:32.312574 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-29a33ec6-5c3e-4e59-ab38-c971ebb75390 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:01:32.313358 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-29a33ec6-5c3e-4e59-ab38-c971ebb75390 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:01:32.313795 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-29a33ec6-5c3e-4e59-ab38-c971ebb75390 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:01:32.470771 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-29a33ec6-5c3e-4e59-ab38-c971ebb75390 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 09:01:32.483156 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-29a33ec6-5c3e-4e59-ab38-c971ebb75390 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 09:01:32.485729 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-29a33ec6-5c3e-4e59-ab38-c971ebb75390 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 09:01:32.487229 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-29a33ec6-5c3e-4e59-ab38-c971ebb75390 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] 10.222.0.31 "GET /compute/v2.1/servers/e74dc909-2e3d-4acb-a05a-ed18d4c0f699" status: 200 len: 1731 microversion: 2.20 time: 0.187176 Apr 29 09:01:32.488222 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 549/1091] 10.222.0.31 () {60 vars in 1276 bytes} [Fri Apr 29 09:01:32 2022] GET /compute/v2.1/servers/e74dc909-2e3d-4acb-a05a-ed18d4c0f699 => generated 1731 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 29 09:01:32.656373 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-efeec2d9-fd91-4799-8a64-d7b6ca219be3 tempest-VolumesActionsTest-1161299678 tempest-VolumesActionsTest-1161299678-project] Calling method '>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 09:01:32.657497 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-efeec2d9-fd91-4799-8a64-d7b6ca219be3 tempest-VolumesActionsTest-1161299678 tempest-VolumesActionsTest-1161299678-project] [instance: 4240f73c-c195-444d-ab09-34d6a34f7614] Fetching instance by UUID {{(pid=123459) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 09:01:32.665933 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-efeec2d9-fd91-4799-8a64-d7b6ca219be3 tempest-VolumesActionsTest-1161299678 tempest-VolumesActionsTest-1161299678-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:01:32.666380 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-efeec2d9-fd91-4799-8a64-d7b6ca219be3 tempest-VolumesActionsTest-1161299678 tempest-VolumesActionsTest-1161299678-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:01:32.667193 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-efeec2d9-fd91-4799-8a64-d7b6ca219be3 tempest-VolumesActionsTest-1161299678 tempest-VolumesActionsTest-1161299678-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:01:32.667625 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-efeec2d9-fd91-4799-8a64-d7b6ca219be3 tempest-VolumesActionsTest-1161299678 tempest-VolumesActionsTest-1161299678-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:01:32.825427 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-efeec2d9-fd91-4799-8a64-d7b6ca219be3 tempest-VolumesActionsTest-1161299678 tempest-VolumesActionsTest-1161299678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69102e11c4bd405eab82f8a1666ebba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd538edac912247ebbaf05b22dfa6dad6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 09:01:32.837579 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-efeec2d9-fd91-4799-8a64-d7b6ca219be3 tempest-VolumesActionsTest-1161299678 tempest-VolumesActionsTest-1161299678-project] 10.222.0.31 "GET /compute/v2.1/servers/4240f73c-c195-444d-ab09-34d6a34f7614" status: 200 len: 1314 microversion: 2.1 time: 0.185839 Apr 29 09:01:32.838216 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 543/1092] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 09:01:32 2022] GET /compute/v2.1/servers/4240f73c-c195-444d-ab09-34d6a34f7614 => generated 1314 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 09:01:33.507475 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-c546a98b-1566-41bc-bec9-7c653db6dd69 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Calling method '>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 09:01:33.509057 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-c546a98b-1566-41bc-bec9-7c653db6dd69 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] [instance: e74dc909-2e3d-4acb-a05a-ed18d4c0f699] Fetching instance by UUID {{(pid=123458) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 09:01:33.515821 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-c546a98b-1566-41bc-bec9-7c653db6dd69 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:01:33.516297 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-c546a98b-1566-41bc-bec9-7c653db6dd69 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:01:33.517106 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-c546a98b-1566-41bc-bec9-7c653db6dd69 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:01:33.517561 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-c546a98b-1566-41bc-bec9-7c653db6dd69 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:01:33.678424 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-c546a98b-1566-41bc-bec9-7c653db6dd69 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 09:01:33.687818 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-c546a98b-1566-41bc-bec9-7c653db6dd69 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 09:01:33.689416 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-c546a98b-1566-41bc-bec9-7c653db6dd69 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 09:01:33.690604 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-c546a98b-1566-41bc-bec9-7c653db6dd69 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] 10.222.0.31 "GET /compute/v2.1/servers/e74dc909-2e3d-4acb-a05a-ed18d4c0f699" status: 200 len: 1731 microversion: 2.20 time: 0.187485 Apr 29 09:01:33.694227 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 550/1093] 10.222.0.31 () {60 vars in 1276 bytes} [Fri Apr 29 09:01:33 2022] GET /compute/v2.1/servers/e74dc909-2e3d-4acb-a05a-ed18d4c0f699 => generated 1731 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 29 09:01:33.855533 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-eb3a862f-1bd2-44e9-a1fb-01a4b73fecc6 tempest-VolumesActionsTest-1161299678 tempest-VolumesActionsTest-1161299678-project] Calling method '>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 09:01:33.856400 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-eb3a862f-1bd2-44e9-a1fb-01a4b73fecc6 tempest-VolumesActionsTest-1161299678 tempest-VolumesActionsTest-1161299678-project] [instance: 4240f73c-c195-444d-ab09-34d6a34f7614] Fetching instance by UUID {{(pid=123459) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 09:01:33.863082 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-eb3a862f-1bd2-44e9-a1fb-01a4b73fecc6 tempest-VolumesActionsTest-1161299678 tempest-VolumesActionsTest-1161299678-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:01:33.863583 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-eb3a862f-1bd2-44e9-a1fb-01a4b73fecc6 tempest-VolumesActionsTest-1161299678 tempest-VolumesActionsTest-1161299678-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:01:33.864397 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-eb3a862f-1bd2-44e9-a1fb-01a4b73fecc6 tempest-VolumesActionsTest-1161299678 tempest-VolumesActionsTest-1161299678-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:01:33.864831 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-eb3a862f-1bd2-44e9-a1fb-01a4b73fecc6 tempest-VolumesActionsTest-1161299678 tempest-VolumesActionsTest-1161299678-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:01:34.016907 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-eb3a862f-1bd2-44e9-a1fb-01a4b73fecc6 tempest-VolumesActionsTest-1161299678 tempest-VolumesActionsTest-1161299678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69102e11c4bd405eab82f8a1666ebba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd538edac912247ebbaf05b22dfa6dad6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 09:01:34.025355 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-eb3a862f-1bd2-44e9-a1fb-01a4b73fecc6 tempest-VolumesActionsTest-1161299678 tempest-VolumesActionsTest-1161299678-project] 10.222.0.31 "GET /compute/v2.1/servers/4240f73c-c195-444d-ab09-34d6a34f7614" status: 200 len: 1314 microversion: 2.1 time: 0.173806 Apr 29 09:01:34.026151 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 544/1094] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 09:01:33 2022] GET /compute/v2.1/servers/4240f73c-c195-444d-ab09-34d6a34f7614 => generated 1314 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 09:01:34.710120 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-a25d2b63-7e30-4652-8746-fa655f4fe228 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Calling method '>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 09:01:34.711426 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-a25d2b63-7e30-4652-8746-fa655f4fe228 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] [instance: e74dc909-2e3d-4acb-a05a-ed18d4c0f699] Fetching instance by UUID {{(pid=123458) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 09:01:34.718249 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-a25d2b63-7e30-4652-8746-fa655f4fe228 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:01:34.718690 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-a25d2b63-7e30-4652-8746-fa655f4fe228 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:01:34.719483 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-a25d2b63-7e30-4652-8746-fa655f4fe228 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:01:34.719928 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-a25d2b63-7e30-4652-8746-fa655f4fe228 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:01:34.862497 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-a25d2b63-7e30-4652-8746-fa655f4fe228 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 09:01:34.872230 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-a25d2b63-7e30-4652-8746-fa655f4fe228 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 09:01:34.874245 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-a25d2b63-7e30-4652-8746-fa655f4fe228 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 09:01:34.875546 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-a25d2b63-7e30-4652-8746-fa655f4fe228 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] 10.222.0.31 "GET /compute/v2.1/servers/e74dc909-2e3d-4acb-a05a-ed18d4c0f699" status: 200 len: 1731 microversion: 2.20 time: 0.169362 Apr 29 09:01:34.876350 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 551/1095] 10.222.0.31 () {60 vars in 1276 bytes} [Fri Apr 29 09:01:34 2022] GET /compute/v2.1/servers/e74dc909-2e3d-4acb-a05a-ed18d4c0f699 => generated 1731 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 29 09:01:35.043084 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-f6d6f90d-9a85-41a4-8bc9-b23877eaf443 tempest-VolumesActionsTest-1161299678 tempest-VolumesActionsTest-1161299678-project] Calling method '>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 09:01:35.043643 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-f6d6f90d-9a85-41a4-8bc9-b23877eaf443 tempest-VolumesActionsTest-1161299678 tempest-VolumesActionsTest-1161299678-project] [instance: 4240f73c-c195-444d-ab09-34d6a34f7614] Fetching instance by UUID {{(pid=123459) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 09:01:35.051159 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-f6d6f90d-9a85-41a4-8bc9-b23877eaf443 tempest-VolumesActionsTest-1161299678 tempest-VolumesActionsTest-1161299678-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:01:35.051607 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-f6d6f90d-9a85-41a4-8bc9-b23877eaf443 tempest-VolumesActionsTest-1161299678 tempest-VolumesActionsTest-1161299678-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:01:35.052423 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-f6d6f90d-9a85-41a4-8bc9-b23877eaf443 tempest-VolumesActionsTest-1161299678 tempest-VolumesActionsTest-1161299678-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:01:35.052863 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-f6d6f90d-9a85-41a4-8bc9-b23877eaf443 tempest-VolumesActionsTest-1161299678 tempest-VolumesActionsTest-1161299678-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:01:35.192944 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-f6d6f90d-9a85-41a4-8bc9-b23877eaf443 tempest-VolumesActionsTest-1161299678 tempest-VolumesActionsTest-1161299678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69102e11c4bd405eab82f8a1666ebba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd538edac912247ebbaf05b22dfa6dad6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 09:01:35.201487 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-f6d6f90d-9a85-41a4-8bc9-b23877eaf443 tempest-VolumesActionsTest-1161299678 tempest-VolumesActionsTest-1161299678-project] 10.222.0.31 "GET /compute/v2.1/servers/4240f73c-c195-444d-ab09-34d6a34f7614" status: 200 len: 1314 microversion: 2.1 time: 0.162794 Apr 29 09:01:35.202146 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 545/1096] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 09:01:35 2022] GET /compute/v2.1/servers/4240f73c-c195-444d-ab09-34d6a34f7614 => generated 1314 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 09:01:35.896622 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-bea60d75-03dc-449f-b6db-e5ba92661811 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Calling method '>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 09:01:35.897973 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-bea60d75-03dc-449f-b6db-e5ba92661811 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] [instance: e74dc909-2e3d-4acb-a05a-ed18d4c0f699] Fetching instance by UUID {{(pid=123458) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 09:01:35.907940 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-bea60d75-03dc-449f-b6db-e5ba92661811 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:01:35.908598 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-bea60d75-03dc-449f-b6db-e5ba92661811 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:01:35.909411 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-bea60d75-03dc-449f-b6db-e5ba92661811 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:01:35.909965 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-bea60d75-03dc-449f-b6db-e5ba92661811 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:01:36.061311 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-bea60d75-03dc-449f-b6db-e5ba92661811 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 09:01:36.070039 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-bea60d75-03dc-449f-b6db-e5ba92661811 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 09:01:36.072119 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-bea60d75-03dc-449f-b6db-e5ba92661811 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 09:01:36.073473 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-bea60d75-03dc-449f-b6db-e5ba92661811 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] 10.222.0.31 "GET /compute/v2.1/servers/e74dc909-2e3d-4acb-a05a-ed18d4c0f699" status: 200 len: 1731 microversion: 2.20 time: 0.180686 Apr 29 09:01:36.074046 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 552/1097] 10.222.0.31 () {60 vars in 1276 bytes} [Fri Apr 29 09:01:35 2022] GET /compute/v2.1/servers/e74dc909-2e3d-4acb-a05a-ed18d4c0f699 => generated 1731 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 29 09:01:36.219698 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-ef980b75-5ef4-4e5b-be01-066d2a023a9f tempest-VolumesActionsTest-1161299678 tempest-VolumesActionsTest-1161299678-project] Calling method '>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 09:01:36.220382 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-ef980b75-5ef4-4e5b-be01-066d2a023a9f tempest-VolumesActionsTest-1161299678 tempest-VolumesActionsTest-1161299678-project] [instance: 4240f73c-c195-444d-ab09-34d6a34f7614] Fetching instance by UUID {{(pid=123459) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 09:01:36.227738 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-ef980b75-5ef4-4e5b-be01-066d2a023a9f tempest-VolumesActionsTest-1161299678 tempest-VolumesActionsTest-1161299678-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:01:36.228224 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-ef980b75-5ef4-4e5b-be01-066d2a023a9f tempest-VolumesActionsTest-1161299678 tempest-VolumesActionsTest-1161299678-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:01:36.228998 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-ef980b75-5ef4-4e5b-be01-066d2a023a9f tempest-VolumesActionsTest-1161299678 tempest-VolumesActionsTest-1161299678-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:01:36.229433 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-ef980b75-5ef4-4e5b-be01-066d2a023a9f tempest-VolumesActionsTest-1161299678 tempest-VolumesActionsTest-1161299678-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:01:36.378470 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-ef980b75-5ef4-4e5b-be01-066d2a023a9f tempest-VolumesActionsTest-1161299678 tempest-VolumesActionsTest-1161299678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69102e11c4bd405eab82f8a1666ebba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd538edac912247ebbaf05b22dfa6dad6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 09:01:36.390826 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-ef980b75-5ef4-4e5b-be01-066d2a023a9f tempest-VolumesActionsTest-1161299678 tempest-VolumesActionsTest-1161299678-project] 10.222.0.31 "GET /compute/v2.1/servers/4240f73c-c195-444d-ab09-34d6a34f7614" status: 200 len: 1314 microversion: 2.1 time: 0.175280 Apr 29 09:01:36.392072 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 546/1098] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 09:01:36 2022] GET /compute/v2.1/servers/4240f73c-c195-444d-ab09-34d6a34f7614 => generated 1314 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 29 09:01:37.092640 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-f1a68452-b54a-4d40-947f-4465bb731afb tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Calling method '>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 09:01:37.093275 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-f1a68452-b54a-4d40-947f-4465bb731afb tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] [instance: e74dc909-2e3d-4acb-a05a-ed18d4c0f699] Fetching instance by UUID {{(pid=123458) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 09:01:37.099600 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-f1a68452-b54a-4d40-947f-4465bb731afb tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:01:37.100327 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-f1a68452-b54a-4d40-947f-4465bb731afb tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:01:37.101296 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-f1a68452-b54a-4d40-947f-4465bb731afb tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:01:37.101733 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-f1a68452-b54a-4d40-947f-4465bb731afb tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:01:37.242843 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-f1a68452-b54a-4d40-947f-4465bb731afb tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 09:01:37.253222 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-f1a68452-b54a-4d40-947f-4465bb731afb tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 09:01:37.254834 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-f1a68452-b54a-4d40-947f-4465bb731afb tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 09:01:37.256193 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-f1a68452-b54a-4d40-947f-4465bb731afb tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] 10.222.0.31 "GET /compute/v2.1/servers/e74dc909-2e3d-4acb-a05a-ed18d4c0f699" status: 200 len: 1731 microversion: 2.20 time: 0.168389 Apr 29 09:01:37.257036 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 553/1099] 10.222.0.31 () {60 vars in 1276 bytes} [Fri Apr 29 09:01:37 2022] GET /compute/v2.1/servers/e74dc909-2e3d-4acb-a05a-ed18d4c0f699 => generated 1731 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 29 09:01:37.408813 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-addd9e80-1831-41e7-a2f6-ab51c108286e tempest-VolumesActionsTest-1161299678 tempest-VolumesActionsTest-1161299678-project] Calling method '>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 09:01:37.409559 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-addd9e80-1831-41e7-a2f6-ab51c108286e tempest-VolumesActionsTest-1161299678 tempest-VolumesActionsTest-1161299678-project] [instance: 4240f73c-c195-444d-ab09-34d6a34f7614] Fetching instance by UUID {{(pid=123459) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 09:01:37.417157 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-addd9e80-1831-41e7-a2f6-ab51c108286e tempest-VolumesActionsTest-1161299678 tempest-VolumesActionsTest-1161299678-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:01:37.417609 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-addd9e80-1831-41e7-a2f6-ab51c108286e tempest-VolumesActionsTest-1161299678 tempest-VolumesActionsTest-1161299678-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:01:37.418406 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-addd9e80-1831-41e7-a2f6-ab51c108286e tempest-VolumesActionsTest-1161299678 tempest-VolumesActionsTest-1161299678-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:01:37.418843 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-addd9e80-1831-41e7-a2f6-ab51c108286e tempest-VolumesActionsTest-1161299678 tempest-VolumesActionsTest-1161299678-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:01:37.564271 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-addd9e80-1831-41e7-a2f6-ab51c108286e tempest-VolumesActionsTest-1161299678 tempest-VolumesActionsTest-1161299678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69102e11c4bd405eab82f8a1666ebba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd538edac912247ebbaf05b22dfa6dad6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 09:01:37.572803 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-addd9e80-1831-41e7-a2f6-ab51c108286e tempest-VolumesActionsTest-1161299678 tempest-VolumesActionsTest-1161299678-project] 10.222.0.31 "GET /compute/v2.1/servers/4240f73c-c195-444d-ab09-34d6a34f7614" status: 200 len: 1314 microversion: 2.1 time: 0.167793 Apr 29 09:01:37.573838 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 547/1100] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 09:01:37 2022] GET /compute/v2.1/servers/4240f73c-c195-444d-ab09-34d6a34f7614 => generated 1314 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 09:01:38.275526 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-38b9bbc4-e8f9-4a5e-9119-0e04b6a6222d tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Calling method '>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 09:01:38.276118 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-38b9bbc4-e8f9-4a5e-9119-0e04b6a6222d tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] [instance: e74dc909-2e3d-4acb-a05a-ed18d4c0f699] Fetching instance by UUID {{(pid=123458) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 09:01:38.282559 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-38b9bbc4-e8f9-4a5e-9119-0e04b6a6222d tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:01:38.283004 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-38b9bbc4-e8f9-4a5e-9119-0e04b6a6222d tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:01:38.283773 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-38b9bbc4-e8f9-4a5e-9119-0e04b6a6222d tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:01:38.284236 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-38b9bbc4-e8f9-4a5e-9119-0e04b6a6222d tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:01:38.419483 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-38b9bbc4-e8f9-4a5e-9119-0e04b6a6222d tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 09:01:38.427975 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-38b9bbc4-e8f9-4a5e-9119-0e04b6a6222d tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 09:01:38.429505 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-38b9bbc4-e8f9-4a5e-9119-0e04b6a6222d tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 09:01:38.430713 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-38b9bbc4-e8f9-4a5e-9119-0e04b6a6222d tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] 10.222.0.31 "GET /compute/v2.1/servers/e74dc909-2e3d-4acb-a05a-ed18d4c0f699" status: 200 len: 1731 microversion: 2.20 time: 0.159736 Apr 29 09:01:38.431273 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 554/1101] 10.222.0.31 () {60 vars in 1276 bytes} [Fri Apr 29 09:01:38 2022] GET /compute/v2.1/servers/e74dc909-2e3d-4acb-a05a-ed18d4c0f699 => generated 1731 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 29 09:01:38.590891 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-8d81ce07-062e-4943-9e8e-3df026862c32 tempest-VolumesActionsTest-1161299678 tempest-VolumesActionsTest-1161299678-project] Calling method '>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 09:01:38.591531 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-8d81ce07-062e-4943-9e8e-3df026862c32 tempest-VolumesActionsTest-1161299678 tempest-VolumesActionsTest-1161299678-project] [instance: 4240f73c-c195-444d-ab09-34d6a34f7614] Fetching instance by UUID {{(pid=123459) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 09:01:38.598351 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-8d81ce07-062e-4943-9e8e-3df026862c32 tempest-VolumesActionsTest-1161299678 tempest-VolumesActionsTest-1161299678-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:01:38.598805 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-8d81ce07-062e-4943-9e8e-3df026862c32 tempest-VolumesActionsTest-1161299678 tempest-VolumesActionsTest-1161299678-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:01:38.599603 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-8d81ce07-062e-4943-9e8e-3df026862c32 tempest-VolumesActionsTest-1161299678 tempest-VolumesActionsTest-1161299678-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:01:38.600043 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-8d81ce07-062e-4943-9e8e-3df026862c32 tempest-VolumesActionsTest-1161299678 tempest-VolumesActionsTest-1161299678-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:01:38.733638 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-8d81ce07-062e-4943-9e8e-3df026862c32 tempest-VolumesActionsTest-1161299678 tempest-VolumesActionsTest-1161299678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69102e11c4bd405eab82f8a1666ebba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd538edac912247ebbaf05b22dfa6dad6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 09:01:38.741004 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-8d81ce07-062e-4943-9e8e-3df026862c32 tempest-VolumesActionsTest-1161299678 tempest-VolumesActionsTest-1161299678-project] 10.222.0.31 "GET /compute/v2.1/servers/4240f73c-c195-444d-ab09-34d6a34f7614" status: 200 len: 1314 microversion: 2.1 time: 0.155009 Apr 29 09:01:38.741571 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 548/1102] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 09:01:38 2022] GET /compute/v2.1/servers/4240f73c-c195-444d-ab09-34d6a34f7614 => generated 1314 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 09:01:39.449974 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-9fc86d57-64d7-464e-8827-7c48aba77a29 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Calling method '>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 09:01:39.450593 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-9fc86d57-64d7-464e-8827-7c48aba77a29 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] [instance: e74dc909-2e3d-4acb-a05a-ed18d4c0f699] Fetching instance by UUID {{(pid=123458) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 09:01:39.457454 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-9fc86d57-64d7-464e-8827-7c48aba77a29 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:01:39.457913 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-9fc86d57-64d7-464e-8827-7c48aba77a29 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:01:39.458724 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-9fc86d57-64d7-464e-8827-7c48aba77a29 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:01:39.459165 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-9fc86d57-64d7-464e-8827-7c48aba77a29 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:01:39.612781 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-9fc86d57-64d7-464e-8827-7c48aba77a29 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 09:01:39.621850 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-9fc86d57-64d7-464e-8827-7c48aba77a29 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 09:01:39.623361 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-9fc86d57-64d7-464e-8827-7c48aba77a29 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 09:01:39.624598 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-9fc86d57-64d7-464e-8827-7c48aba77a29 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] 10.222.0.31 "GET /compute/v2.1/servers/e74dc909-2e3d-4acb-a05a-ed18d4c0f699" status: 200 len: 1731 microversion: 2.20 time: 0.179431 Apr 29 09:01:39.625165 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 555/1103] 10.222.0.31 () {60 vars in 1276 bytes} [Fri Apr 29 09:01:39 2022] GET /compute/v2.1/servers/e74dc909-2e3d-4acb-a05a-ed18d4c0f699 => generated 1731 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 29 09:01:39.757604 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-6285dfd0-0984-4ad7-8b7e-c6832fb8bb41 tempest-VolumesActionsTest-1161299678 tempest-VolumesActionsTest-1161299678-project] Calling method '>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 09:01:39.758286 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-6285dfd0-0984-4ad7-8b7e-c6832fb8bb41 tempest-VolumesActionsTest-1161299678 tempest-VolumesActionsTest-1161299678-project] [instance: 4240f73c-c195-444d-ab09-34d6a34f7614] Fetching instance by UUID {{(pid=123459) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 09:01:39.764805 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-6285dfd0-0984-4ad7-8b7e-c6832fb8bb41 tempest-VolumesActionsTest-1161299678 tempest-VolumesActionsTest-1161299678-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:01:39.765522 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-6285dfd0-0984-4ad7-8b7e-c6832fb8bb41 tempest-VolumesActionsTest-1161299678 tempest-VolumesActionsTest-1161299678-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:01:39.766028 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-6285dfd0-0984-4ad7-8b7e-c6832fb8bb41 tempest-VolumesActionsTest-1161299678 tempest-VolumesActionsTest-1161299678-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:01:39.766494 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-6285dfd0-0984-4ad7-8b7e-c6832fb8bb41 tempest-VolumesActionsTest-1161299678 tempest-VolumesActionsTest-1161299678-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:01:39.902459 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-6285dfd0-0984-4ad7-8b7e-c6832fb8bb41 tempest-VolumesActionsTest-1161299678 tempest-VolumesActionsTest-1161299678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69102e11c4bd405eab82f8a1666ebba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd538edac912247ebbaf05b22dfa6dad6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 09:01:39.909797 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-6285dfd0-0984-4ad7-8b7e-c6832fb8bb41 tempest-VolumesActionsTest-1161299678 tempest-VolumesActionsTest-1161299678-project] 10.222.0.31 "GET /compute/v2.1/servers/4240f73c-c195-444d-ab09-34d6a34f7614" status: 200 len: 1314 microversion: 2.1 time: 0.156013 Apr 29 09:01:39.910613 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 549/1104] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 09:01:39 2022] GET /compute/v2.1/servers/4240f73c-c195-444d-ab09-34d6a34f7614 => generated 1314 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 09:01:40.643194 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-e70b0dda-a020-4a31-9d4b-578d0cb8bef6 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Calling method '>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 09:01:40.643789 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-e70b0dda-a020-4a31-9d4b-578d0cb8bef6 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] [instance: e74dc909-2e3d-4acb-a05a-ed18d4c0f699] Fetching instance by UUID {{(pid=123458) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 09:01:40.650221 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-e70b0dda-a020-4a31-9d4b-578d0cb8bef6 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:01:40.650668 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-e70b0dda-a020-4a31-9d4b-578d0cb8bef6 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:01:40.651449 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-e70b0dda-a020-4a31-9d4b-578d0cb8bef6 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:01:40.651892 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-e70b0dda-a020-4a31-9d4b-578d0cb8bef6 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:01:40.782715 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-e70b0dda-a020-4a31-9d4b-578d0cb8bef6 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 09:01:40.791288 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-e70b0dda-a020-4a31-9d4b-578d0cb8bef6 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 09:01:40.792825 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-e70b0dda-a020-4a31-9d4b-578d0cb8bef6 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 09:01:40.793992 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-e70b0dda-a020-4a31-9d4b-578d0cb8bef6 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] 10.222.0.31 "GET /compute/v2.1/servers/e74dc909-2e3d-4acb-a05a-ed18d4c0f699" status: 200 len: 1731 microversion: 2.20 time: 0.154816 Apr 29 09:01:40.794550 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 556/1105] 10.222.0.31 () {60 vars in 1276 bytes} [Fri Apr 29 09:01:40 2022] GET /compute/v2.1/servers/e74dc909-2e3d-4acb-a05a-ed18d4c0f699 => generated 1731 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 29 09:01:40.927003 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-d2cf5392-2f5c-4bd8-b1b3-635d8fb92d60 tempest-VolumesActionsTest-1161299678 tempest-VolumesActionsTest-1161299678-project] Calling method '>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 09:01:40.927550 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-d2cf5392-2f5c-4bd8-b1b3-635d8fb92d60 tempest-VolumesActionsTest-1161299678 tempest-VolumesActionsTest-1161299678-project] [instance: 4240f73c-c195-444d-ab09-34d6a34f7614] Fetching instance by UUID {{(pid=123459) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 09:01:40.935305 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-d2cf5392-2f5c-4bd8-b1b3-635d8fb92d60 tempest-VolumesActionsTest-1161299678 tempest-VolumesActionsTest-1161299678-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:01:40.935753 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-d2cf5392-2f5c-4bd8-b1b3-635d8fb92d60 tempest-VolumesActionsTest-1161299678 tempest-VolumesActionsTest-1161299678-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:01:40.936574 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-d2cf5392-2f5c-4bd8-b1b3-635d8fb92d60 tempest-VolumesActionsTest-1161299678 tempest-VolumesActionsTest-1161299678-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:01:40.937017 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-d2cf5392-2f5c-4bd8-b1b3-635d8fb92d60 tempest-VolumesActionsTest-1161299678 tempest-VolumesActionsTest-1161299678-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:01:41.068408 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-d2cf5392-2f5c-4bd8-b1b3-635d8fb92d60 tempest-VolumesActionsTest-1161299678 tempest-VolumesActionsTest-1161299678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69102e11c4bd405eab82f8a1666ebba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd538edac912247ebbaf05b22dfa6dad6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 09:01:41.075960 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-d2cf5392-2f5c-4bd8-b1b3-635d8fb92d60 tempest-VolumesActionsTest-1161299678 tempest-VolumesActionsTest-1161299678-project] 10.222.0.31 "GET /compute/v2.1/servers/4240f73c-c195-444d-ab09-34d6a34f7614" status: 200 len: 1314 microversion: 2.1 time: 0.152902 Apr 29 09:01:41.076583 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 550/1106] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 09:01:40 2022] GET /compute/v2.1/servers/4240f73c-c195-444d-ab09-34d6a34f7614 => generated 1314 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 09:01:41.812904 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-3b75c3ab-2f1f-4f8e-885e-d8a676a1b4ca tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Calling method '>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 09:01:41.813540 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-3b75c3ab-2f1f-4f8e-885e-d8a676a1b4ca tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] [instance: e74dc909-2e3d-4acb-a05a-ed18d4c0f699] Fetching instance by UUID {{(pid=123458) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 09:01:41.819877 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-3b75c3ab-2f1f-4f8e-885e-d8a676a1b4ca tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:01:41.820934 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-3b75c3ab-2f1f-4f8e-885e-d8a676a1b4ca tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:01:41.821815 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-3b75c3ab-2f1f-4f8e-885e-d8a676a1b4ca tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:01:41.822244 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-3b75c3ab-2f1f-4f8e-885e-d8a676a1b4ca tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:01:41.967123 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-3b75c3ab-2f1f-4f8e-885e-d8a676a1b4ca tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 09:01:41.975410 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-3b75c3ab-2f1f-4f8e-885e-d8a676a1b4ca tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 09:01:41.977008 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-3b75c3ab-2f1f-4f8e-885e-d8a676a1b4ca tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 09:01:41.978177 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-3b75c3ab-2f1f-4f8e-885e-d8a676a1b4ca tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] 10.222.0.31 "GET /compute/v2.1/servers/e74dc909-2e3d-4acb-a05a-ed18d4c0f699" status: 200 len: 1731 microversion: 2.20 time: 0.169174 Apr 29 09:01:41.978732 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 557/1107] 10.222.0.31 () {60 vars in 1276 bytes} [Fri Apr 29 09:01:41 2022] GET /compute/v2.1/servers/e74dc909-2e3d-4acb-a05a-ed18d4c0f699 => generated 1731 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 29 09:01:42.093426 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-fb18e1bd-4b77-4178-b743-85bc9b0fade4 tempest-VolumesActionsTest-1161299678 tempest-VolumesActionsTest-1161299678-project] Calling method '>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 09:01:42.093989 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-fb18e1bd-4b77-4178-b743-85bc9b0fade4 tempest-VolumesActionsTest-1161299678 tempest-VolumesActionsTest-1161299678-project] [instance: 4240f73c-c195-444d-ab09-34d6a34f7614] Fetching instance by UUID {{(pid=123459) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 09:01:42.100665 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-fb18e1bd-4b77-4178-b743-85bc9b0fade4 tempest-VolumesActionsTest-1161299678 tempest-VolumesActionsTest-1161299678-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:01:42.100895 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-fb18e1bd-4b77-4178-b743-85bc9b0fade4 tempest-VolumesActionsTest-1161299678 tempest-VolumesActionsTest-1161299678-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:01:42.102266 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-fb18e1bd-4b77-4178-b743-85bc9b0fade4 tempest-VolumesActionsTest-1161299678 tempest-VolumesActionsTest-1161299678-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:01:42.102736 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-fb18e1bd-4b77-4178-b743-85bc9b0fade4 tempest-VolumesActionsTest-1161299678 tempest-VolumesActionsTest-1161299678-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:01:42.235656 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-fb18e1bd-4b77-4178-b743-85bc9b0fade4 tempest-VolumesActionsTest-1161299678 tempest-VolumesActionsTest-1161299678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69102e11c4bd405eab82f8a1666ebba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd538edac912247ebbaf05b22dfa6dad6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 09:01:42.244255 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-fb18e1bd-4b77-4178-b743-85bc9b0fade4 tempest-VolumesActionsTest-1161299678 tempest-VolumesActionsTest-1161299678-project] 10.222.0.31 "GET /compute/v2.1/servers/4240f73c-c195-444d-ab09-34d6a34f7614" status: 200 len: 1314 microversion: 2.1 time: 0.154815 Apr 29 09:01:42.244847 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 551/1108] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 09:01:42 2022] GET /compute/v2.1/servers/4240f73c-c195-444d-ab09-34d6a34f7614 => generated 1314 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 09:01:42.997465 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-fae1ff08-95a8-4560-b23c-935b5fdfb904 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Calling method '>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 09:01:42.998062 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-fae1ff08-95a8-4560-b23c-935b5fdfb904 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] [instance: e74dc909-2e3d-4acb-a05a-ed18d4c0f699] Fetching instance by UUID {{(pid=123458) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 09:01:43.004876 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-fae1ff08-95a8-4560-b23c-935b5fdfb904 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:01:43.005321 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-fae1ff08-95a8-4560-b23c-935b5fdfb904 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:01:43.006108 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-fae1ff08-95a8-4560-b23c-935b5fdfb904 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:01:43.006606 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-fae1ff08-95a8-4560-b23c-935b5fdfb904 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:01:43.145690 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-fae1ff08-95a8-4560-b23c-935b5fdfb904 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 09:01:43.155878 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-fae1ff08-95a8-4560-b23c-935b5fdfb904 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 09:01:43.157496 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-fae1ff08-95a8-4560-b23c-935b5fdfb904 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 09:01:43.158679 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-fae1ff08-95a8-4560-b23c-935b5fdfb904 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] 10.222.0.31 "GET /compute/v2.1/servers/e74dc909-2e3d-4acb-a05a-ed18d4c0f699" status: 200 len: 1731 microversion: 2.20 time: 0.165530 Apr 29 09:01:43.159246 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 558/1109] 10.222.0.31 () {60 vars in 1276 bytes} [Fri Apr 29 09:01:42 2022] GET /compute/v2.1/servers/e74dc909-2e3d-4acb-a05a-ed18d4c0f699 => generated 1731 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 29 09:01:43.263895 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-7ecc58e6-fd46-437d-9747-c80a34592fe2 tempest-VolumesActionsTest-1161299678 tempest-VolumesActionsTest-1161299678-project] Calling method '>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 09:01:43.264914 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-7ecc58e6-fd46-437d-9747-c80a34592fe2 tempest-VolumesActionsTest-1161299678 tempest-VolumesActionsTest-1161299678-project] [instance: 4240f73c-c195-444d-ab09-34d6a34f7614] Fetching instance by UUID {{(pid=123459) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 09:01:43.272522 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-7ecc58e6-fd46-437d-9747-c80a34592fe2 tempest-VolumesActionsTest-1161299678 tempest-VolumesActionsTest-1161299678-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:01:43.272973 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-7ecc58e6-fd46-437d-9747-c80a34592fe2 tempest-VolumesActionsTest-1161299678 tempest-VolumesActionsTest-1161299678-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:01:43.274617 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-7ecc58e6-fd46-437d-9747-c80a34592fe2 tempest-VolumesActionsTest-1161299678 tempest-VolumesActionsTest-1161299678-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:01:43.275076 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-7ecc58e6-fd46-437d-9747-c80a34592fe2 tempest-VolumesActionsTest-1161299678 tempest-VolumesActionsTest-1161299678-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:01:43.406911 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-7ecc58e6-fd46-437d-9747-c80a34592fe2 tempest-VolumesActionsTest-1161299678 tempest-VolumesActionsTest-1161299678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69102e11c4bd405eab82f8a1666ebba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd538edac912247ebbaf05b22dfa6dad6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 09:01:43.415054 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-7ecc58e6-fd46-437d-9747-c80a34592fe2 tempest-VolumesActionsTest-1161299678 tempest-VolumesActionsTest-1161299678-project] 10.222.0.31 "GET /compute/v2.1/servers/4240f73c-c195-444d-ab09-34d6a34f7614" status: 200 len: 1314 microversion: 2.1 time: 0.155683 Apr 29 09:01:43.415787 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 552/1110] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 09:01:43 2022] GET /compute/v2.1/servers/4240f73c-c195-444d-ab09-34d6a34f7614 => generated 1314 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 09:01:44.177619 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-69958038-47aa-4fb7-8412-7e8404a35875 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Calling method '>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 09:01:44.178217 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-69958038-47aa-4fb7-8412-7e8404a35875 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] [instance: e74dc909-2e3d-4acb-a05a-ed18d4c0f699] Fetching instance by UUID {{(pid=123458) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 09:01:44.185238 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-69958038-47aa-4fb7-8412-7e8404a35875 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:01:44.185628 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-69958038-47aa-4fb7-8412-7e8404a35875 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:01:44.186405 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-69958038-47aa-4fb7-8412-7e8404a35875 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:01:44.186847 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-69958038-47aa-4fb7-8412-7e8404a35875 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:01:44.317843 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-69958038-47aa-4fb7-8412-7e8404a35875 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 09:01:44.326571 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-69958038-47aa-4fb7-8412-7e8404a35875 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 09:01:44.328227 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-69958038-47aa-4fb7-8412-7e8404a35875 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 09:01:44.329463 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-69958038-47aa-4fb7-8412-7e8404a35875 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] 10.222.0.31 "GET /compute/v2.1/servers/e74dc909-2e3d-4acb-a05a-ed18d4c0f699" status: 200 len: 1731 microversion: 2.20 time: 0.155772 Apr 29 09:01:44.330032 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 559/1111] 10.222.0.31 () {60 vars in 1276 bytes} [Fri Apr 29 09:01:44 2022] GET /compute/v2.1/servers/e74dc909-2e3d-4acb-a05a-ed18d4c0f699 => generated 1731 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 29 09:01:44.432319 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-3b879edb-4189-49b9-a20b-d956ee761125 tempest-VolumesActionsTest-1161299678 tempest-VolumesActionsTest-1161299678-project] Calling method '>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 09:01:44.432937 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-3b879edb-4189-49b9-a20b-d956ee761125 tempest-VolumesActionsTest-1161299678 tempest-VolumesActionsTest-1161299678-project] [instance: 4240f73c-c195-444d-ab09-34d6a34f7614] Fetching instance by UUID {{(pid=123459) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 09:01:44.439363 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-3b879edb-4189-49b9-a20b-d956ee761125 tempest-VolumesActionsTest-1161299678 tempest-VolumesActionsTest-1161299678-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:01:44.439754 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-3b879edb-4189-49b9-a20b-d956ee761125 tempest-VolumesActionsTest-1161299678 tempest-VolumesActionsTest-1161299678-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:01:44.440563 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-3b879edb-4189-49b9-a20b-d956ee761125 tempest-VolumesActionsTest-1161299678 tempest-VolumesActionsTest-1161299678-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:01:44.441003 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-3b879edb-4189-49b9-a20b-d956ee761125 tempest-VolumesActionsTest-1161299678 tempest-VolumesActionsTest-1161299678-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:01:44.567401 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-3b879edb-4189-49b9-a20b-d956ee761125 tempest-VolumesActionsTest-1161299678 tempest-VolumesActionsTest-1161299678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69102e11c4bd405eab82f8a1666ebba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd538edac912247ebbaf05b22dfa6dad6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 09:01:44.575862 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-3b879edb-4189-49b9-a20b-d956ee761125 tempest-VolumesActionsTest-1161299678 tempest-VolumesActionsTest-1161299678-project] 10.222.0.31 "GET /compute/v2.1/servers/4240f73c-c195-444d-ab09-34d6a34f7614" status: 200 len: 1314 microversion: 2.1 time: 0.147992 Apr 29 09:01:44.576461 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 553/1112] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 09:01:44 2022] GET /compute/v2.1/servers/4240f73c-c195-444d-ab09-34d6a34f7614 => generated 1314 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 09:01:45.347655 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-ab36c8ed-9330-4c34-a777-f338e132d5b6 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Calling method '>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 09:01:45.348313 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-ab36c8ed-9330-4c34-a777-f338e132d5b6 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] [instance: e74dc909-2e3d-4acb-a05a-ed18d4c0f699] Fetching instance by UUID {{(pid=123458) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 09:01:45.355345 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-ab36c8ed-9330-4c34-a777-f338e132d5b6 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:01:45.355798 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-ab36c8ed-9330-4c34-a777-f338e132d5b6 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:01:45.356609 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-ab36c8ed-9330-4c34-a777-f338e132d5b6 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:01:45.357055 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-ab36c8ed-9330-4c34-a777-f338e132d5b6 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:01:45.488339 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-ab36c8ed-9330-4c34-a777-f338e132d5b6 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 09:01:45.497281 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-ab36c8ed-9330-4c34-a777-f338e132d5b6 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 09:01:45.498797 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-ab36c8ed-9330-4c34-a777-f338e132d5b6 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 09:01:45.499971 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-ab36c8ed-9330-4c34-a777-f338e132d5b6 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] 10.222.0.31 "GET /compute/v2.1/servers/e74dc909-2e3d-4acb-a05a-ed18d4c0f699" status: 200 len: 1731 microversion: 2.20 time: 0.156194 Apr 29 09:01:45.500555 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 560/1113] 10.222.0.31 () {60 vars in 1276 bytes} [Fri Apr 29 09:01:45 2022] GET /compute/v2.1/servers/e74dc909-2e3d-4acb-a05a-ed18d4c0f699 => generated 1731 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 29 09:01:45.594764 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-a31183d8-0a2a-4db9-b329-b6ab244138c0 tempest-VolumesActionsTest-1161299678 tempest-VolumesActionsTest-1161299678-project] Calling method '>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 09:01:45.595384 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-a31183d8-0a2a-4db9-b329-b6ab244138c0 tempest-VolumesActionsTest-1161299678 tempest-VolumesActionsTest-1161299678-project] [instance: 4240f73c-c195-444d-ab09-34d6a34f7614] Fetching instance by UUID {{(pid=123459) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 09:01:45.601816 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-a31183d8-0a2a-4db9-b329-b6ab244138c0 tempest-VolumesActionsTest-1161299678 tempest-VolumesActionsTest-1161299678-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:01:45.602211 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-a31183d8-0a2a-4db9-b329-b6ab244138c0 tempest-VolumesActionsTest-1161299678 tempest-VolumesActionsTest-1161299678-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:01:45.602989 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-a31183d8-0a2a-4db9-b329-b6ab244138c0 tempest-VolumesActionsTest-1161299678 tempest-VolumesActionsTest-1161299678-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:01:45.604022 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-a31183d8-0a2a-4db9-b329-b6ab244138c0 tempest-VolumesActionsTest-1161299678 tempest-VolumesActionsTest-1161299678-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:01:45.738180 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-a31183d8-0a2a-4db9-b329-b6ab244138c0 tempest-VolumesActionsTest-1161299678 tempest-VolumesActionsTest-1161299678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69102e11c4bd405eab82f8a1666ebba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd538edac912247ebbaf05b22dfa6dad6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 09:01:45.745527 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-a31183d8-0a2a-4db9-b329-b6ab244138c0 tempest-VolumesActionsTest-1161299678 tempest-VolumesActionsTest-1161299678-project] 10.222.0.31 "GET /compute/v2.1/servers/4240f73c-c195-444d-ab09-34d6a34f7614" status: 200 len: 1314 microversion: 2.1 time: 0.156024 Apr 29 09:01:45.746354 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 554/1114] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 09:01:45 2022] GET /compute/v2.1/servers/4240f73c-c195-444d-ab09-34d6a34f7614 => generated 1314 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 09:01:46.518367 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-a2a8d738-3ab1-422f-bee7-f6254f7fb784 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Calling method '>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 09:01:46.518981 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-a2a8d738-3ab1-422f-bee7-f6254f7fb784 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] [instance: e74dc909-2e3d-4acb-a05a-ed18d4c0f699] Fetching instance by UUID {{(pid=123458) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 09:01:46.525680 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-a2a8d738-3ab1-422f-bee7-f6254f7fb784 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:01:46.526133 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-a2a8d738-3ab1-422f-bee7-f6254f7fb784 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:01:46.527010 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-a2a8d738-3ab1-422f-bee7-f6254f7fb784 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:01:46.527445 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-a2a8d738-3ab1-422f-bee7-f6254f7fb784 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:01:46.662368 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-a2a8d738-3ab1-422f-bee7-f6254f7fb784 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 09:01:46.670282 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-a2a8d738-3ab1-422f-bee7-f6254f7fb784 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 09:01:46.671766 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-a2a8d738-3ab1-422f-bee7-f6254f7fb784 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 09:01:46.673069 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-a2a8d738-3ab1-422f-bee7-f6254f7fb784 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] 10.222.0.31 "GET /compute/v2.1/servers/e74dc909-2e3d-4acb-a05a-ed18d4c0f699" status: 200 len: 1731 microversion: 2.20 time: 0.158759 Apr 29 09:01:46.673627 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 561/1115] 10.222.0.31 () {60 vars in 1276 bytes} [Fri Apr 29 09:01:46 2022] GET /compute/v2.1/servers/e74dc909-2e3d-4acb-a05a-ed18d4c0f699 => generated 1731 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 29 09:01:46.762637 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-75732864-1c4e-4639-ab5a-7c576feb7379 tempest-VolumesActionsTest-1161299678 tempest-VolumesActionsTest-1161299678-project] Calling method '>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 09:01:46.763181 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-75732864-1c4e-4639-ab5a-7c576feb7379 tempest-VolumesActionsTest-1161299678 tempest-VolumesActionsTest-1161299678-project] [instance: 4240f73c-c195-444d-ab09-34d6a34f7614] Fetching instance by UUID {{(pid=123459) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 09:01:46.769484 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-75732864-1c4e-4639-ab5a-7c576feb7379 tempest-VolumesActionsTest-1161299678 tempest-VolumesActionsTest-1161299678-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:01:46.769914 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-75732864-1c4e-4639-ab5a-7c576feb7379 tempest-VolumesActionsTest-1161299678 tempest-VolumesActionsTest-1161299678-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:01:46.770669 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-75732864-1c4e-4639-ab5a-7c576feb7379 tempest-VolumesActionsTest-1161299678 tempest-VolumesActionsTest-1161299678-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:01:46.771101 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-75732864-1c4e-4639-ab5a-7c576feb7379 tempest-VolumesActionsTest-1161299678 tempest-VolumesActionsTest-1161299678-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:01:46.907125 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-75732864-1c4e-4639-ab5a-7c576feb7379 tempest-VolumesActionsTest-1161299678 tempest-VolumesActionsTest-1161299678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69102e11c4bd405eab82f8a1666ebba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd538edac912247ebbaf05b22dfa6dad6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 09:01:46.914351 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-75732864-1c4e-4639-ab5a-7c576feb7379 tempest-VolumesActionsTest-1161299678 tempest-VolumesActionsTest-1161299678-project] 10.222.0.31 "GET /compute/v2.1/servers/4240f73c-c195-444d-ab09-34d6a34f7614" status: 200 len: 1498 microversion: 2.1 time: 0.155772 Apr 29 09:01:46.914914 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 555/1116] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 09:01:46 2022] GET /compute/v2.1/servers/4240f73c-c195-444d-ab09-34d6a34f7614 => generated 1498 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 09:01:47.376564 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-6d74fd54-774e-45e7-8990-12a2a307a7db tempest-VolumesActionsTest-1161299678 tempest-VolumesActionsTest-1161299678-project] Calling method '>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 09:01:47.377061 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-6d74fd54-774e-45e7-8990-12a2a307a7db tempest-VolumesActionsTest-1161299678 tempest-VolumesActionsTest-1161299678-project] [instance: 4240f73c-c195-444d-ab09-34d6a34f7614] Fetching instance by UUID {{(pid=123458) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 09:01:47.382952 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-6d74fd54-774e-45e7-8990-12a2a307a7db tempest-VolumesActionsTest-1161299678 tempest-VolumesActionsTest-1161299678-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:01:47.383402 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-6d74fd54-774e-45e7-8990-12a2a307a7db tempest-VolumesActionsTest-1161299678 tempest-VolumesActionsTest-1161299678-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:01:47.384191 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-6d74fd54-774e-45e7-8990-12a2a307a7db tempest-VolumesActionsTest-1161299678 tempest-VolumesActionsTest-1161299678-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:01:47.384630 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-6d74fd54-774e-45e7-8990-12a2a307a7db tempest-VolumesActionsTest-1161299678 tempest-VolumesActionsTest-1161299678-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:01:47.409961 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-6d74fd54-774e-45e7-8990-12a2a307a7db tempest-VolumesActionsTest-1161299678 tempest-VolumesActionsTest-1161299678-project] [instance: 4240f73c-c195-444d-ab09-34d6a34f7614] Going to try to terminate instance {{(pid=123458) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 29 09:01:47.483863 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-6d74fd54-774e-45e7-8990-12a2a307a7db tempest-VolumesActionsTest-1161299678 tempest-VolumesActionsTest-1161299678-project] 10.222.0.31 "DELETE /compute/v2.1/servers/4240f73c-c195-444d-ab09-34d6a34f7614" status: 204 len: 0 microversion: 2.1 time: 0.110640 Apr 29 09:01:47.484474 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 562/1117] 10.222.0.31 () {58 vars in 1238 bytes} [Fri Apr 29 09:01:47 2022] DELETE /compute/v2.1/servers/4240f73c-c195-444d-ab09-34d6a34f7614 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 29 09:01:47.492947 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-e6c59cb2-8d1a-4756-8e7d-2a02f5b71ec2 tempest-VolumesActionsTest-1161299678 tempest-VolumesActionsTest-1161299678-project] Calling method '>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 09:01:47.493634 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-e6c59cb2-8d1a-4756-8e7d-2a02f5b71ec2 tempest-VolumesActionsTest-1161299678 tempest-VolumesActionsTest-1161299678-project] [instance: 4240f73c-c195-444d-ab09-34d6a34f7614] Fetching instance by UUID {{(pid=123459) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 09:01:47.499883 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-e6c59cb2-8d1a-4756-8e7d-2a02f5b71ec2 tempest-VolumesActionsTest-1161299678 tempest-VolumesActionsTest-1161299678-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:01:47.500370 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-e6c59cb2-8d1a-4756-8e7d-2a02f5b71ec2 tempest-VolumesActionsTest-1161299678 tempest-VolumesActionsTest-1161299678-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:01:47.501140 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-e6c59cb2-8d1a-4756-8e7d-2a02f5b71ec2 tempest-VolumesActionsTest-1161299678 tempest-VolumesActionsTest-1161299678-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:01:47.501575 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-e6c59cb2-8d1a-4756-8e7d-2a02f5b71ec2 tempest-VolumesActionsTest-1161299678 tempest-VolumesActionsTest-1161299678-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:01:47.631132 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-e6c59cb2-8d1a-4756-8e7d-2a02f5b71ec2 tempest-VolumesActionsTest-1161299678 tempest-VolumesActionsTest-1161299678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69102e11c4bd405eab82f8a1666ebba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd538edac912247ebbaf05b22dfa6dad6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 09:01:47.639583 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-e6c59cb2-8d1a-4756-8e7d-2a02f5b71ec2 tempest-VolumesActionsTest-1161299678 tempest-VolumesActionsTest-1161299678-project] 10.222.0.31 "GET /compute/v2.1/servers/4240f73c-c195-444d-ab09-34d6a34f7614" status: 200 len: 1504 microversion: 2.1 time: 0.150686 Apr 29 09:01:47.640396 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 556/1118] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 09:01:47 2022] GET /compute/v2.1/servers/4240f73c-c195-444d-ab09-34d6a34f7614 => generated 1504 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 09:01:47.694097 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-d1eb7cfe-5abe-401e-b6f2-b4bfbc5dbb60 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Calling method '>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 09:01:47.694801 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-d1eb7cfe-5abe-401e-b6f2-b4bfbc5dbb60 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] [instance: e74dc909-2e3d-4acb-a05a-ed18d4c0f699] Fetching instance by UUID {{(pid=123458) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 09:01:47.702349 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-d1eb7cfe-5abe-401e-b6f2-b4bfbc5dbb60 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:01:47.702809 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-d1eb7cfe-5abe-401e-b6f2-b4bfbc5dbb60 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:01:47.703587 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-d1eb7cfe-5abe-401e-b6f2-b4bfbc5dbb60 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:01:47.704026 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-d1eb7cfe-5abe-401e-b6f2-b4bfbc5dbb60 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:01:47.840924 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-d1eb7cfe-5abe-401e-b6f2-b4bfbc5dbb60 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 09:01:47.848812 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-d1eb7cfe-5abe-401e-b6f2-b4bfbc5dbb60 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 09:01:47.850320 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-d1eb7cfe-5abe-401e-b6f2-b4bfbc5dbb60 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 09:01:47.851482 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-d1eb7cfe-5abe-401e-b6f2-b4bfbc5dbb60 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] 10.222.0.31 "GET /compute/v2.1/servers/e74dc909-2e3d-4acb-a05a-ed18d4c0f699" status: 200 len: 1731 microversion: 2.20 time: 0.161643 Apr 29 09:01:47.852051 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 563/1119] 10.222.0.31 () {60 vars in 1276 bytes} [Fri Apr 29 09:01:47 2022] GET /compute/v2.1/servers/e74dc909-2e3d-4acb-a05a-ed18d4c0f699 => generated 1731 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 29 09:01:48.016916 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [req-843a1af1-7edb-467a-bebf-7bb610a22581 req-6b623af3-a6c5-41fd-a46e-30f2cca599d8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e74dc909-2e3d-4acb-a05a-ed18d4c0f699", "name": "network-vif-plugged", "status": "completed", "tag": "440a5656-f549-48bb-8394-679abd59d5c6"}]} {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 29 09:01:48.025811 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [req-843a1af1-7edb-467a-bebf-7bb610a22581 req-6b623af3-a6c5-41fd-a46e-30f2cca599d8 service nova] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:01:48.026382 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [req-843a1af1-7edb-467a-bebf-7bb610a22581 req-6b623af3-a6c5-41fd-a46e-30f2cca599d8 service nova] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:01:48.039563 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.compute.server_external_events [req-843a1af1-7edb-467a-bebf-7bb610a22581 req-6b623af3-a6c5-41fd-a46e-30f2cca599d8 service nova] Creating event network-vif-plugged:440a5656-f549-48bb-8394-679abd59d5c6 for instance e74dc909-2e3d-4acb-a05a-ed18d4c0f699 on hv-cinder-83987 Apr 29 09:01:48.044890 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [req-843a1af1-7edb-467a-bebf-7bb610a22581 req-6b623af3-a6c5-41fd-a46e-30f2cca599d8 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031993 Apr 29 09:01:48.045725 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 557/1120] 10.222.0.31 () {64 vars in 1317 bytes} [Fri Apr 29 09:01:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 29 09:01:48.657748 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-32bee8af-48fe-447d-976f-4a4b2b9bdae3 tempest-VolumesActionsTest-1161299678 tempest-VolumesActionsTest-1161299678-project] Calling method '>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 09:01:48.658427 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-32bee8af-48fe-447d-976f-4a4b2b9bdae3 tempest-VolumesActionsTest-1161299678 tempest-VolumesActionsTest-1161299678-project] [instance: 4240f73c-c195-444d-ab09-34d6a34f7614] Fetching instance by UUID {{(pid=123458) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 09:01:48.664582 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-32bee8af-48fe-447d-976f-4a4b2b9bdae3 tempest-VolumesActionsTest-1161299678 tempest-VolumesActionsTest-1161299678-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:01:48.665038 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-32bee8af-48fe-447d-976f-4a4b2b9bdae3 tempest-VolumesActionsTest-1161299678 tempest-VolumesActionsTest-1161299678-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:01:48.665823 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-32bee8af-48fe-447d-976f-4a4b2b9bdae3 tempest-VolumesActionsTest-1161299678 tempest-VolumesActionsTest-1161299678-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:01:48.666261 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-32bee8af-48fe-447d-976f-4a4b2b9bdae3 tempest-VolumesActionsTest-1161299678 tempest-VolumesActionsTest-1161299678-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:01:48.805590 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-32bee8af-48fe-447d-976f-4a4b2b9bdae3 tempest-VolumesActionsTest-1161299678 tempest-VolumesActionsTest-1161299678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69102e11c4bd405eab82f8a1666ebba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd538edac912247ebbaf05b22dfa6dad6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 09:01:48.813709 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-32bee8af-48fe-447d-976f-4a4b2b9bdae3 tempest-VolumesActionsTest-1161299678 tempest-VolumesActionsTest-1161299678-project] 10.222.0.31 "GET /compute/v2.1/servers/4240f73c-c195-444d-ab09-34d6a34f7614" status: 200 len: 1504 microversion: 2.1 time: 0.160126 Apr 29 09:01:48.814289 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 564/1121] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 09:01:48 2022] GET /compute/v2.1/servers/4240f73c-c195-444d-ab09-34d6a34f7614 => generated 1504 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 09:01:48.871415 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-a3ff9ec2-752b-497d-9263-1d4dc272dc38 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Calling method '>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 09:01:48.872202 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-a3ff9ec2-752b-497d-9263-1d4dc272dc38 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] [instance: e74dc909-2e3d-4acb-a05a-ed18d4c0f699] Fetching instance by UUID {{(pid=123459) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 09:01:48.878384 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-a3ff9ec2-752b-497d-9263-1d4dc272dc38 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:01:48.878838 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-a3ff9ec2-752b-497d-9263-1d4dc272dc38 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:01:48.879604 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-a3ff9ec2-752b-497d-9263-1d4dc272dc38 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:01:48.880041 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-a3ff9ec2-752b-497d-9263-1d4dc272dc38 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:01:49.012805 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-a3ff9ec2-752b-497d-9263-1d4dc272dc38 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 09:01:49.020565 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-a3ff9ec2-752b-497d-9263-1d4dc272dc38 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 09:01:49.022100 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-a3ff9ec2-752b-497d-9263-1d4dc272dc38 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 09:01:49.023253 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-a3ff9ec2-752b-497d-9263-1d4dc272dc38 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] 10.222.0.31 "GET /compute/v2.1/servers/e74dc909-2e3d-4acb-a05a-ed18d4c0f699" status: 200 len: 1731 microversion: 2.20 time: 0.156577 Apr 29 09:01:49.023813 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 558/1122] 10.222.0.31 () {60 vars in 1276 bytes} [Fri Apr 29 09:01:48 2022] GET /compute/v2.1/servers/e74dc909-2e3d-4acb-a05a-ed18d4c0f699 => generated 1731 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 29 09:01:49.752514 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [req-a84fc91e-ed75-4ef0-b467-575cc06ad4a3 req-8f460f92-071e-4fa7-b0ac-741504c2f2d8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4240f73c-c195-444d-ab09-34d6a34f7614", "name": "network-vif-deleted", "tag": "ff9b8c47-a50f-4aed-abfb-17ad9661e4cc"}]} {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 29 09:01:49.760607 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [req-a84fc91e-ed75-4ef0-b467-575cc06ad4a3 req-8f460f92-071e-4fa7-b0ac-741504c2f2d8 service nova] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:01:49.761055 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [req-a84fc91e-ed75-4ef0-b467-575cc06ad4a3 req-8f460f92-071e-4fa7-b0ac-741504c2f2d8 service nova] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:01:49.774255 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.compute.server_external_events [req-a84fc91e-ed75-4ef0-b467-575cc06ad4a3 req-8f460f92-071e-4fa7-b0ac-741504c2f2d8 service nova] Creating event network-vif-deleted:ff9b8c47-a50f-4aed-abfb-17ad9661e4cc for instance 4240f73c-c195-444d-ab09-34d6a34f7614 on hv-cinder-83987 Apr 29 09:01:49.780319 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [req-a84fc91e-ed75-4ef0-b467-575cc06ad4a3 req-8f460f92-071e-4fa7-b0ac-741504c2f2d8 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100767 Apr 29 09:01:49.780887 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 565/1123] 10.222.0.31 () {64 vars in 1317 bytes} [Fri Apr 29 09:01:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 29 09:01:49.830824 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-d5e81516-83f7-4128-927a-f22b9a582f57 tempest-VolumesActionsTest-1161299678 tempest-VolumesActionsTest-1161299678-project] Calling method '>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 09:01:49.831427 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-d5e81516-83f7-4128-927a-f22b9a582f57 tempest-VolumesActionsTest-1161299678 tempest-VolumesActionsTest-1161299678-project] [instance: 4240f73c-c195-444d-ab09-34d6a34f7614] Fetching instance by UUID {{(pid=123459) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 09:01:49.838076 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-d5e81516-83f7-4128-927a-f22b9a582f57 tempest-VolumesActionsTest-1161299678 tempest-VolumesActionsTest-1161299678-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:01:49.838451 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-d5e81516-83f7-4128-927a-f22b9a582f57 tempest-VolumesActionsTest-1161299678 tempest-VolumesActionsTest-1161299678-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:01:49.839805 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-d5e81516-83f7-4128-927a-f22b9a582f57 tempest-VolumesActionsTest-1161299678 tempest-VolumesActionsTest-1161299678-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:01:49.841240 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-d5e81516-83f7-4128-927a-f22b9a582f57 tempest-VolumesActionsTest-1161299678 tempest-VolumesActionsTest-1161299678-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:01:49.875315 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-d5e81516-83f7-4128-927a-f22b9a582f57 tempest-VolumesActionsTest-1161299678 tempest-VolumesActionsTest-1161299678-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:01:49.875767 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-d5e81516-83f7-4128-927a-f22b9a582f57 tempest-VolumesActionsTest-1161299678 tempest-VolumesActionsTest-1161299678-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:01:49.876277 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.objects.instance [None req-d5e81516-83f7-4128-927a-f22b9a582f57 tempest-VolumesActionsTest-1161299678 tempest-VolumesActionsTest-1161299678-project] Lazy-loading 'fault' on Instance uuid 4240f73c-c195-444d-ab09-34d6a34f7614 {{(pid=123459) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 29 09:01:49.923550 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-d5e81516-83f7-4128-927a-f22b9a582f57 tempest-VolumesActionsTest-1161299678 tempest-VolumesActionsTest-1161299678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69102e11c4bd405eab82f8a1666ebba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd538edac912247ebbaf05b22dfa6dad6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 09:01:49.938979 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-d5e81516-83f7-4128-927a-f22b9a582f57 tempest-VolumesActionsTest-1161299678 tempest-VolumesActionsTest-1161299678-project] 10.222.0.31 "GET /compute/v2.1/servers/4240f73c-c195-444d-ab09-34d6a34f7614" status: 200 len: 1304 microversion: 2.1 time: 0.111909 Apr 29 09:01:49.939572 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 559/1124] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 09:01:49 2022] GET /compute/v2.1/servers/4240f73c-c195-444d-ab09-34d6a34f7614 => generated 1304 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 09:01:50.042027 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-7e2a1711-8b85-4681-8b80-f506861e2eef tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Calling method '>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 09:01:50.042994 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-7e2a1711-8b85-4681-8b80-f506861e2eef tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] [instance: e74dc909-2e3d-4acb-a05a-ed18d4c0f699] Fetching instance by UUID {{(pid=123458) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 09:01:50.050064 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-7e2a1711-8b85-4681-8b80-f506861e2eef tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:01:50.050787 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-7e2a1711-8b85-4681-8b80-f506861e2eef tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:01:50.051599 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-7e2a1711-8b85-4681-8b80-f506861e2eef tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:01:50.052035 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-7e2a1711-8b85-4681-8b80-f506861e2eef tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:01:50.194454 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-7e2a1711-8b85-4681-8b80-f506861e2eef tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 09:01:50.203767 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-7e2a1711-8b85-4681-8b80-f506861e2eef tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 09:01:50.205306 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-7e2a1711-8b85-4681-8b80-f506861e2eef tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 09:01:50.206462 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-7e2a1711-8b85-4681-8b80-f506861e2eef tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] 10.222.0.31 "GET /compute/v2.1/servers/e74dc909-2e3d-4acb-a05a-ed18d4c0f699" status: 200 len: 1731 microversion: 2.20 time: 0.168895 Apr 29 09:01:50.207026 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 566/1125] 10.222.0.31 () {60 vars in 1276 bytes} [Fri Apr 29 09:01:50 2022] GET /compute/v2.1/servers/e74dc909-2e3d-4acb-a05a-ed18d4c0f699 => generated 1731 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 29 09:01:50.957893 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-281bf366-b526-4e75-9b14-8a49032e31be tempest-VolumesActionsTest-1161299678 tempest-VolumesActionsTest-1161299678-project] Calling method '>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 09:01:50.958503 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-281bf366-b526-4e75-9b14-8a49032e31be tempest-VolumesActionsTest-1161299678 tempest-VolumesActionsTest-1161299678-project] [instance: 4240f73c-c195-444d-ab09-34d6a34f7614] Fetching instance by UUID {{(pid=123459) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 09:01:50.965591 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-281bf366-b526-4e75-9b14-8a49032e31be tempest-VolumesActionsTest-1161299678 tempest-VolumesActionsTest-1161299678-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:01:50.966036 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-281bf366-b526-4e75-9b14-8a49032e31be tempest-VolumesActionsTest-1161299678 tempest-VolumesActionsTest-1161299678-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:01:50.966811 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-281bf366-b526-4e75-9b14-8a49032e31be tempest-VolumesActionsTest-1161299678 tempest-VolumesActionsTest-1161299678-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:01:50.967249 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-281bf366-b526-4e75-9b14-8a49032e31be tempest-VolumesActionsTest-1161299678 tempest-VolumesActionsTest-1161299678-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:01:50.981098 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.wsgi [None req-281bf366-b526-4e75-9b14-8a49032e31be tempest-VolumesActionsTest-1161299678 tempest-VolumesActionsTest-1161299678-project] HTTP exception thrown: Instance 4240f73c-c195-444d-ab09-34d6a34f7614 could not be found. Apr 29 09:01:50.981691 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-281bf366-b526-4e75-9b14-8a49032e31be tempest-VolumesActionsTest-1161299678 tempest-VolumesActionsTest-1161299678-project] Returning 404 to user: Instance 4240f73c-c195-444d-ab09-34d6a34f7614 could not be found. {{(pid=123459) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 29 09:01:50.982517 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-281bf366-b526-4e75-9b14-8a49032e31be tempest-VolumesActionsTest-1161299678 tempest-VolumesActionsTest-1161299678-project] 10.222.0.31 "GET /compute/v2.1/servers/4240f73c-c195-444d-ab09-34d6a34f7614" status: 404 len: 111 microversion: 2.1 time: 0.028525 Apr 29 09:01:50.983104 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 560/1126] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 09:01:50 2022] GET /compute/v2.1/servers/4240f73c-c195-444d-ab09-34d6a34f7614 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 29 09:01:51.035185 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-5a774fa6-884a-4028-b6df-9380fe6c7b8d tempest-VolumesActionsTest-1161299678 tempest-VolumesActionsTest-1161299678-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-46634180", "imageRef": "e0678f88-0b68-4453-b569-29fd065e544e", "flavorRef": "452", "networks": [{"uuid": "e752ce75-3ff8-4a81-9e57-1d34f86ff501"}]}} {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 29 09:01:51.090655 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.network.neutron [None req-5a774fa6-884a-4028-b6df-9380fe6c7b8d tempest-VolumesActionsTest-1161299678 tempest-VolumesActionsTest-1161299678-project] validate_networks() for [('e752ce75-3ff8-4a81-9e57-1d34f86ff501', None, None, None, None, None)] {{(pid=123458) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 29 09:01:51.224940 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-1dc85999-339b-480f-af28-d269c0f54083 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Calling method '>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 09:01:51.225663 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-1dc85999-339b-480f-af28-d269c0f54083 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] [instance: e74dc909-2e3d-4acb-a05a-ed18d4c0f699] Fetching instance by UUID {{(pid=123459) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 09:01:51.233966 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-1dc85999-339b-480f-af28-d269c0f54083 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:01:51.234556 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-1dc85999-339b-480f-af28-d269c0f54083 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:01:51.235421 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-1dc85999-339b-480f-af28-d269c0f54083 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:01:51.235960 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-1dc85999-339b-480f-af28-d269c0f54083 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:01:51.385347 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-1dc85999-339b-480f-af28-d269c0f54083 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 09:01:51.394402 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-1dc85999-339b-480f-af28-d269c0f54083 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 09:01:51.395803 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-1dc85999-339b-480f-af28-d269c0f54083 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 09:01:51.397018 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-1dc85999-339b-480f-af28-d269c0f54083 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] 10.222.0.31 "GET /compute/v2.1/servers/e74dc909-2e3d-4acb-a05a-ed18d4c0f699" status: 200 len: 1731 microversion: 2.20 time: 0.176463 Apr 29 09:01:51.397745 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 561/1127] 10.222.0.31 () {60 vars in 1276 bytes} [Fri Apr 29 09:01:51 2022] GET /compute/v2.1/servers/e74dc909-2e3d-4acb-a05a-ed18d4c0f699 => generated 1731 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 29 09:01:51.501066 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.virt.hardware [None req-5a774fa6-884a-4028-b6df-9380fe6c7b8d tempest-VolumesActionsTest-1161299678 tempest-VolumesActionsTest-1161299678-project] Flavor limits 0:0:0 {{(pid=123458) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 29 09:01:51.501491 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.virt.hardware [None req-5a774fa6-884a-4028-b6df-9380fe6c7b8d tempest-VolumesActionsTest-1161299678 tempest-VolumesActionsTest-1161299678-project] Image limits 0:0:0 {{(pid=123458) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 29 09:01:51.501993 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.virt.hardware [None req-5a774fa6-884a-4028-b6df-9380fe6c7b8d tempest-VolumesActionsTest-1161299678 tempest-VolumesActionsTest-1161299678-project] Flavor pref 0:0:0 {{(pid=123458) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 29 09:01:51.502407 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.virt.hardware [None req-5a774fa6-884a-4028-b6df-9380fe6c7b8d tempest-VolumesActionsTest-1161299678 tempest-VolumesActionsTest-1161299678-project] Image pref 0:0:0 {{(pid=123458) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 29 09:01:51.502826 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.virt.hardware [None req-5a774fa6-884a-4028-b6df-9380fe6c7b8d tempest-VolumesActionsTest-1161299678 tempest-VolumesActionsTest-1161299678-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123458) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 29 09:01:51.512289 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-5a774fa6-884a-4028-b6df-9380fe6c7b8d tempest-VolumesActionsTest-1161299678 tempest-VolumesActionsTest-1161299678-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:01:51.512739 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-5a774fa6-884a-4028-b6df-9380fe6c7b8d tempest-VolumesActionsTest-1161299678 tempest-VolumesActionsTest-1161299678-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:01:51.513548 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-5a774fa6-884a-4028-b6df-9380fe6c7b8d tempest-VolumesActionsTest-1161299678 tempest-VolumesActionsTest-1161299678-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:01:51.513980 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-5a774fa6-884a-4028-b6df-9380fe6c7b8d tempest-VolumesActionsTest-1161299678 tempest-VolumesActionsTest-1161299678-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:01:51.532496 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.quota [None req-5a774fa6-884a-4028-b6df-9380fe6c7b8d tempest-VolumesActionsTest-1161299678 tempest-VolumesActionsTest-1161299678-project] Getting quotas for project d538edac912247ebbaf05b22dfa6dad6. Resources: {'instances', 'cores', 'ram'} {{(pid=123458) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 29 09:01:51.537074 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.quota [None req-5a774fa6-884a-4028-b6df-9380fe6c7b8d tempest-VolumesActionsTest-1161299678 tempest-VolumesActionsTest-1161299678-project] Getting quotas for user 69102e11c4bd405eab82f8a1666ebba0 and project d538edac912247ebbaf05b22dfa6dad6. Resources: {'instances', 'cores', 'ram'} {{(pid=123458) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 29 09:01:51.548652 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-5a774fa6-884a-4028-b6df-9380fe6c7b8d tempest-VolumesActionsTest-1161299678 tempest-VolumesActionsTest-1161299678-project] Going to run 1 instances... {{(pid=123458) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 29 09:01:51.550966 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-5a774fa6-884a-4028-b6df-9380fe6c7b8d tempest-VolumesActionsTest-1161299678 tempest-VolumesActionsTest-1161299678-project] [instance: 0f7e89c8-a7a0-45b1-b4ad-e79bad911cea] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e0678f88-0b68-4453-b569-29fd065e544e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123458) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 29 09:01:51.601285 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-5a774fa6-884a-4028-b6df-9380fe6c7b8d tempest-VolumesActionsTest-1161299678 tempest-VolumesActionsTest-1161299678-project] 10.222.0.31 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.569941 Apr 29 09:01:51.602252 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 567/1128] 10.222.0.31 () {60 vars in 1146 bytes} [Fri Apr 29 09:01:51 2022] POST /compute/v2.1/servers => generated 380 bytes in 571 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 29 09:01:51.612590 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-480e4d43-4600-48ca-971e-3247ff92a7f8 tempest-VolumesActionsTest-1161299678 tempest-VolumesActionsTest-1161299678-project] Calling method '>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 09:01:51.613403 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-480e4d43-4600-48ca-971e-3247ff92a7f8 tempest-VolumesActionsTest-1161299678 tempest-VolumesActionsTest-1161299678-project] [instance: 0f7e89c8-a7a0-45b1-b4ad-e79bad911cea] Fetching instance by UUID {{(pid=123459) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 09:01:51.684436 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-480e4d43-4600-48ca-971e-3247ff92a7f8 tempest-VolumesActionsTest-1161299678 tempest-VolumesActionsTest-1161299678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69102e11c4bd405eab82f8a1666ebba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd538edac912247ebbaf05b22dfa6dad6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 09:01:51.691779 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-480e4d43-4600-48ca-971e-3247ff92a7f8 tempest-VolumesActionsTest-1161299678 tempest-VolumesActionsTest-1161299678-project] 10.222.0.31 "GET /compute/v2.1/servers/0f7e89c8-a7a0-45b1-b4ad-e79bad911cea" status: 200 len: 1212 microversion: 2.1 time: 0.083364 Apr 29 09:01:51.692464 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 562/1129] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 09:01:51 2022] GET /compute/v2.1/servers/0f7e89c8-a7a0-45b1-b4ad-e79bad911cea => generated 1212 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 09:01:52.418199 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-d88cd3f5-0e61-4276-99c5-dbf53ad844ca tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Calling method '>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 09:01:52.418757 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-d88cd3f5-0e61-4276-99c5-dbf53ad844ca tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] [instance: e74dc909-2e3d-4acb-a05a-ed18d4c0f699] Fetching instance by UUID {{(pid=123458) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 09:01:52.425450 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-d88cd3f5-0e61-4276-99c5-dbf53ad844ca tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:01:52.425898 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-d88cd3f5-0e61-4276-99c5-dbf53ad844ca tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:01:52.426673 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-d88cd3f5-0e61-4276-99c5-dbf53ad844ca tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:01:52.427120 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-d88cd3f5-0e61-4276-99c5-dbf53ad844ca tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:01:52.564581 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-d88cd3f5-0e61-4276-99c5-dbf53ad844ca tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 09:01:52.572899 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-d88cd3f5-0e61-4276-99c5-dbf53ad844ca tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 09:01:52.574507 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-d88cd3f5-0e61-4276-99c5-dbf53ad844ca tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 09:01:52.575721 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-d88cd3f5-0e61-4276-99c5-dbf53ad844ca tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] 10.222.0.31 "GET /compute/v2.1/servers/e74dc909-2e3d-4acb-a05a-ed18d4c0f699" status: 200 len: 1718 microversion: 2.20 time: 0.162720 Apr 29 09:01:52.590417 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 568/1130] 10.222.0.31 () {60 vars in 1276 bytes} [Fri Apr 29 09:01:52 2022] GET /compute/v2.1/servers/e74dc909-2e3d-4acb-a05a-ed18d4c0f699 => generated 1718 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 29 09:01:52.711819 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-e1a768dd-e930-45ca-b085-15ac6536d412 tempest-VolumesActionsTest-1161299678 tempest-VolumesActionsTest-1161299678-project] Calling method '>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 09:01:52.714921 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-e1a768dd-e930-45ca-b085-15ac6536d412 tempest-VolumesActionsTest-1161299678 tempest-VolumesActionsTest-1161299678-project] [instance: 0f7e89c8-a7a0-45b1-b4ad-e79bad911cea] Fetching instance by UUID {{(pid=123459) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 09:01:52.720632 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-e1a768dd-e930-45ca-b085-15ac6536d412 tempest-VolumesActionsTest-1161299678 tempest-VolumesActionsTest-1161299678-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:01:52.721302 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-e1a768dd-e930-45ca-b085-15ac6536d412 tempest-VolumesActionsTest-1161299678 tempest-VolumesActionsTest-1161299678-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:01:52.722280 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-e1a768dd-e930-45ca-b085-15ac6536d412 tempest-VolumesActionsTest-1161299678 tempest-VolumesActionsTest-1161299678-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:01:52.722883 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-e1a768dd-e930-45ca-b085-15ac6536d412 tempest-VolumesActionsTest-1161299678 tempest-VolumesActionsTest-1161299678-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:01:52.788570 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-e1a768dd-e930-45ca-b085-15ac6536d412 tempest-VolumesActionsTest-1161299678 tempest-VolumesActionsTest-1161299678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69102e11c4bd405eab82f8a1666ebba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd538edac912247ebbaf05b22dfa6dad6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 09:01:52.797150 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-e1a768dd-e930-45ca-b085-15ac6536d412 tempest-VolumesActionsTest-1161299678 tempest-VolumesActionsTest-1161299678-project] 10.222.0.31 "GET /compute/v2.1/servers/0f7e89c8-a7a0-45b1-b4ad-e79bad911cea" status: 200 len: 1282 microversion: 2.1 time: 0.090020 Apr 29 09:01:52.797758 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 563/1131] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 09:01:52 2022] GET /compute/v2.1/servers/0f7e89c8-a7a0-45b1-b4ad-e79bad911cea => generated 1282 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 09:01:53.814846 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-6f38f288-a425-4cbd-bcb1-716da97e75f5 tempest-VolumesActionsTest-1161299678 tempest-VolumesActionsTest-1161299678-project] Calling method '>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 09:01:53.815537 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-6f38f288-a425-4cbd-bcb1-716da97e75f5 tempest-VolumesActionsTest-1161299678 tempest-VolumesActionsTest-1161299678-project] [instance: 0f7e89c8-a7a0-45b1-b4ad-e79bad911cea] Fetching instance by UUID {{(pid=123458) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 09:01:53.822275 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-6f38f288-a425-4cbd-bcb1-716da97e75f5 tempest-VolumesActionsTest-1161299678 tempest-VolumesActionsTest-1161299678-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:01:53.822724 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-6f38f288-a425-4cbd-bcb1-716da97e75f5 tempest-VolumesActionsTest-1161299678 tempest-VolumesActionsTest-1161299678-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:01:53.824126 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-6f38f288-a425-4cbd-bcb1-716da97e75f5 tempest-VolumesActionsTest-1161299678 tempest-VolumesActionsTest-1161299678-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:01:53.824590 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-6f38f288-a425-4cbd-bcb1-716da97e75f5 tempest-VolumesActionsTest-1161299678 tempest-VolumesActionsTest-1161299678-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:01:54.015149 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [req-c4accc5e-14f3-41a2-af6c-d6525c572cf6 req-fc715d27-7367-4aea-a187-2ff507eb729a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0f7e89c8-a7a0-45b1-b4ad-e79bad911cea", "tag": "5a815387-118c-46d5-b0cb-58c9741141ca"}]} {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 29 09:01:54.024725 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [req-c4accc5e-14f3-41a2-af6c-d6525c572cf6 req-fc715d27-7367-4aea-a187-2ff507eb729a service nova] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:01:54.025356 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [req-c4accc5e-14f3-41a2-af6c-d6525c572cf6 req-fc715d27-7367-4aea-a187-2ff507eb729a service nova] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:01:54.040415 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.compute.server_external_events [req-c4accc5e-14f3-41a2-af6c-d6525c572cf6 req-fc715d27-7367-4aea-a187-2ff507eb729a service nova] Creating event network-changed:5a815387-118c-46d5-b0cb-58c9741141ca for instance 0f7e89c8-a7a0-45b1-b4ad-e79bad911cea on hv-cinder-83987 Apr 29 09:01:54.045503 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-6f38f288-a425-4cbd-bcb1-716da97e75f5 tempest-VolumesActionsTest-1161299678 tempest-VolumesActionsTest-1161299678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69102e11c4bd405eab82f8a1666ebba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd538edac912247ebbaf05b22dfa6dad6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 09:01:54.046395 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [req-c4accc5e-14f3-41a2-af6c-d6525c572cf6 req-fc715d27-7367-4aea-a187-2ff507eb729a service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037222 Apr 29 09:01:54.047604 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 564/1132] 10.222.0.31 () {64 vars in 1317 bytes} [Fri Apr 29 09:01:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 29 09:01:54.055229 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-6f38f288-a425-4cbd-bcb1-716da97e75f5 tempest-VolumesActionsTest-1161299678 tempest-VolumesActionsTest-1161299678-project] 10.222.0.31 "GET /compute/v2.1/servers/0f7e89c8-a7a0-45b1-b4ad-e79bad911cea" status: 200 len: 1312 microversion: 2.1 time: 0.244288 Apr 29 09:01:54.055837 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 569/1133] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 09:01:53 2022] GET /compute/v2.1/servers/0f7e89c8-a7a0-45b1-b4ad-e79bad911cea => generated 1312 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 09:01:55.074374 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-c3478e59-14cc-4586-8683-a47ff5c7ac03 tempest-VolumesActionsTest-1161299678 tempest-VolumesActionsTest-1161299678-project] Calling method '>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 09:01:55.075069 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-c3478e59-14cc-4586-8683-a47ff5c7ac03 tempest-VolumesActionsTest-1161299678 tempest-VolumesActionsTest-1161299678-project] [instance: 0f7e89c8-a7a0-45b1-b4ad-e79bad911cea] Fetching instance by UUID {{(pid=123459) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 09:01:55.081339 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-c3478e59-14cc-4586-8683-a47ff5c7ac03 tempest-VolumesActionsTest-1161299678 tempest-VolumesActionsTest-1161299678-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:01:55.081782 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-c3478e59-14cc-4586-8683-a47ff5c7ac03 tempest-VolumesActionsTest-1161299678 tempest-VolumesActionsTest-1161299678-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:01:55.082541 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-c3478e59-14cc-4586-8683-a47ff5c7ac03 tempest-VolumesActionsTest-1161299678 tempest-VolumesActionsTest-1161299678-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:01:55.082970 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-c3478e59-14cc-4586-8683-a47ff5c7ac03 tempest-VolumesActionsTest-1161299678 tempest-VolumesActionsTest-1161299678-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:01:55.215779 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-c3478e59-14cc-4586-8683-a47ff5c7ac03 tempest-VolumesActionsTest-1161299678 tempest-VolumesActionsTest-1161299678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69102e11c4bd405eab82f8a1666ebba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd538edac912247ebbaf05b22dfa6dad6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 09:01:55.223590 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-c3478e59-14cc-4586-8683-a47ff5c7ac03 tempest-VolumesActionsTest-1161299678 tempest-VolumesActionsTest-1161299678-project] 10.222.0.31 "GET /compute/v2.1/servers/0f7e89c8-a7a0-45b1-b4ad-e79bad911cea" status: 200 len: 1312 microversion: 2.1 time: 0.153901 Apr 29 09:01:55.224182 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 565/1134] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 09:01:55 2022] GET /compute/v2.1/servers/0f7e89c8-a7a0-45b1-b4ad-e79bad911cea => generated 1312 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 09:01:56.242029 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-495151c4-6fc8-4dc6-b7de-00202dd8dc5a tempest-VolumesActionsTest-1161299678 tempest-VolumesActionsTest-1161299678-project] Calling method '>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 09:01:56.242633 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-495151c4-6fc8-4dc6-b7de-00202dd8dc5a tempest-VolumesActionsTest-1161299678 tempest-VolumesActionsTest-1161299678-project] [instance: 0f7e89c8-a7a0-45b1-b4ad-e79bad911cea] Fetching instance by UUID {{(pid=123458) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 09:01:56.250003 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-495151c4-6fc8-4dc6-b7de-00202dd8dc5a tempest-VolumesActionsTest-1161299678 tempest-VolumesActionsTest-1161299678-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:01:56.250458 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-495151c4-6fc8-4dc6-b7de-00202dd8dc5a tempest-VolumesActionsTest-1161299678 tempest-VolumesActionsTest-1161299678-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:01:56.251229 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-495151c4-6fc8-4dc6-b7de-00202dd8dc5a tempest-VolumesActionsTest-1161299678 tempest-VolumesActionsTest-1161299678-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:01:56.251669 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-495151c4-6fc8-4dc6-b7de-00202dd8dc5a tempest-VolumesActionsTest-1161299678 tempest-VolumesActionsTest-1161299678-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:01:56.386665 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-495151c4-6fc8-4dc6-b7de-00202dd8dc5a tempest-VolumesActionsTest-1161299678 tempest-VolumesActionsTest-1161299678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69102e11c4bd405eab82f8a1666ebba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd538edac912247ebbaf05b22dfa6dad6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 09:01:56.394416 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-495151c4-6fc8-4dc6-b7de-00202dd8dc5a tempest-VolumesActionsTest-1161299678 tempest-VolumesActionsTest-1161299678-project] 10.222.0.31 "GET /compute/v2.1/servers/0f7e89c8-a7a0-45b1-b4ad-e79bad911cea" status: 200 len: 1312 microversion: 2.1 time: 0.156183 Apr 29 09:01:56.395017 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 570/1135] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 09:01:56 2022] GET /compute/v2.1/servers/0f7e89c8-a7a0-45b1-b4ad-e79bad911cea => generated 1312 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 09:01:57.410771 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-60040e2f-4f87-4342-8714-3e1436512bb1 tempest-VolumesActionsTest-1161299678 tempest-VolumesActionsTest-1161299678-project] Calling method '>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 09:01:57.411386 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-60040e2f-4f87-4342-8714-3e1436512bb1 tempest-VolumesActionsTest-1161299678 tempest-VolumesActionsTest-1161299678-project] [instance: 0f7e89c8-a7a0-45b1-b4ad-e79bad911cea] Fetching instance by UUID {{(pid=123459) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 09:01:57.418438 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-60040e2f-4f87-4342-8714-3e1436512bb1 tempest-VolumesActionsTest-1161299678 tempest-VolumesActionsTest-1161299678-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:01:57.418986 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-60040e2f-4f87-4342-8714-3e1436512bb1 tempest-VolumesActionsTest-1161299678 tempest-VolumesActionsTest-1161299678-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:01:57.419769 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-60040e2f-4f87-4342-8714-3e1436512bb1 tempest-VolumesActionsTest-1161299678 tempest-VolumesActionsTest-1161299678-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:01:57.420221 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-60040e2f-4f87-4342-8714-3e1436512bb1 tempest-VolumesActionsTest-1161299678 tempest-VolumesActionsTest-1161299678-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:01:57.552171 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-60040e2f-4f87-4342-8714-3e1436512bb1 tempest-VolumesActionsTest-1161299678 tempest-VolumesActionsTest-1161299678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69102e11c4bd405eab82f8a1666ebba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd538edac912247ebbaf05b22dfa6dad6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 09:01:57.560271 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-60040e2f-4f87-4342-8714-3e1436512bb1 tempest-VolumesActionsTest-1161299678 tempest-VolumesActionsTest-1161299678-project] 10.222.0.31 "GET /compute/v2.1/servers/0f7e89c8-a7a0-45b1-b4ad-e79bad911cea" status: 200 len: 1312 microversion: 2.1 time: 0.153202 Apr 29 09:01:57.560869 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 566/1136] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 09:01:57 2022] GET /compute/v2.1/servers/0f7e89c8-a7a0-45b1-b4ad-e79bad911cea => generated 1312 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 09:01:58.577894 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-25bb4a6e-4c9e-4f76-bed0-dc9695e83355 tempest-VolumesActionsTest-1161299678 tempest-VolumesActionsTest-1161299678-project] Calling method '>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 09:01:58.578494 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-25bb4a6e-4c9e-4f76-bed0-dc9695e83355 tempest-VolumesActionsTest-1161299678 tempest-VolumesActionsTest-1161299678-project] [instance: 0f7e89c8-a7a0-45b1-b4ad-e79bad911cea] Fetching instance by UUID {{(pid=123458) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 09:01:58.584947 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-25bb4a6e-4c9e-4f76-bed0-dc9695e83355 tempest-VolumesActionsTest-1161299678 tempest-VolumesActionsTest-1161299678-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:01:58.585388 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-25bb4a6e-4c9e-4f76-bed0-dc9695e83355 tempest-VolumesActionsTest-1161299678 tempest-VolumesActionsTest-1161299678-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:01:58.586155 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-25bb4a6e-4c9e-4f76-bed0-dc9695e83355 tempest-VolumesActionsTest-1161299678 tempest-VolumesActionsTest-1161299678-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:01:58.586580 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-25bb4a6e-4c9e-4f76-bed0-dc9695e83355 tempest-VolumesActionsTest-1161299678 tempest-VolumesActionsTest-1161299678-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:01:58.725981 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-25bb4a6e-4c9e-4f76-bed0-dc9695e83355 tempest-VolumesActionsTest-1161299678 tempest-VolumesActionsTest-1161299678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69102e11c4bd405eab82f8a1666ebba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd538edac912247ebbaf05b22dfa6dad6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 09:01:58.734230 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-25bb4a6e-4c9e-4f76-bed0-dc9695e83355 tempest-VolumesActionsTest-1161299678 tempest-VolumesActionsTest-1161299678-project] 10.222.0.31 "GET /compute/v2.1/servers/0f7e89c8-a7a0-45b1-b4ad-e79bad911cea" status: 200 len: 1312 microversion: 2.1 time: 0.160795 Apr 29 09:01:58.734820 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 571/1137] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 09:01:58 2022] GET /compute/v2.1/servers/0f7e89c8-a7a0-45b1-b4ad-e79bad911cea => generated 1312 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 09:01:59.751403 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-b166d023-598f-453b-b3e6-dfe02f0f7fe4 tempest-VolumesActionsTest-1161299678 tempest-VolumesActionsTest-1161299678-project] Calling method '>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 09:01:59.752931 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-b166d023-598f-453b-b3e6-dfe02f0f7fe4 tempest-VolumesActionsTest-1161299678 tempest-VolumesActionsTest-1161299678-project] [instance: 0f7e89c8-a7a0-45b1-b4ad-e79bad911cea] Fetching instance by UUID {{(pid=123459) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 09:01:59.759675 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-b166d023-598f-453b-b3e6-dfe02f0f7fe4 tempest-VolumesActionsTest-1161299678 tempest-VolumesActionsTest-1161299678-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:01:59.760160 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-b166d023-598f-453b-b3e6-dfe02f0f7fe4 tempest-VolumesActionsTest-1161299678 tempest-VolumesActionsTest-1161299678-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:01:59.761753 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-b166d023-598f-453b-b3e6-dfe02f0f7fe4 tempest-VolumesActionsTest-1161299678 tempest-VolumesActionsTest-1161299678-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:01:59.762543 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-b166d023-598f-453b-b3e6-dfe02f0f7fe4 tempest-VolumesActionsTest-1161299678 tempest-VolumesActionsTest-1161299678-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:01:59.892985 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-b166d023-598f-453b-b3e6-dfe02f0f7fe4 tempest-VolumesActionsTest-1161299678 tempest-VolumesActionsTest-1161299678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69102e11c4bd405eab82f8a1666ebba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd538edac912247ebbaf05b22dfa6dad6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 09:01:59.918606 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-b166d023-598f-453b-b3e6-dfe02f0f7fe4 tempest-VolumesActionsTest-1161299678 tempest-VolumesActionsTest-1161299678-project] 10.222.0.31 "GET /compute/v2.1/servers/0f7e89c8-a7a0-45b1-b4ad-e79bad911cea" status: 200 len: 1312 microversion: 2.1 time: 0.170954 Apr 29 09:01:59.919212 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 567/1138] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 09:01:59 2022] GET /compute/v2.1/servers/0f7e89c8-a7a0-45b1-b4ad-e79bad911cea => generated 1312 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 09:02:00.064051 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [req-5c257cbe-6bfa-43e9-9694-e9cd30f2ded1 req-77d28388-c0e5-434f-873b-cf61caaf0599 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0f7e89c8-a7a0-45b1-b4ad-e79bad911cea", "name": "network-vif-plugged", "status": "completed", "tag": "5a815387-118c-46d5-b0cb-58c9741141ca"}]} {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 29 09:02:00.073019 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [req-5c257cbe-6bfa-43e9-9694-e9cd30f2ded1 req-77d28388-c0e5-434f-873b-cf61caaf0599 service nova] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:02:00.074219 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [req-5c257cbe-6bfa-43e9-9694-e9cd30f2ded1 req-77d28388-c0e5-434f-873b-cf61caaf0599 service nova] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:02:00.085391 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.compute.server_external_events [req-5c257cbe-6bfa-43e9-9694-e9cd30f2ded1 req-77d28388-c0e5-434f-873b-cf61caaf0599 service nova] Creating event network-vif-plugged:5a815387-118c-46d5-b0cb-58c9741141ca for instance 0f7e89c8-a7a0-45b1-b4ad-e79bad911cea on hv-cinder-83987 Apr 29 09:02:00.090469 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [req-5c257cbe-6bfa-43e9-9694-e9cd30f2ded1 req-77d28388-c0e5-434f-873b-cf61caaf0599 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029921 Apr 29 09:02:00.091065 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 572/1139] 10.222.0.31 () {64 vars in 1317 bytes} [Fri Apr 29 09:02:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 29 09:02:00.935276 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-3ab77467-36fd-4c33-9290-8f2f08c6356d tempest-VolumesActionsTest-1161299678 tempest-VolumesActionsTest-1161299678-project] Calling method '>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 09:02:00.935900 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-3ab77467-36fd-4c33-9290-8f2f08c6356d tempest-VolumesActionsTest-1161299678 tempest-VolumesActionsTest-1161299678-project] [instance: 0f7e89c8-a7a0-45b1-b4ad-e79bad911cea] Fetching instance by UUID {{(pid=123459) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 09:02:00.942378 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-3ab77467-36fd-4c33-9290-8f2f08c6356d tempest-VolumesActionsTest-1161299678 tempest-VolumesActionsTest-1161299678-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:02:00.942827 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-3ab77467-36fd-4c33-9290-8f2f08c6356d tempest-VolumesActionsTest-1161299678 tempest-VolumesActionsTest-1161299678-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:02:00.943601 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-3ab77467-36fd-4c33-9290-8f2f08c6356d tempest-VolumesActionsTest-1161299678 tempest-VolumesActionsTest-1161299678-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:02:00.944038 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-3ab77467-36fd-4c33-9290-8f2f08c6356d tempest-VolumesActionsTest-1161299678 tempest-VolumesActionsTest-1161299678-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:02:01.078486 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-3ab77467-36fd-4c33-9290-8f2f08c6356d tempest-VolumesActionsTest-1161299678 tempest-VolumesActionsTest-1161299678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69102e11c4bd405eab82f8a1666ebba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd538edac912247ebbaf05b22dfa6dad6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 09:02:01.085775 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-3ab77467-36fd-4c33-9290-8f2f08c6356d tempest-VolumesActionsTest-1161299678 tempest-VolumesActionsTest-1161299678-project] 10.222.0.31 "GET /compute/v2.1/servers/0f7e89c8-a7a0-45b1-b4ad-e79bad911cea" status: 200 len: 1312 microversion: 2.1 time: 0.154751 Apr 29 09:02:01.086342 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 568/1140] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 09:02:00 2022] GET /compute/v2.1/servers/0f7e89c8-a7a0-45b1-b4ad-e79bad911cea => generated 1312 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 09:02:02.104048 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-6d543f89-947b-4010-b6f4-20f170f2bb71 tempest-VolumesActionsTest-1161299678 tempest-VolumesActionsTest-1161299678-project] Calling method '>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 09:02:02.104778 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-6d543f89-947b-4010-b6f4-20f170f2bb71 tempest-VolumesActionsTest-1161299678 tempest-VolumesActionsTest-1161299678-project] [instance: 0f7e89c8-a7a0-45b1-b4ad-e79bad911cea] Fetching instance by UUID {{(pid=123458) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 09:02:02.111189 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-6d543f89-947b-4010-b6f4-20f170f2bb71 tempest-VolumesActionsTest-1161299678 tempest-VolumesActionsTest-1161299678-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:02:02.111634 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-6d543f89-947b-4010-b6f4-20f170f2bb71 tempest-VolumesActionsTest-1161299678 tempest-VolumesActionsTest-1161299678-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:02:02.112457 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-6d543f89-947b-4010-b6f4-20f170f2bb71 tempest-VolumesActionsTest-1161299678 tempest-VolumesActionsTest-1161299678-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:02:02.112882 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-6d543f89-947b-4010-b6f4-20f170f2bb71 tempest-VolumesActionsTest-1161299678 tempest-VolumesActionsTest-1161299678-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:02:02.247307 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-6d543f89-947b-4010-b6f4-20f170f2bb71 tempest-VolumesActionsTest-1161299678 tempest-VolumesActionsTest-1161299678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69102e11c4bd405eab82f8a1666ebba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd538edac912247ebbaf05b22dfa6dad6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 09:02:02.255978 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-6d543f89-947b-4010-b6f4-20f170f2bb71 tempest-VolumesActionsTest-1161299678 tempest-VolumesActionsTest-1161299678-project] 10.222.0.31 "GET /compute/v2.1/servers/0f7e89c8-a7a0-45b1-b4ad-e79bad911cea" status: 200 len: 1312 microversion: 2.1 time: 0.156879 Apr 29 09:02:02.256601 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 573/1141] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 09:02:02 2022] GET /compute/v2.1/servers/0f7e89c8-a7a0-45b1-b4ad-e79bad911cea => generated 1312 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 09:02:03.273344 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-e212a6f9-e5fe-406f-a60d-f012dc9b2516 tempest-VolumesActionsTest-1161299678 tempest-VolumesActionsTest-1161299678-project] Calling method '>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 09:02:03.273965 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-e212a6f9-e5fe-406f-a60d-f012dc9b2516 tempest-VolumesActionsTest-1161299678 tempest-VolumesActionsTest-1161299678-project] [instance: 0f7e89c8-a7a0-45b1-b4ad-e79bad911cea] Fetching instance by UUID {{(pid=123459) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 09:02:03.281328 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-e212a6f9-e5fe-406f-a60d-f012dc9b2516 tempest-VolumesActionsTest-1161299678 tempest-VolumesActionsTest-1161299678-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:02:03.281778 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-e212a6f9-e5fe-406f-a60d-f012dc9b2516 tempest-VolumesActionsTest-1161299678 tempest-VolumesActionsTest-1161299678-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:02:03.282554 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-e212a6f9-e5fe-406f-a60d-f012dc9b2516 tempest-VolumesActionsTest-1161299678 tempest-VolumesActionsTest-1161299678-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:02:03.282996 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-e212a6f9-e5fe-406f-a60d-f012dc9b2516 tempest-VolumesActionsTest-1161299678 tempest-VolumesActionsTest-1161299678-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:02:03.416814 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-e212a6f9-e5fe-406f-a60d-f012dc9b2516 tempest-VolumesActionsTest-1161299678 tempest-VolumesActionsTest-1161299678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69102e11c4bd405eab82f8a1666ebba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd538edac912247ebbaf05b22dfa6dad6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 09:02:03.424442 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-e212a6f9-e5fe-406f-a60d-f012dc9b2516 tempest-VolumesActionsTest-1161299678 tempest-VolumesActionsTest-1161299678-project] 10.222.0.31 "GET /compute/v2.1/servers/0f7e89c8-a7a0-45b1-b4ad-e79bad911cea" status: 200 len: 1497 microversion: 2.1 time: 0.154904 Apr 29 09:02:03.425022 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 569/1142] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 09:02:03 2022] GET /compute/v2.1/servers/0f7e89c8-a7a0-45b1-b4ad-e79bad911cea => generated 1497 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 09:02:03.957186 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-f9135d69-ec47-4522-a926-d83c3df51718 tempest-VolumesActionsTest-1161299678 tempest-VolumesActionsTest-1161299678-project] Calling method '>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 09:02:03.957748 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-f9135d69-ec47-4522-a926-d83c3df51718 tempest-VolumesActionsTest-1161299678 tempest-VolumesActionsTest-1161299678-project] [instance: 0f7e89c8-a7a0-45b1-b4ad-e79bad911cea] Fetching instance by UUID {{(pid=123458) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 09:02:03.963654 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-f9135d69-ec47-4522-a926-d83c3df51718 tempest-VolumesActionsTest-1161299678 tempest-VolumesActionsTest-1161299678-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:02:03.964162 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-f9135d69-ec47-4522-a926-d83c3df51718 tempest-VolumesActionsTest-1161299678 tempest-VolumesActionsTest-1161299678-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:02:03.964928 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-f9135d69-ec47-4522-a926-d83c3df51718 tempest-VolumesActionsTest-1161299678 tempest-VolumesActionsTest-1161299678-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:02:03.965533 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-f9135d69-ec47-4522-a926-d83c3df51718 tempest-VolumesActionsTest-1161299678 tempest-VolumesActionsTest-1161299678-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:02:03.990520 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-f9135d69-ec47-4522-a926-d83c3df51718 tempest-VolumesActionsTest-1161299678 tempest-VolumesActionsTest-1161299678-project] [instance: 0f7e89c8-a7a0-45b1-b4ad-e79bad911cea] Going to try to terminate instance {{(pid=123458) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 29 09:02:04.068726 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-f9135d69-ec47-4522-a926-d83c3df51718 tempest-VolumesActionsTest-1161299678 tempest-VolumesActionsTest-1161299678-project] 10.222.0.31 "DELETE /compute/v2.1/servers/0f7e89c8-a7a0-45b1-b4ad-e79bad911cea" status: 204 len: 0 microversion: 2.1 time: 0.114970 Apr 29 09:02:04.069425 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 574/1143] 10.222.0.31 () {58 vars in 1238 bytes} [Fri Apr 29 09:02:03 2022] DELETE /compute/v2.1/servers/0f7e89c8-a7a0-45b1-b4ad-e79bad911cea => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Apr 29 09:02:04.078118 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-7267c588-ae25-4ec0-81d2-a1356b0f8b87 tempest-VolumesActionsTest-1161299678 tempest-VolumesActionsTest-1161299678-project] Calling method '>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 09:02:04.078733 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-7267c588-ae25-4ec0-81d2-a1356b0f8b87 tempest-VolumesActionsTest-1161299678 tempest-VolumesActionsTest-1161299678-project] [instance: 0f7e89c8-a7a0-45b1-b4ad-e79bad911cea] Fetching instance by UUID {{(pid=123459) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 09:02:04.084791 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-7267c588-ae25-4ec0-81d2-a1356b0f8b87 tempest-VolumesActionsTest-1161299678 tempest-VolumesActionsTest-1161299678-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:02:04.085239 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-7267c588-ae25-4ec0-81d2-a1356b0f8b87 tempest-VolumesActionsTest-1161299678 tempest-VolumesActionsTest-1161299678-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:02:04.086006 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-7267c588-ae25-4ec0-81d2-a1356b0f8b87 tempest-VolumesActionsTest-1161299678 tempest-VolumesActionsTest-1161299678-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:02:04.086446 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-7267c588-ae25-4ec0-81d2-a1356b0f8b87 tempest-VolumesActionsTest-1161299678 tempest-VolumesActionsTest-1161299678-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:02:04.221225 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-7267c588-ae25-4ec0-81d2-a1356b0f8b87 tempest-VolumesActionsTest-1161299678 tempest-VolumesActionsTest-1161299678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69102e11c4bd405eab82f8a1666ebba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd538edac912247ebbaf05b22dfa6dad6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 09:02:04.228540 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-7267c588-ae25-4ec0-81d2-a1356b0f8b87 tempest-VolumesActionsTest-1161299678 tempest-VolumesActionsTest-1161299678-project] 10.222.0.31 "GET /compute/v2.1/servers/0f7e89c8-a7a0-45b1-b4ad-e79bad911cea" status: 200 len: 1503 microversion: 2.1 time: 0.154471 Apr 29 09:02:04.229143 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 570/1144] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 09:02:04 2022] GET /compute/v2.1/servers/0f7e89c8-a7a0-45b1-b4ad-e79bad911cea => generated 1503 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 09:02:05.248125 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-e3b2ca6a-0d76-4e99-bb82-7839aef1f896 tempest-VolumesActionsTest-1161299678 tempest-VolumesActionsTest-1161299678-project] Calling method '>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 09:02:05.248867 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-e3b2ca6a-0d76-4e99-bb82-7839aef1f896 tempest-VolumesActionsTest-1161299678 tempest-VolumesActionsTest-1161299678-project] [instance: 0f7e89c8-a7a0-45b1-b4ad-e79bad911cea] Fetching instance by UUID {{(pid=123458) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 09:02:05.255286 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-e3b2ca6a-0d76-4e99-bb82-7839aef1f896 tempest-VolumesActionsTest-1161299678 tempest-VolumesActionsTest-1161299678-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:02:05.255740 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-e3b2ca6a-0d76-4e99-bb82-7839aef1f896 tempest-VolumesActionsTest-1161299678 tempest-VolumesActionsTest-1161299678-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:02:05.256544 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-e3b2ca6a-0d76-4e99-bb82-7839aef1f896 tempest-VolumesActionsTest-1161299678 tempest-VolumesActionsTest-1161299678-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:02:05.256982 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-e3b2ca6a-0d76-4e99-bb82-7839aef1f896 tempest-VolumesActionsTest-1161299678 tempest-VolumesActionsTest-1161299678-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:02:05.397022 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-e3b2ca6a-0d76-4e99-bb82-7839aef1f896 tempest-VolumesActionsTest-1161299678 tempest-VolumesActionsTest-1161299678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69102e11c4bd405eab82f8a1666ebba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd538edac912247ebbaf05b22dfa6dad6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 09:02:05.404549 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-e3b2ca6a-0d76-4e99-bb82-7839aef1f896 tempest-VolumesActionsTest-1161299678 tempest-VolumesActionsTest-1161299678-project] 10.222.0.31 "GET /compute/v2.1/servers/0f7e89c8-a7a0-45b1-b4ad-e79bad911cea" status: 200 len: 1503 microversion: 2.1 time: 0.161561 Apr 29 09:02:05.405200 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 575/1145] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 09:02:05 2022] GET /compute/v2.1/servers/0f7e89c8-a7a0-45b1-b4ad-e79bad911cea => generated 1503 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 09:02:06.422016 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-8b32e690-67bc-44c2-9ce5-3f9d9399c090 tempest-VolumesActionsTest-1161299678 tempest-VolumesActionsTest-1161299678-project] Calling method '>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 09:02:06.422665 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-8b32e690-67bc-44c2-9ce5-3f9d9399c090 tempest-VolumesActionsTest-1161299678 tempest-VolumesActionsTest-1161299678-project] [instance: 0f7e89c8-a7a0-45b1-b4ad-e79bad911cea] Fetching instance by UUID {{(pid=123459) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 09:02:06.430823 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-8b32e690-67bc-44c2-9ce5-3f9d9399c090 tempest-VolumesActionsTest-1161299678 tempest-VolumesActionsTest-1161299678-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:02:06.431323 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-8b32e690-67bc-44c2-9ce5-3f9d9399c090 tempest-VolumesActionsTest-1161299678 tempest-VolumesActionsTest-1161299678-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:02:06.432119 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-8b32e690-67bc-44c2-9ce5-3f9d9399c090 tempest-VolumesActionsTest-1161299678 tempest-VolumesActionsTest-1161299678-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:02:06.432614 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-8b32e690-67bc-44c2-9ce5-3f9d9399c090 tempest-VolumesActionsTest-1161299678 tempest-VolumesActionsTest-1161299678-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:02:06.469791 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [req-d9024e80-0620-4a05-9c00-a039bd52df7e req-ddaf8ad8-35d3-4d7e-921f-b3c95965d7a5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0f7e89c8-a7a0-45b1-b4ad-e79bad911cea", "name": "network-vif-deleted", "tag": "5a815387-118c-46d5-b0cb-58c9741141ca"}]} {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 29 09:02:06.483065 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [req-d9024e80-0620-4a05-9c00-a039bd52df7e req-ddaf8ad8-35d3-4d7e-921f-b3c95965d7a5 service nova] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:02:06.483385 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [req-d9024e80-0620-4a05-9c00-a039bd52df7e req-ddaf8ad8-35d3-4d7e-921f-b3c95965d7a5 service nova] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:02:06.498996 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.compute.server_external_events [req-d9024e80-0620-4a05-9c00-a039bd52df7e req-ddaf8ad8-35d3-4d7e-921f-b3c95965d7a5 service nova] Creating event network-vif-deleted:5a815387-118c-46d5-b0cb-58c9741141ca for instance 0f7e89c8-a7a0-45b1-b4ad-e79bad911cea on hv-cinder-83987 Apr 29 09:02:06.501890 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-8b32e690-67bc-44c2-9ce5-3f9d9399c090 tempest-VolumesActionsTest-1161299678 tempest-VolumesActionsTest-1161299678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69102e11c4bd405eab82f8a1666ebba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd538edac912247ebbaf05b22dfa6dad6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 09:02:06.503289 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [req-d9024e80-0620-4a05-9c00-a039bd52df7e req-ddaf8ad8-35d3-4d7e-921f-b3c95965d7a5 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037095 Apr 29 09:02:06.504464 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 576/1146] 10.222.0.31 () {64 vars in 1317 bytes} [Fri Apr 29 09:02:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 29 09:02:06.511413 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-8b32e690-67bc-44c2-9ce5-3f9d9399c090 tempest-VolumesActionsTest-1161299678 tempest-VolumesActionsTest-1161299678-project] 10.222.0.31 "GET /compute/v2.1/servers/0f7e89c8-a7a0-45b1-b4ad-e79bad911cea" status: 200 len: 1461 microversion: 2.1 time: 0.092892 Apr 29 09:02:06.512063 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 571/1147] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 09:02:06 2022] GET /compute/v2.1/servers/0f7e89c8-a7a0-45b1-b4ad-e79bad911cea => generated 1461 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 09:02:07.531670 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-9da466a4-045e-44e4-8e56-07c48240ccfe tempest-VolumesActionsTest-1161299678 tempest-VolumesActionsTest-1161299678-project] Calling method '>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 09:02:07.532953 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-9da466a4-045e-44e4-8e56-07c48240ccfe tempest-VolumesActionsTest-1161299678 tempest-VolumesActionsTest-1161299678-project] [instance: 0f7e89c8-a7a0-45b1-b4ad-e79bad911cea] Fetching instance by UUID {{(pid=123458) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 09:02:07.539479 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-9da466a4-045e-44e4-8e56-07c48240ccfe tempest-VolumesActionsTest-1161299678 tempest-VolumesActionsTest-1161299678-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:02:07.539929 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-9da466a4-045e-44e4-8e56-07c48240ccfe tempest-VolumesActionsTest-1161299678 tempest-VolumesActionsTest-1161299678-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:02:07.540759 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-9da466a4-045e-44e4-8e56-07c48240ccfe tempest-VolumesActionsTest-1161299678 tempest-VolumesActionsTest-1161299678-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:02:07.541201 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-9da466a4-045e-44e4-8e56-07c48240ccfe tempest-VolumesActionsTest-1161299678 tempest-VolumesActionsTest-1161299678-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:02:07.556713 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.wsgi [None req-9da466a4-045e-44e4-8e56-07c48240ccfe tempest-VolumesActionsTest-1161299678 tempest-VolumesActionsTest-1161299678-project] HTTP exception thrown: Instance 0f7e89c8-a7a0-45b1-b4ad-e79bad911cea could not be found. Apr 29 09:02:07.557317 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-9da466a4-045e-44e4-8e56-07c48240ccfe tempest-VolumesActionsTest-1161299678 tempest-VolumesActionsTest-1161299678-project] Returning 404 to user: Instance 0f7e89c8-a7a0-45b1-b4ad-e79bad911cea could not be found. {{(pid=123458) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 29 09:02:07.558320 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-9da466a4-045e-44e4-8e56-07c48240ccfe tempest-VolumesActionsTest-1161299678 tempest-VolumesActionsTest-1161299678-project] 10.222.0.31 "GET /compute/v2.1/servers/0f7e89c8-a7a0-45b1-b4ad-e79bad911cea" status: 404 len: 111 microversion: 2.1 time: 0.034153 Apr 29 09:02:07.559010 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 577/1148] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 09:02:07 2022] GET /compute/v2.1/servers/0f7e89c8-a7a0-45b1-b4ad-e79bad911cea => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 29 09:02:34.528045 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-8e7d3369-a3b2-4ee1-9015-ec139f18edbe tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Calling method '>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 09:02:34.528899 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-8e7d3369-a3b2-4ee1-9015-ec139f18edbe tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] [instance: 1fa7d94e-9ddd-4cf7-a7c5-072231c6d0bb] Fetching instance by UUID {{(pid=123459) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 09:02:34.538889 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-8e7d3369-a3b2-4ee1-9015-ec139f18edbe tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:02:34.543935 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-8e7d3369-a3b2-4ee1-9015-ec139f18edbe tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:02:34.543935 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-8e7d3369-a3b2-4ee1-9015-ec139f18edbe tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:02:34.543935 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-8e7d3369-a3b2-4ee1-9015-ec139f18edbe tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:02:34.578230 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-8e7d3369-a3b2-4ee1-9015-ec139f18edbe tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] 10.222.0.31 "GET /compute/v2.1/servers/1fa7d94e-9ddd-4cf7-a7c5-072231c6d0bb/ips" status: 200 len: 149 microversion: 2.1 time: 0.056870 Apr 29 09:02:34.579033 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 572/1149] 10.222.0.31 () {58 vars in 1247 bytes} [Fri Apr 29 09:02:34 2022] GET /compute/v2.1/servers/1fa7d94e-9ddd-4cf7-a7c5-072231c6d0bb/ips => generated 149 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 29 09:02:36.985630 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-2fd6bc65-59e2-4339-9b11-83a12a329829 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5b7ca22f-78c7-4775-9ea4-6fdd9afbc8da"}} {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 29 09:02:36.986740 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-2fd6bc65-59e2-4339-9b11-83a12a329829 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] [instance: 1fa7d94e-9ddd-4cf7-a7c5-072231c6d0bb] Fetching instance by UUID {{(pid=123458) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 09:02:36.993576 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-2fd6bc65-59e2-4339-9b11-83a12a329829 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:02:36.994025 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-2fd6bc65-59e2-4339-9b11-83a12a329829 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:02:36.994893 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-2fd6bc65-59e2-4339-9b11-83a12a329829 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:02:36.995381 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-2fd6bc65-59e2-4339-9b11-83a12a329829 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:02:37.282177 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-2fd6bc65-59e2-4339-9b11-83a12a329829 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] 10.222.0.31 "POST /compute/v2.1/servers/1fa7d94e-9ddd-4cf7-a7c5-072231c6d0bb/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.301306 Apr 29 09:02:37.282917 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 578/1150] 10.222.0.31 () {60 vars in 1322 bytes} [Fri Apr 29 09:02:36 2022] POST /compute/v2.1/servers/1fa7d94e-9ddd-4cf7-a7c5-072231c6d0bb/os-volume_attachments => generated 194 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 29 09:02:46.004158 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-f6818a96-ebce-4f72-a202-474bce39bec8 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Calling method '>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 09:02:46.004783 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-f6818a96-ebce-4f72-a202-474bce39bec8 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] [instance: 1fa7d94e-9ddd-4cf7-a7c5-072231c6d0bb] Fetching instance by UUID {{(pid=123459) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 09:02:46.011897 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-f6818a96-ebce-4f72-a202-474bce39bec8 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:02:46.012599 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-f6818a96-ebce-4f72-a202-474bce39bec8 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:02:46.013574 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-f6818a96-ebce-4f72-a202-474bce39bec8 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:02:46.014014 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-f6818a96-ebce-4f72-a202-474bce39bec8 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:02:46.109197 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.objects.instance [None req-f6818a96-ebce-4f72-a202-474bce39bec8 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lazy-loading 'services' on Instance uuid 1fa7d94e-9ddd-4cf7-a7c5-072231c6d0bb {{(pid=123459) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 29 09:02:46.184536 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-f6818a96-ebce-4f72-a202-474bce39bec8 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] 10.222.0.31 "DELETE /compute/v2.1/servers/1fa7d94e-9ddd-4cf7-a7c5-072231c6d0bb/os-volume_attachments/5b7ca22f-78c7-4775-9ea4-6fdd9afbc8da" status: 202 len: 0 microversion: 2.1 time: 0.184097 Apr 29 09:02:46.185130 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 573/1151] 10.222.0.31 () {58 vars in 1415 bytes} [Fri Apr 29 09:02:45 2022] DELETE /compute/v2.1/servers/1fa7d94e-9ddd-4cf7-a7c5-072231c6d0bb/os-volume_attachments/5b7ca22f-78c7-4775-9ea4-6fdd9afbc8da => generated 0 bytes in 186 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Apr 29 09:02:46.194174 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-79b62f86-48a8-47e9-a272-a7dfebdc484c tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Calling method '>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 09:02:46.195274 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-79b62f86-48a8-47e9-a272-a7dfebdc484c tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] [instance: 1fa7d94e-9ddd-4cf7-a7c5-072231c6d0bb] Fetching instance by UUID {{(pid=123458) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 09:02:46.203443 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-79b62f86-48a8-47e9-a272-a7dfebdc484c tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:02:46.203890 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-79b62f86-48a8-47e9-a272-a7dfebdc484c tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:02:46.204878 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-79b62f86-48a8-47e9-a272-a7dfebdc484c tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:02:46.205352 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-79b62f86-48a8-47e9-a272-a7dfebdc484c tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:02:46.242626 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-79b62f86-48a8-47e9-a272-a7dfebdc484c tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] 10.222.0.31 "GET /compute/v2.1/servers/1fa7d94e-9ddd-4cf7-a7c5-072231c6d0bb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052713 Apr 29 09:02:46.243408 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 579/1152] 10.222.0.31 () {58 vars in 1301 bytes} [Fri Apr 29 09:02:46 2022] GET /compute/v2.1/servers/1fa7d94e-9ddd-4cf7-a7c5-072231c6d0bb/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 29 09:02:47.256694 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-4702f98f-e82b-47b4-9759-132dfdfe7245 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Calling method '>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 09:02:47.257749 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-4702f98f-e82b-47b4-9759-132dfdfe7245 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] [instance: 1fa7d94e-9ddd-4cf7-a7c5-072231c6d0bb] Fetching instance by UUID {{(pid=123459) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 09:02:47.264631 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-4702f98f-e82b-47b4-9759-132dfdfe7245 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:02:47.265085 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-4702f98f-e82b-47b4-9759-132dfdfe7245 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:02:47.265886 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-4702f98f-e82b-47b4-9759-132dfdfe7245 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:02:47.266326 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-4702f98f-e82b-47b4-9759-132dfdfe7245 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:02:47.299744 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-4702f98f-e82b-47b4-9759-132dfdfe7245 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] 10.222.0.31 "GET /compute/v2.1/servers/1fa7d94e-9ddd-4cf7-a7c5-072231c6d0bb/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047814 Apr 29 09:02:47.300354 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 574/1153] 10.222.0.31 () {58 vars in 1301 bytes} [Fri Apr 29 09:02:47 2022] GET /compute/v2.1/servers/1fa7d94e-9ddd-4cf7-a7c5-072231c6d0bb/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 29 09:02:47.364999 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-f433de74-b42e-43ce-ba2c-352f94d88858 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Calling method '>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 09:02:47.365741 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-f433de74-b42e-43ce-ba2c-352f94d88858 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] [instance: 1fa7d94e-9ddd-4cf7-a7c5-072231c6d0bb] Fetching instance by UUID {{(pid=123458) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 09:02:47.372494 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-f433de74-b42e-43ce-ba2c-352f94d88858 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:02:47.372942 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-f433de74-b42e-43ce-ba2c-352f94d88858 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:02:47.373710 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-f433de74-b42e-43ce-ba2c-352f94d88858 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:02:47.374145 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-f433de74-b42e-43ce-ba2c-352f94d88858 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:02:47.400647 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-f433de74-b42e-43ce-ba2c-352f94d88858 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] [instance: 1fa7d94e-9ddd-4cf7-a7c5-072231c6d0bb] Going to try to terminate instance {{(pid=123458) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 29 09:02:47.497788 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-f433de74-b42e-43ce-ba2c-352f94d88858 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] 10.222.0.31 "DELETE /compute/v2.1/servers/1fa7d94e-9ddd-4cf7-a7c5-072231c6d0bb" status: 204 len: 0 microversion: 2.1 time: 0.135993 Apr 29 09:02:47.498402 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 580/1154] 10.222.0.31 () {58 vars in 1238 bytes} [Fri Apr 29 09:02:47 2022] DELETE /compute/v2.1/servers/1fa7d94e-9ddd-4cf7-a7c5-072231c6d0bb => generated 0 bytes in 138 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 29 09:02:47.506838 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-313aacce-1fd8-4e92-8983-16bdc12aa342 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Calling method '>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 09:02:47.507447 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-313aacce-1fd8-4e92-8983-16bdc12aa342 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] [instance: 1fa7d94e-9ddd-4cf7-a7c5-072231c6d0bb] Fetching instance by UUID {{(pid=123459) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 09:02:47.515149 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-313aacce-1fd8-4e92-8983-16bdc12aa342 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:02:47.515783 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-313aacce-1fd8-4e92-8983-16bdc12aa342 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:02:47.516618 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-313aacce-1fd8-4e92-8983-16bdc12aa342 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:02:47.517335 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-313aacce-1fd8-4e92-8983-16bdc12aa342 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:02:47.671917 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-313aacce-1fd8-4e92-8983-16bdc12aa342 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e47ecdfb01f447699275b13255c15d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578e6a35974d4e5c8a0cd4e5fa994259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 09:02:47.679423 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-313aacce-1fd8-4e92-8983-16bdc12aa342 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] 10.222.0.31 "GET /compute/v2.1/servers/1fa7d94e-9ddd-4cf7-a7c5-072231c6d0bb" status: 200 len: 1680 microversion: 2.1 time: 0.176583 Apr 29 09:02:47.680095 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 575/1155] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 09:02:47 2022] GET /compute/v2.1/servers/1fa7d94e-9ddd-4cf7-a7c5-072231c6d0bb => generated 1680 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 09:02:48.698109 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-76b81227-5b98-4950-89a8-a4fe51733dc0 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Calling method '>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 09:02:48.698832 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-76b81227-5b98-4950-89a8-a4fe51733dc0 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] [instance: 1fa7d94e-9ddd-4cf7-a7c5-072231c6d0bb] Fetching instance by UUID {{(pid=123458) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 09:02:48.705944 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-76b81227-5b98-4950-89a8-a4fe51733dc0 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:02:48.706392 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-76b81227-5b98-4950-89a8-a4fe51733dc0 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:02:48.707166 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-76b81227-5b98-4950-89a8-a4fe51733dc0 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:02:48.707602 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-76b81227-5b98-4950-89a8-a4fe51733dc0 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:02:48.864575 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-76b81227-5b98-4950-89a8-a4fe51733dc0 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e47ecdfb01f447699275b13255c15d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578e6a35974d4e5c8a0cd4e5fa994259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 09:02:48.873697 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-76b81227-5b98-4950-89a8-a4fe51733dc0 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] 10.222.0.31 "GET /compute/v2.1/servers/1fa7d94e-9ddd-4cf7-a7c5-072231c6d0bb" status: 200 len: 1680 microversion: 2.1 time: 0.179608 Apr 29 09:02:48.874171 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 581/1156] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 09:02:48 2022] GET /compute/v2.1/servers/1fa7d94e-9ddd-4cf7-a7c5-072231c6d0bb => generated 1680 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 09:02:49.890864 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-5b258d7d-5011-4561-96b6-1805bca05e04 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Calling method '>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 09:02:49.891474 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-5b258d7d-5011-4561-96b6-1805bca05e04 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] [instance: 1fa7d94e-9ddd-4cf7-a7c5-072231c6d0bb] Fetching instance by UUID {{(pid=123459) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 09:02:49.899194 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-5b258d7d-5011-4561-96b6-1805bca05e04 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:02:49.899635 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-5b258d7d-5011-4561-96b6-1805bca05e04 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:02:49.900434 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-5b258d7d-5011-4561-96b6-1805bca05e04 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:02:49.900867 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-5b258d7d-5011-4561-96b6-1805bca05e04 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:02:50.051304 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-5b258d7d-5011-4561-96b6-1805bca05e04 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e47ecdfb01f447699275b13255c15d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578e6a35974d4e5c8a0cd4e5fa994259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 09:02:50.058973 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-5b258d7d-5011-4561-96b6-1805bca05e04 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] 10.222.0.31 "GET /compute/v2.1/servers/1fa7d94e-9ddd-4cf7-a7c5-072231c6d0bb" status: 200 len: 1680 microversion: 2.1 time: 0.171951 Apr 29 09:02:50.059561 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 576/1157] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 09:02:49 2022] GET /compute/v2.1/servers/1fa7d94e-9ddd-4cf7-a7c5-072231c6d0bb => generated 1680 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 09:02:50.819058 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [req-26d06879-b435-4a09-bca0-206db1d2a4ad req-d33790dc-1ff0-4c7a-ad2e-15031ab63adc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1fa7d94e-9ddd-4cf7-a7c5-072231c6d0bb", "name": "network-vif-deleted", "tag": "6c3b1255-2e99-4681-a117-5f4062b2074f"}]} {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 29 09:02:50.829881 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [req-26d06879-b435-4a09-bca0-206db1d2a4ad req-d33790dc-1ff0-4c7a-ad2e-15031ab63adc service nova] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:02:50.830325 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [req-26d06879-b435-4a09-bca0-206db1d2a4ad req-d33790dc-1ff0-4c7a-ad2e-15031ab63adc service nova] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:02:50.843071 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.compute.server_external_events [req-26d06879-b435-4a09-bca0-206db1d2a4ad req-d33790dc-1ff0-4c7a-ad2e-15031ab63adc service nova] Creating event network-vif-deleted:6c3b1255-2e99-4681-a117-5f4062b2074f for instance 1fa7d94e-9ddd-4cf7-a7c5-072231c6d0bb on hv-cinder-83987 Apr 29 09:02:50.849230 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [req-26d06879-b435-4a09-bca0-206db1d2a4ad req-d33790dc-1ff0-4c7a-ad2e-15031ab63adc service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033970 Apr 29 09:02:50.850413 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 582/1158] 10.222.0.31 () {64 vars in 1317 bytes} [Fri Apr 29 09:02:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 29 09:02:51.077947 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-59e71064-e8c0-4689-b770-0a326b7e1d82 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Calling method '>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 09:02:51.078574 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-59e71064-e8c0-4689-b770-0a326b7e1d82 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] [instance: 1fa7d94e-9ddd-4cf7-a7c5-072231c6d0bb] Fetching instance by UUID {{(pid=123459) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 09:02:51.085342 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-59e71064-e8c0-4689-b770-0a326b7e1d82 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:02:51.085798 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-59e71064-e8c0-4689-b770-0a326b7e1d82 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:02:51.086580 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-59e71064-e8c0-4689-b770-0a326b7e1d82 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:02:51.087021 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-59e71064-e8c0-4689-b770-0a326b7e1d82 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:02:51.129856 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-59e71064-e8c0-4689-b770-0a326b7e1d82 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:02:51.130351 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-59e71064-e8c0-4689-b770-0a326b7e1d82 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:02:51.130836 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.objects.instance [None req-59e71064-e8c0-4689-b770-0a326b7e1d82 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lazy-loading 'fault' on Instance uuid 1fa7d94e-9ddd-4cf7-a7c5-072231c6d0bb {{(pid=123459) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 29 09:02:51.184536 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-59e71064-e8c0-4689-b770-0a326b7e1d82 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e47ecdfb01f447699275b13255c15d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578e6a35974d4e5c8a0cd4e5fa994259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 09:02:51.193150 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-59e71064-e8c0-4689-b770-0a326b7e1d82 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] 10.222.0.31 "GET /compute/v2.1/servers/1fa7d94e-9ddd-4cf7-a7c5-072231c6d0bb" status: 200 len: 1330 microversion: 2.1 time: 0.120340 Apr 29 09:02:51.193731 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 577/1159] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 09:02:51 2022] GET /compute/v2.1/servers/1fa7d94e-9ddd-4cf7-a7c5-072231c6d0bb => generated 1330 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 09:02:52.212971 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-ef580243-9c65-4c8d-b326-e79055844d2f tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Calling method '>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 09:02:52.213802 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-ef580243-9c65-4c8d-b326-e79055844d2f tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] [instance: 1fa7d94e-9ddd-4cf7-a7c5-072231c6d0bb] Fetching instance by UUID {{(pid=123458) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 09:02:52.221327 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-ef580243-9c65-4c8d-b326-e79055844d2f tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:02:52.221781 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-ef580243-9c65-4c8d-b326-e79055844d2f tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:02:52.222588 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-ef580243-9c65-4c8d-b326-e79055844d2f tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:02:52.223034 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-ef580243-9c65-4c8d-b326-e79055844d2f tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:02:52.237881 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.wsgi [None req-ef580243-9c65-4c8d-b326-e79055844d2f tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] HTTP exception thrown: Instance 1fa7d94e-9ddd-4cf7-a7c5-072231c6d0bb could not be found. Apr 29 09:02:52.238512 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-ef580243-9c65-4c8d-b326-e79055844d2f tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Returning 404 to user: Instance 1fa7d94e-9ddd-4cf7-a7c5-072231c6d0bb could not be found. {{(pid=123458) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 29 09:02:52.239371 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-ef580243-9c65-4c8d-b326-e79055844d2f tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] 10.222.0.31 "GET /compute/v2.1/servers/1fa7d94e-9ddd-4cf7-a7c5-072231c6d0bb" status: 404 len: 111 microversion: 2.1 time: 0.031857 Apr 29 09:02:52.239957 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 583/1160] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 09:02:52 2022] GET /compute/v2.1/servers/1fa7d94e-9ddd-4cf7-a7c5-072231c6d0bb => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 29 09:02:52.251581 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-e1f0e38e-4aa3-4b54-adf4-fe2a85c914ab tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Calling method '.version_select at 0x7f6238535d30>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 09:02:52.273198 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-e1f0e38e-4aa3-4b54-adf4-fe2a85c914ab tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] 10.222.0.31 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-900471435" status: 202 len: 0 microversion: 2.1 time: 0.027965 Apr 29 09:02:52.273793 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 578/1161] 10.222.0.31 () {58 vars in 1217 bytes} [Fri Apr 29 09:02:52 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-900471435 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 29 09:02:54.101509 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-f11d0f0a-9088-4be7-8ac5-bd95cbfc8833 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Calling method '>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 09:02:54.102114 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-f11d0f0a-9088-4be7-8ac5-bd95cbfc8833 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] [instance: 1fa7d94e-9ddd-4cf7-a7c5-072231c6d0bb] Fetching instance by UUID {{(pid=123458) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 09:02:54.109219 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-f11d0f0a-9088-4be7-8ac5-bd95cbfc8833 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:02:54.109673 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-f11d0f0a-9088-4be7-8ac5-bd95cbfc8833 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:02:54.110457 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-f11d0f0a-9088-4be7-8ac5-bd95cbfc8833 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:02:54.110896 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-f11d0f0a-9088-4be7-8ac5-bd95cbfc8833 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:02:54.127072 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.wsgi [None req-f11d0f0a-9088-4be7-8ac5-bd95cbfc8833 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] HTTP exception thrown: Instance 1fa7d94e-9ddd-4cf7-a7c5-072231c6d0bb could not be found. Apr 29 09:02:54.127701 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-f11d0f0a-9088-4be7-8ac5-bd95cbfc8833 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Returning 404 to user: Instance 1fa7d94e-9ddd-4cf7-a7c5-072231c6d0bb could not be found. {{(pid=123458) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 29 09:02:54.128657 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-f11d0f0a-9088-4be7-8ac5-bd95cbfc8833 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] 10.222.0.31 "DELETE /compute/v2.1/servers/1fa7d94e-9ddd-4cf7-a7c5-072231c6d0bb" status: 404 len: 111 microversion: 2.1 time: 0.031338 Apr 29 09:02:54.129269 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 584/1162] 10.222.0.31 () {58 vars in 1238 bytes} [Fri Apr 29 09:02:54 2022] DELETE /compute/v2.1/servers/1fa7d94e-9ddd-4cf7-a7c5-072231c6d0bb => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 29 09:02:54.138218 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-85372334-fc8c-4879-a57b-a5510cf63551 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Calling method '>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 09:02:54.138834 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-85372334-fc8c-4879-a57b-a5510cf63551 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] [instance: 1fa7d94e-9ddd-4cf7-a7c5-072231c6d0bb] Fetching instance by UUID {{(pid=123459) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 09:02:54.145099 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-85372334-fc8c-4879-a57b-a5510cf63551 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:02:54.145551 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-85372334-fc8c-4879-a57b-a5510cf63551 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:02:54.146329 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-85372334-fc8c-4879-a57b-a5510cf63551 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:02:54.146766 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-85372334-fc8c-4879-a57b-a5510cf63551 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:02:54.160196 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.wsgi [None req-85372334-fc8c-4879-a57b-a5510cf63551 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] HTTP exception thrown: Instance 1fa7d94e-9ddd-4cf7-a7c5-072231c6d0bb could not be found. Apr 29 09:02:54.160795 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-85372334-fc8c-4879-a57b-a5510cf63551 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Returning 404 to user: Instance 1fa7d94e-9ddd-4cf7-a7c5-072231c6d0bb could not be found. {{(pid=123459) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 29 09:02:54.161635 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-85372334-fc8c-4879-a57b-a5510cf63551 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] 10.222.0.31 "GET /compute/v2.1/servers/1fa7d94e-9ddd-4cf7-a7c5-072231c6d0bb" status: 404 len: 111 microversion: 2.1 time: 0.028118 Apr 29 09:02:54.162192 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 579/1163] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 09:02:54 2022] GET /compute/v2.1/servers/1fa7d94e-9ddd-4cf7-a7c5-072231c6d0bb => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 29 09:02:55.297691 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-d3dfe38e-77ba-4ac8-89b8-a0d224e2bfdd tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Calling method '>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 09:02:55.298237 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-d3dfe38e-77ba-4ac8-89b8-a0d224e2bfdd tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] [instance: 6722378c-3c16-480e-b7de-4f9c8696fa03] Fetching instance by UUID {{(pid=123458) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 09:02:55.304531 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-d3dfe38e-77ba-4ac8-89b8-a0d224e2bfdd tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:02:55.304987 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-d3dfe38e-77ba-4ac8-89b8-a0d224e2bfdd tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:02:55.306318 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-d3dfe38e-77ba-4ac8-89b8-a0d224e2bfdd tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:02:55.306318 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-d3dfe38e-77ba-4ac8-89b8-a0d224e2bfdd tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:02:55.320673 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.wsgi [None req-d3dfe38e-77ba-4ac8-89b8-a0d224e2bfdd tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] HTTP exception thrown: Instance 6722378c-3c16-480e-b7de-4f9c8696fa03 could not be found. Apr 29 09:02:55.321276 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-d3dfe38e-77ba-4ac8-89b8-a0d224e2bfdd tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Returning 404 to user: Instance 6722378c-3c16-480e-b7de-4f9c8696fa03 could not be found. {{(pid=123458) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 29 09:02:55.322131 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-d3dfe38e-77ba-4ac8-89b8-a0d224e2bfdd tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] 10.222.0.31 "DELETE /compute/v2.1/servers/6722378c-3c16-480e-b7de-4f9c8696fa03" status: 404 len: 111 microversion: 2.1 time: 0.030078 Apr 29 09:02:55.322688 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 585/1164] 10.222.0.31 () {58 vars in 1238 bytes} [Fri Apr 29 09:02:55 2022] DELETE /compute/v2.1/servers/6722378c-3c16-480e-b7de-4f9c8696fa03 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 29 09:02:55.331154 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-dde89f47-e579-4e78-b513-8707bc4b9ed7 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Calling method '>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 09:02:55.331771 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-dde89f47-e579-4e78-b513-8707bc4b9ed7 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] [instance: 6722378c-3c16-480e-b7de-4f9c8696fa03] Fetching instance by UUID {{(pid=123459) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 09:02:55.338410 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-dde89f47-e579-4e78-b513-8707bc4b9ed7 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:02:55.338867 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-dde89f47-e579-4e78-b513-8707bc4b9ed7 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:02:55.340214 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-dde89f47-e579-4e78-b513-8707bc4b9ed7 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:02:55.341013 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-dde89f47-e579-4e78-b513-8707bc4b9ed7 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:02:55.358540 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.wsgi [None req-dde89f47-e579-4e78-b513-8707bc4b9ed7 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] HTTP exception thrown: Instance 6722378c-3c16-480e-b7de-4f9c8696fa03 could not be found. Apr 29 09:02:55.359135 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-dde89f47-e579-4e78-b513-8707bc4b9ed7 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Returning 404 to user: Instance 6722378c-3c16-480e-b7de-4f9c8696fa03 could not be found. {{(pid=123459) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 29 09:02:55.359966 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-dde89f47-e579-4e78-b513-8707bc4b9ed7 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] 10.222.0.31 "GET /compute/v2.1/servers/6722378c-3c16-480e-b7de-4f9c8696fa03" status: 404 len: 111 microversion: 2.1 time: 0.032683 Apr 29 09:02:55.360564 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 580/1165] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 09:02:55 2022] GET /compute/v2.1/servers/6722378c-3c16-480e-b7de-4f9c8696fa03 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 29 09:02:55.368502 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-2327b9ba-e122-400f-970a-313dc1c20aec tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Calling method '>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 09:02:55.369002 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-2327b9ba-e122-400f-970a-313dc1c20aec tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] [instance: 21ab666e-c39f-4202-9e7a-aa431a96a130] Fetching instance by UUID {{(pid=123458) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 09:02:55.375773 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-2327b9ba-e122-400f-970a-313dc1c20aec tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:02:55.376278 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-2327b9ba-e122-400f-970a-313dc1c20aec tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:02:55.377063 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-2327b9ba-e122-400f-970a-313dc1c20aec tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:02:55.377504 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-2327b9ba-e122-400f-970a-313dc1c20aec tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:02:55.392558 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.wsgi [None req-2327b9ba-e122-400f-970a-313dc1c20aec tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] HTTP exception thrown: Instance 21ab666e-c39f-4202-9e7a-aa431a96a130 could not be found. Apr 29 09:02:55.393161 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-2327b9ba-e122-400f-970a-313dc1c20aec tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Returning 404 to user: Instance 21ab666e-c39f-4202-9e7a-aa431a96a130 could not be found. {{(pid=123458) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 29 09:02:55.394020 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-2327b9ba-e122-400f-970a-313dc1c20aec tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] 10.222.0.31 "DELETE /compute/v2.1/servers/21ab666e-c39f-4202-9e7a-aa431a96a130" status: 404 len: 111 microversion: 2.1 time: 0.029348 Apr 29 09:02:55.394559 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 586/1166] 10.222.0.31 () {58 vars in 1238 bytes} [Fri Apr 29 09:02:55 2022] DELETE /compute/v2.1/servers/21ab666e-c39f-4202-9e7a-aa431a96a130 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 29 09:02:55.403047 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-e373815b-b7bc-4a20-af59-9edc45bcb787 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Calling method '>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 09:02:55.403874 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-e373815b-b7bc-4a20-af59-9edc45bcb787 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] [instance: 21ab666e-c39f-4202-9e7a-aa431a96a130] Fetching instance by UUID {{(pid=123459) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 09:02:55.409894 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-e373815b-b7bc-4a20-af59-9edc45bcb787 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:02:55.410335 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-e373815b-b7bc-4a20-af59-9edc45bcb787 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:02:55.411093 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-e373815b-b7bc-4a20-af59-9edc45bcb787 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:02:55.411527 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-e373815b-b7bc-4a20-af59-9edc45bcb787 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:02:55.426134 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.wsgi [None req-e373815b-b7bc-4a20-af59-9edc45bcb787 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] HTTP exception thrown: Instance 21ab666e-c39f-4202-9e7a-aa431a96a130 could not be found. Apr 29 09:02:55.426719 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-e373815b-b7bc-4a20-af59-9edc45bcb787 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Returning 404 to user: Instance 21ab666e-c39f-4202-9e7a-aa431a96a130 could not be found. {{(pid=123459) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 29 09:02:55.427559 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-e373815b-b7bc-4a20-af59-9edc45bcb787 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] 10.222.0.31 "GET /compute/v2.1/servers/21ab666e-c39f-4202-9e7a-aa431a96a130" status: 404 len: 111 microversion: 2.1 time: 0.028924 Apr 29 09:02:55.428095 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 581/1167] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 09:02:55 2022] GET /compute/v2.1/servers/21ab666e-c39f-4202-9e7a-aa431a96a130 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 29 09:02:56.565921 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-d701dfa4-930e-43fb-8b5f-8d7e6c0932e1 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Calling method '>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 09:02:56.566423 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-d701dfa4-930e-43fb-8b5f-8d7e6c0932e1 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] [instance: 0f9c17b6-b1a2-4ec6-ba8c-2097a8c8ccb7] Fetching instance by UUID {{(pid=123458) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 09:02:56.572798 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-d701dfa4-930e-43fb-8b5f-8d7e6c0932e1 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:02:56.573248 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-d701dfa4-930e-43fb-8b5f-8d7e6c0932e1 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:02:56.574017 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-d701dfa4-930e-43fb-8b5f-8d7e6c0932e1 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:02:56.574705 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-d701dfa4-930e-43fb-8b5f-8d7e6c0932e1 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:02:56.587835 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.wsgi [None req-d701dfa4-930e-43fb-8b5f-8d7e6c0932e1 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] HTTP exception thrown: Instance 0f9c17b6-b1a2-4ec6-ba8c-2097a8c8ccb7 could not be found. Apr 29 09:02:56.588452 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-d701dfa4-930e-43fb-8b5f-8d7e6c0932e1 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Returning 404 to user: Instance 0f9c17b6-b1a2-4ec6-ba8c-2097a8c8ccb7 could not be found. {{(pid=123458) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 29 09:02:56.589267 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-d701dfa4-930e-43fb-8b5f-8d7e6c0932e1 tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] 10.222.0.31 "DELETE /compute/v2.1/servers/0f9c17b6-b1a2-4ec6-ba8c-2097a8c8ccb7" status: 404 len: 111 microversion: 2.1 time: 0.027260 Apr 29 09:02:56.589931 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 587/1168] 10.222.0.31 () {58 vars in 1238 bytes} [Fri Apr 29 09:02:56 2022] DELETE /compute/v2.1/servers/0f9c17b6-b1a2-4ec6-ba8c-2097a8c8ccb7 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 29 09:02:56.598472 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-5fff16dc-71ff-43a1-959c-d2f68e17f00f tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Calling method '>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 09:02:56.599105 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-5fff16dc-71ff-43a1-959c-d2f68e17f00f tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] [instance: 0f9c17b6-b1a2-4ec6-ba8c-2097a8c8ccb7] Fetching instance by UUID {{(pid=123459) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 09:02:56.606421 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-5fff16dc-71ff-43a1-959c-d2f68e17f00f tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:02:56.606976 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-5fff16dc-71ff-43a1-959c-d2f68e17f00f tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:02:56.607765 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-5fff16dc-71ff-43a1-959c-d2f68e17f00f tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:02:56.608236 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-5fff16dc-71ff-43a1-959c-d2f68e17f00f tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:02:56.622479 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.wsgi [None req-5fff16dc-71ff-43a1-959c-d2f68e17f00f tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] HTTP exception thrown: Instance 0f9c17b6-b1a2-4ec6-ba8c-2097a8c8ccb7 could not be found. Apr 29 09:02:56.623054 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-5fff16dc-71ff-43a1-959c-d2f68e17f00f tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] Returning 404 to user: Instance 0f9c17b6-b1a2-4ec6-ba8c-2097a8c8ccb7 could not be found. {{(pid=123459) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 29 09:02:56.623905 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-5fff16dc-71ff-43a1-959c-d2f68e17f00f tempest-AttachVolumeNegativeTest-647604016 tempest-AttachVolumeNegativeTest-647604016-project] 10.222.0.31 "GET /compute/v2.1/servers/0f9c17b6-b1a2-4ec6-ba8c-2097a8c8ccb7" status: 404 len: 111 microversion: 2.1 time: 0.029557 Apr 29 09:02:56.624563 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 582/1169] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 09:02:56 2022] GET /compute/v2.1/servers/0f9c17b6-b1a2-4ec6-ba8c-2097a8c8ccb7 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 29 09:03:09.621913 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-f96be546-f4fb-43e2-a8af-d359ae0afa49 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Calling method '>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 09:03:09.623588 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-f96be546-f4fb-43e2-a8af-d359ae0afa49 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] [instance: e74dc909-2e3d-4acb-a05a-ed18d4c0f699] Fetching instance by UUID {{(pid=123458) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 09:03:09.630839 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-f96be546-f4fb-43e2-a8af-d359ae0afa49 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:03:09.631276 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-f96be546-f4fb-43e2-a8af-d359ae0afa49 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:03:09.632063 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-f96be546-f4fb-43e2-a8af-d359ae0afa49 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:03:09.632528 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-f96be546-f4fb-43e2-a8af-d359ae0afa49 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:03:09.663071 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-f96be546-f4fb-43e2-a8af-d359ae0afa49 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] 10.222.0.31 "GET /compute/v2.1/servers/e74dc909-2e3d-4acb-a05a-ed18d4c0f699/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.047038 Apr 29 09:03:09.663638 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 588/1170] 10.222.0.31 () {60 vars in 1342 bytes} [Fri Apr 29 09:03:09 2022] GET /compute/v2.1/servers/e74dc909-2e3d-4acb-a05a-ed18d4c0f699/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 09:03:09.722531 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-83dfbce4-b184-4e93-ac19-2e015d70ebed tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Calling method '>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 09:03:09.723146 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-83dfbce4-b184-4e93-ac19-2e015d70ebed tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] [instance: e74dc909-2e3d-4acb-a05a-ed18d4c0f699] Fetching instance by UUID {{(pid=123459) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 09:03:09.729577 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-83dfbce4-b184-4e93-ac19-2e015d70ebed tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:03:09.730339 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-83dfbce4-b184-4e93-ac19-2e015d70ebed tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:03:09.731871 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-83dfbce4-b184-4e93-ac19-2e015d70ebed tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:03:09.732346 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-83dfbce4-b184-4e93-ac19-2e015d70ebed tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:03:09.763730 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-83dfbce4-b184-4e93-ac19-2e015d70ebed tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] [instance: e74dc909-2e3d-4acb-a05a-ed18d4c0f699] Going to try to terminate instance {{(pid=123459) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 29 09:03:09.853645 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-83dfbce4-b184-4e93-ac19-2e015d70ebed tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] 10.222.0.31 "DELETE /compute/v2.1/servers/e74dc909-2e3d-4acb-a05a-ed18d4c0f699" status: 204 len: 0 microversion: 2.20 time: 0.134632 Apr 29 09:03:09.854629 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 583/1171] 10.222.0.31 () {60 vars in 1279 bytes} [Fri Apr 29 09:03:09 2022] DELETE /compute/v2.1/servers/e74dc909-2e3d-4acb-a05a-ed18d4c0f699 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 29 09:03:09.863528 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-41d251a2-4ad8-464d-8e28-81844b8e5e5a tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Calling method '>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 09:03:09.864166 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-41d251a2-4ad8-464d-8e28-81844b8e5e5a tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] [instance: e74dc909-2e3d-4acb-a05a-ed18d4c0f699] Fetching instance by UUID {{(pid=123458) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 09:03:09.870302 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-41d251a2-4ad8-464d-8e28-81844b8e5e5a tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:03:09.870783 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-41d251a2-4ad8-464d-8e28-81844b8e5e5a tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:03:09.872722 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-41d251a2-4ad8-464d-8e28-81844b8e5e5a tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:03:09.873228 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-41d251a2-4ad8-464d-8e28-81844b8e5e5a tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:03:10.027757 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-41d251a2-4ad8-464d-8e28-81844b8e5e5a tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 09:03:10.035712 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-41d251a2-4ad8-464d-8e28-81844b8e5e5a tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 09:03:10.037222 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-41d251a2-4ad8-464d-8e28-81844b8e5e5a tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 09:03:10.040179 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-41d251a2-4ad8-464d-8e28-81844b8e5e5a tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] 10.222.0.31 "GET /compute/v2.1/servers/e74dc909-2e3d-4acb-a05a-ed18d4c0f699" status: 200 len: 1724 microversion: 2.20 time: 0.178738 Apr 29 09:03:10.040179 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 589/1172] 10.222.0.31 () {60 vars in 1276 bytes} [Fri Apr 29 09:03:09 2022] GET /compute/v2.1/servers/e74dc909-2e3d-4acb-a05a-ed18d4c0f699 => generated 1724 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 29 09:03:11.059472 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-ce65b99c-8960-4a7e-968c-cc8e5187e3ed tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Calling method '>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 09:03:11.060197 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-ce65b99c-8960-4a7e-968c-cc8e5187e3ed tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] [instance: e74dc909-2e3d-4acb-a05a-ed18d4c0f699] Fetching instance by UUID {{(pid=123459) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 09:03:11.067019 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-ce65b99c-8960-4a7e-968c-cc8e5187e3ed tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:03:11.067471 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-ce65b99c-8960-4a7e-968c-cc8e5187e3ed tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:03:11.068404 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-ce65b99c-8960-4a7e-968c-cc8e5187e3ed tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:03:11.068839 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-ce65b99c-8960-4a7e-968c-cc8e5187e3ed tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:03:11.221109 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-ce65b99c-8960-4a7e-968c-cc8e5187e3ed tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 09:03:11.235774 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-ce65b99c-8960-4a7e-968c-cc8e5187e3ed tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 09:03:11.237344 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-ce65b99c-8960-4a7e-968c-cc8e5187e3ed tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 09:03:11.238529 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-ce65b99c-8960-4a7e-968c-cc8e5187e3ed tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] 10.222.0.31 "GET /compute/v2.1/servers/e74dc909-2e3d-4acb-a05a-ed18d4c0f699" status: 200 len: 1724 microversion: 2.20 time: 0.183429 Apr 29 09:03:11.239305 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 584/1173] 10.222.0.31 () {60 vars in 1276 bytes} [Fri Apr 29 09:03:11 2022] GET /compute/v2.1/servers/e74dc909-2e3d-4acb-a05a-ed18d4c0f699 => generated 1724 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 29 09:03:11.300673 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-7829a188-1357-4363-a452-7fb6e78d6127 tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-370874995", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1636555824", "security_groups": [{"name": "tempest-secgroup-smoke-1667238243"}], "block_device_mapping_v2": [{"uuid": "cd731978-8794-4109-837b-65197d410cce", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "1a8d7fea-92bf-4f68-8779-641df4ec3db8"}]}} {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 29 09:03:11.421716 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.network.neutron [None req-7829a188-1357-4363-a452-7fb6e78d6127 tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] validate_networks() for [('1a8d7fea-92bf-4f68-8779-641df4ec3db8', None, None, None, None, None)] {{(pid=123458) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 29 09:03:11.852971 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.virt.hardware [None req-7829a188-1357-4363-a452-7fb6e78d6127 tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] Flavor limits 0:0:0 {{(pid=123458) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 29 09:03:11.853422 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.virt.hardware [None req-7829a188-1357-4363-a452-7fb6e78d6127 tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] Image limits 0:0:0 {{(pid=123458) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 29 09:03:11.854143 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.virt.hardware [None req-7829a188-1357-4363-a452-7fb6e78d6127 tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] Flavor pref 0:0:0 {{(pid=123458) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 29 09:03:11.854529 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.virt.hardware [None req-7829a188-1357-4363-a452-7fb6e78d6127 tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] Image pref 0:0:0 {{(pid=123458) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 29 09:03:11.854967 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.virt.hardware [None req-7829a188-1357-4363-a452-7fb6e78d6127 tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123458) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 29 09:03:11.864560 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-7829a188-1357-4363-a452-7fb6e78d6127 tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:03:11.865008 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-7829a188-1357-4363-a452-7fb6e78d6127 tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:03:11.865811 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-7829a188-1357-4363-a452-7fb6e78d6127 tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:03:11.866247 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-7829a188-1357-4363-a452-7fb6e78d6127 tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:03:11.890291 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.quota [None req-7829a188-1357-4363-a452-7fb6e78d6127 tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] Getting quotas for project d8dd37ae188e415e86f551e3f760319e. Resources: {'instances', 'cores', 'ram'} {{(pid=123458) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 29 09:03:11.896045 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.quota [None req-7829a188-1357-4363-a452-7fb6e78d6127 tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] Getting quotas for user 3a82490fb17d42bf8c19f676fb687033 and project d8dd37ae188e415e86f551e3f760319e. Resources: {'instances', 'cores', 'ram'} {{(pid=123458) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 29 09:03:11.965448 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-7829a188-1357-4363-a452-7fb6e78d6127 tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] Going to run 1 instances... {{(pid=123458) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 29 09:03:11.967954 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-7829a188-1357-4363-a452-7fb6e78d6127 tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] [instance: 4cd472ef-6069-4ede-a481-7e09b8de064d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='cd731978-8794-4109-837b-65197d410cce',volume_size=None,volume_type=None)] {{(pid=123458) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 29 09:03:12.121506 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-7829a188-1357-4363-a452-7fb6e78d6127 tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] 10.222.0.31 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.824750 Apr 29 09:03:12.124037 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 590/1174] 10.222.0.31 () {60 vars in 1146 bytes} [Fri Apr 29 09:03:11 2022] POST /compute/v2.1/servers => generated 406 bytes in 828 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 29 09:03:12.132431 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-dbfc6044-f2c1-4300-94a5-acdef7fad5ed tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] Calling method '>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 09:03:12.133852 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-dbfc6044-f2c1-4300-94a5-acdef7fad5ed tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] [instance: 4cd472ef-6069-4ede-a481-7e09b8de064d] Fetching instance by UUID {{(pid=123459) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 09:03:12.200770 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-dbfc6044-f2c1-4300-94a5-acdef7fad5ed tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a82490fb17d42bf8c19f676fb687033', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8dd37ae188e415e86f551e3f760319e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 09:03:12.208337 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-dbfc6044-f2c1-4300-94a5-acdef7fad5ed tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] 10.222.0.31 "GET /compute/v2.1/servers/4cd472ef-6069-4ede-a481-7e09b8de064d" status: 200 len: 1094 microversion: 2.1 time: 0.079656 Apr 29 09:03:12.208924 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 585/1175] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 09:03:12 2022] GET /compute/v2.1/servers/4cd472ef-6069-4ede-a481-7e09b8de064d => generated 1094 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 29 09:03:12.257321 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-8738dc48-0d3f-4c48-9c9d-9fea1c1d919a tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Calling method '>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 09:03:12.257939 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-8738dc48-0d3f-4c48-9c9d-9fea1c1d919a tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] [instance: e74dc909-2e3d-4acb-a05a-ed18d4c0f699] Fetching instance by UUID {{(pid=123458) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 09:03:12.265880 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-8738dc48-0d3f-4c48-9c9d-9fea1c1d919a tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:03:12.266562 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-8738dc48-0d3f-4c48-9c9d-9fea1c1d919a tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:03:12.267350 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-8738dc48-0d3f-4c48-9c9d-9fea1c1d919a tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:03:12.267791 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-8738dc48-0d3f-4c48-9c9d-9fea1c1d919a tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:03:12.425115 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-8738dc48-0d3f-4c48-9c9d-9fea1c1d919a tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 09:03:12.436312 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-8738dc48-0d3f-4c48-9c9d-9fea1c1d919a tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 09:03:12.437948 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-8738dc48-0d3f-4c48-9c9d-9fea1c1d919a tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 09:03:12.439576 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-8738dc48-0d3f-4c48-9c9d-9fea1c1d919a tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] 10.222.0.31 "GET /compute/v2.1/servers/e74dc909-2e3d-4acb-a05a-ed18d4c0f699" status: 200 len: 1724 microversion: 2.20 time: 0.186284 Apr 29 09:03:12.440175 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 591/1176] 10.222.0.31 () {60 vars in 1276 bytes} [Fri Apr 29 09:03:12 2022] GET /compute/v2.1/servers/e74dc909-2e3d-4acb-a05a-ed18d4c0f699 => generated 1724 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 29 09:03:13.224765 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-d306b780-363f-49df-b8c7-6624209ae777 tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] Calling method '>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 09:03:13.225575 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-d306b780-363f-49df-b8c7-6624209ae777 tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] [instance: 4cd472ef-6069-4ede-a481-7e09b8de064d] Fetching instance by UUID {{(pid=123459) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 09:03:13.233984 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-d306b780-363f-49df-b8c7-6624209ae777 tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:03:13.234579 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-d306b780-363f-49df-b8c7-6624209ae777 tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:03:13.235472 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-d306b780-363f-49df-b8c7-6624209ae777 tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:03:13.236013 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-d306b780-363f-49df-b8c7-6624209ae777 tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:03:13.304373 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-d306b780-363f-49df-b8c7-6624209ae777 tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a82490fb17d42bf8c19f676fb687033', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8dd37ae188e415e86f551e3f760319e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 09:03:13.314329 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-d306b780-363f-49df-b8c7-6624209ae777 tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] 10.222.0.31 "GET /compute/v2.1/servers/4cd472ef-6069-4ede-a481-7e09b8de064d" status: 200 len: 1192 microversion: 2.1 time: 0.093404 Apr 29 09:03:13.321204 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 586/1177] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 09:03:13 2022] GET /compute/v2.1/servers/4cd472ef-6069-4ede-a481-7e09b8de064d => generated 1192 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 09:03:13.471878 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-6943d424-4eb0-443d-a073-f8e4b491afe0 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Calling method '>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 09:03:13.473193 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-6943d424-4eb0-443d-a073-f8e4b491afe0 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] [instance: e74dc909-2e3d-4acb-a05a-ed18d4c0f699] Fetching instance by UUID {{(pid=123458) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 09:03:13.488853 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-6943d424-4eb0-443d-a073-f8e4b491afe0 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:03:13.489645 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-6943d424-4eb0-443d-a073-f8e4b491afe0 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:03:13.490668 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-6943d424-4eb0-443d-a073-f8e4b491afe0 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:03:13.491544 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-6943d424-4eb0-443d-a073-f8e4b491afe0 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:03:13.586499 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-6943d424-4eb0-443d-a073-f8e4b491afe0 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 09:03:13.603868 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-6943d424-4eb0-443d-a073-f8e4b491afe0 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 09:03:13.606965 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-6943d424-4eb0-443d-a073-f8e4b491afe0 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 09:03:13.609370 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-6943d424-4eb0-443d-a073-f8e4b491afe0 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] 10.222.0.31 "GET /compute/v2.1/servers/e74dc909-2e3d-4acb-a05a-ed18d4c0f699" status: 200 len: 1656 microversion: 2.20 time: 0.144409 Apr 29 09:03:13.609952 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 592/1178] 10.222.0.31 () {60 vars in 1276 bytes} [Fri Apr 29 09:03:13 2022] GET /compute/v2.1/servers/e74dc909-2e3d-4acb-a05a-ed18d4c0f699 => generated 1656 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 29 09:03:14.004872 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [req-76a21c26-0c3f-4427-b67e-228cdb92f405 req-26eab947-b25f-4160-8b0f-8282db106b63 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e74dc909-2e3d-4acb-a05a-ed18d4c0f699", "name": "network-vif-deleted", "tag": "440a5656-f549-48bb-8394-679abd59d5c6"}]} {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 29 09:03:14.014171 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [req-76a21c26-0c3f-4427-b67e-228cdb92f405 req-26eab947-b25f-4160-8b0f-8282db106b63 service nova] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:03:14.015013 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [req-76a21c26-0c3f-4427-b67e-228cdb92f405 req-26eab947-b25f-4160-8b0f-8282db106b63 service nova] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:03:14.031524 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.compute.server_external_events [req-76a21c26-0c3f-4427-b67e-228cdb92f405 req-26eab947-b25f-4160-8b0f-8282db106b63 service nova] Creating event network-vif-deleted:440a5656-f549-48bb-8394-679abd59d5c6 for instance e74dc909-2e3d-4acb-a05a-ed18d4c0f699 on hv-cinder-83987 Apr 29 09:03:14.038446 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [req-76a21c26-0c3f-4427-b67e-228cdb92f405 req-26eab947-b25f-4160-8b0f-8282db106b63 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045793 Apr 29 09:03:14.039793 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 587/1179] 10.222.0.31 () {64 vars in 1317 bytes} [Fri Apr 29 09:03:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 29 09:03:14.331749 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-9f610e55-2eaf-41cd-9a6c-b1e3d4369056 tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] Calling method '>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 09:03:14.332404 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-9f610e55-2eaf-41cd-9a6c-b1e3d4369056 tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] [instance: 4cd472ef-6069-4ede-a481-7e09b8de064d] Fetching instance by UUID {{(pid=123458) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 09:03:14.339419 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-9f610e55-2eaf-41cd-9a6c-b1e3d4369056 tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:03:14.339849 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-9f610e55-2eaf-41cd-9a6c-b1e3d4369056 tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:03:14.340948 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-9f610e55-2eaf-41cd-9a6c-b1e3d4369056 tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:03:14.341624 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-9f610e55-2eaf-41cd-9a6c-b1e3d4369056 tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:03:14.620524 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-9f610e55-2eaf-41cd-9a6c-b1e3d4369056 tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a82490fb17d42bf8c19f676fb687033', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8dd37ae188e415e86f551e3f760319e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 09:03:14.637635 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-63fe94df-88f8-46a0-8fa7-ad8c47def6eb tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Calling method '>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 09:03:14.638536 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-63fe94df-88f8-46a0-8fa7-ad8c47def6eb tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] [instance: e74dc909-2e3d-4acb-a05a-ed18d4c0f699] Fetching instance by UUID {{(pid=123459) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 09:03:14.652409 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-9f610e55-2eaf-41cd-9a6c-b1e3d4369056 tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] 10.222.0.31 "GET /compute/v2.1/servers/4cd472ef-6069-4ede-a481-7e09b8de064d" status: 200 len: 1278 microversion: 2.1 time: 0.324446 Apr 29 09:03:14.664019 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 593/1180] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 09:03:14 2022] GET /compute/v2.1/servers/4cd472ef-6069-4ede-a481-7e09b8de064d => generated 1278 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 09:03:14.665132 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-63fe94df-88f8-46a0-8fa7-ad8c47def6eb tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:03:14.667092 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-63fe94df-88f8-46a0-8fa7-ad8c47def6eb tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:03:14.668524 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-63fe94df-88f8-46a0-8fa7-ad8c47def6eb tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:03:14.668980 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-63fe94df-88f8-46a0-8fa7-ad8c47def6eb tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:03:14.753263 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-63fe94df-88f8-46a0-8fa7-ad8c47def6eb tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:03:14.754614 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-63fe94df-88f8-46a0-8fa7-ad8c47def6eb tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:03:14.755111 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.objects.instance [None req-63fe94df-88f8-46a0-8fa7-ad8c47def6eb tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lazy-loading 'fault' on Instance uuid e74dc909-2e3d-4acb-a05a-ed18d4c0f699 {{(pid=123459) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 29 09:03:14.826580 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-63fe94df-88f8-46a0-8fa7-ad8c47def6eb tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 09:03:14.835986 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-63fe94df-88f8-46a0-8fa7-ad8c47def6eb tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 09:03:14.839078 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-63fe94df-88f8-46a0-8fa7-ad8c47def6eb tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'abdb65629422487fba47326d5971bb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2c3d18ff34afe806e090aec002a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 09:03:14.841395 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-63fe94df-88f8-46a0-8fa7-ad8c47def6eb tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] 10.222.0.31 "GET /compute/v2.1/servers/e74dc909-2e3d-4acb-a05a-ed18d4c0f699" status: 200 len: 1371 microversion: 2.20 time: 0.216060 Apr 29 09:03:14.843696 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 588/1181] 10.222.0.31 () {60 vars in 1276 bytes} [Fri Apr 29 09:03:14 2022] GET /compute/v2.1/servers/e74dc909-2e3d-4acb-a05a-ed18d4c0f699 => generated 1371 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 29 09:03:15.673599 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-afbd6c6d-f2da-44ed-a0ec-b1503a08abb2 tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] Calling method '>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 09:03:15.674215 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-afbd6c6d-f2da-44ed-a0ec-b1503a08abb2 tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] [instance: 4cd472ef-6069-4ede-a481-7e09b8de064d] Fetching instance by UUID {{(pid=123459) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 09:03:15.687713 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-afbd6c6d-f2da-44ed-a0ec-b1503a08abb2 tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:03:15.689748 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-afbd6c6d-f2da-44ed-a0ec-b1503a08abb2 tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:03:15.690734 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-afbd6c6d-f2da-44ed-a0ec-b1503a08abb2 tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:03:15.694307 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-afbd6c6d-f2da-44ed-a0ec-b1503a08abb2 tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:03:15.787616 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [req-6ba5a97e-b5dd-4095-ba8b-1bd0d8ec98d8 req-2817d53a-198e-4a61-989b-8ec8dd4ed131 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4cd472ef-6069-4ede-a481-7e09b8de064d", "tag": "30512652-ebc0-4dcf-8b65-9b0f2e8e0c5c"}]} {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 29 09:03:15.804635 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [req-6ba5a97e-b5dd-4095-ba8b-1bd0d8ec98d8 req-2817d53a-198e-4a61-989b-8ec8dd4ed131 service nova] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:03:15.805026 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [req-6ba5a97e-b5dd-4095-ba8b-1bd0d8ec98d8 req-2817d53a-198e-4a61-989b-8ec8dd4ed131 service nova] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:03:15.840687 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.compute.server_external_events [req-6ba5a97e-b5dd-4095-ba8b-1bd0d8ec98d8 req-2817d53a-198e-4a61-989b-8ec8dd4ed131 service nova] Creating event network-changed:30512652-ebc0-4dcf-8b65-9b0f2e8e0c5c for instance 4cd472ef-6069-4ede-a481-7e09b8de064d on hv-cinder-83987 Apr 29 09:03:15.857044 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [req-6ba5a97e-b5dd-4095-ba8b-1bd0d8ec98d8 req-2817d53a-198e-4a61-989b-8ec8dd4ed131 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.322278 Apr 29 09:03:15.858344 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 594/1182] 10.222.0.31 () {64 vars in 1317 bytes} [Fri Apr 29 09:03:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 29 09:03:15.864523 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-4703cace-4c70-441f-9b36-1a2a8ec1a48c tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Calling method '>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 09:03:15.865440 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-4703cace-4c70-441f-9b36-1a2a8ec1a48c tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] [instance: e74dc909-2e3d-4acb-a05a-ed18d4c0f699] Fetching instance by UUID {{(pid=123458) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 09:03:15.877485 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-4703cace-4c70-441f-9b36-1a2a8ec1a48c tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:03:15.878168 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-4703cace-4c70-441f-9b36-1a2a8ec1a48c tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:03:15.879310 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-4703cace-4c70-441f-9b36-1a2a8ec1a48c tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:03:15.879947 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-4703cace-4c70-441f-9b36-1a2a8ec1a48c tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:03:15.902016 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.wsgi [None req-4703cace-4c70-441f-9b36-1a2a8ec1a48c tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] HTTP exception thrown: Instance e74dc909-2e3d-4acb-a05a-ed18d4c0f699 could not be found. Apr 29 09:03:15.904967 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-4703cace-4c70-441f-9b36-1a2a8ec1a48c tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Returning 404 to user: Instance e74dc909-2e3d-4acb-a05a-ed18d4c0f699 could not be found. {{(pid=123458) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 29 09:03:15.906044 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-4703cace-4c70-441f-9b36-1a2a8ec1a48c tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] 10.222.0.31 "GET /compute/v2.1/servers/e74dc909-2e3d-4acb-a05a-ed18d4c0f699" status: 404 len: 111 microversion: 2.20 time: 0.046318 Apr 29 09:03:15.910188 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 595/1183] 10.222.0.31 () {60 vars in 1276 bytes} [Fri Apr 29 09:03:15 2022] GET /compute/v2.1/servers/e74dc909-2e3d-4acb-a05a-ed18d4c0f699 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 29 09:03:15.920519 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-999cd70b-1379-4187-a0f7-2bd563a97d36 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Calling method '.version_select at 0x7f623837ea60>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 09:03:15.954039 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-999cd70b-1379-4187-a0f7-2bd563a97d36 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] 10.222.0.31 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-982632728" status: 204 len: 0 microversion: 2.20 time: 0.039511 Apr 29 09:03:15.954743 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 596/1184] 10.222.0.31 () {60 vars in 1258 bytes} [Fri Apr 29 09:03:15 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-982632728 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 29 09:03:16.029191 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-afbd6c6d-f2da-44ed-a0ec-b1503a08abb2 tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a82490fb17d42bf8c19f676fb687033', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8dd37ae188e415e86f551e3f760319e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 09:03:16.037483 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-afbd6c6d-f2da-44ed-a0ec-b1503a08abb2 tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] 10.222.0.31 "GET /compute/v2.1/servers/4cd472ef-6069-4ede-a481-7e09b8de064d" status: 200 len: 1266 microversion: 2.1 time: 0.370461 Apr 29 09:03:16.038389 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 589/1185] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 09:03:15 2022] GET /compute/v2.1/servers/4cd472ef-6069-4ede-a481-7e09b8de064d => generated 1266 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 09:03:17.059467 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-2df9098a-d2ab-48df-ab62-735e2326f286 tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] Calling method '>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 09:03:17.060089 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-2df9098a-d2ab-48df-ab62-735e2326f286 tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] [instance: 4cd472ef-6069-4ede-a481-7e09b8de064d] Fetching instance by UUID {{(pid=123458) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 09:03:17.067168 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-2df9098a-d2ab-48df-ab62-735e2326f286 tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:03:17.067674 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-2df9098a-d2ab-48df-ab62-735e2326f286 tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:03:17.068530 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-2df9098a-d2ab-48df-ab62-735e2326f286 tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:03:17.068963 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-2df9098a-d2ab-48df-ab62-735e2326f286 tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:03:17.218901 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-2df9098a-d2ab-48df-ab62-735e2326f286 tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a82490fb17d42bf8c19f676fb687033', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8dd37ae188e415e86f551e3f760319e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 09:03:17.226318 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-2df9098a-d2ab-48df-ab62-735e2326f286 tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] 10.222.0.31 "GET /compute/v2.1/servers/4cd472ef-6069-4ede-a481-7e09b8de064d" status: 200 len: 1266 microversion: 2.1 time: 0.171140 Apr 29 09:03:17.226888 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 597/1186] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 09:03:17 2022] GET /compute/v2.1/servers/4cd472ef-6069-4ede-a481-7e09b8de064d => generated 1266 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 09:03:17.729707 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-ffa037ec-4445-4092-af22-a6d55ce7d056 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Calling method '>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 09:03:17.730267 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-ffa037ec-4445-4092-af22-a6d55ce7d056 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] [instance: e74dc909-2e3d-4acb-a05a-ed18d4c0f699] Fetching instance by UUID {{(pid=123459) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 09:03:17.736930 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-ffa037ec-4445-4092-af22-a6d55ce7d056 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:03:17.737373 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-ffa037ec-4445-4092-af22-a6d55ce7d056 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:03:17.738126 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-ffa037ec-4445-4092-af22-a6d55ce7d056 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:03:17.738557 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-ffa037ec-4445-4092-af22-a6d55ce7d056 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:03:17.752581 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.wsgi [None req-ffa037ec-4445-4092-af22-a6d55ce7d056 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] HTTP exception thrown: Instance e74dc909-2e3d-4acb-a05a-ed18d4c0f699 could not be found. Apr 29 09:03:17.753155 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-ffa037ec-4445-4092-af22-a6d55ce7d056 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Returning 404 to user: Instance e74dc909-2e3d-4acb-a05a-ed18d4c0f699 could not be found. {{(pid=123459) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 29 09:03:17.753960 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-ffa037ec-4445-4092-af22-a6d55ce7d056 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] 10.222.0.31 "DELETE /compute/v2.1/servers/e74dc909-2e3d-4acb-a05a-ed18d4c0f699" status: 404 len: 111 microversion: 2.20 time: 0.028080 Apr 29 09:03:17.754475 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 590/1187] 10.222.0.31 () {60 vars in 1279 bytes} [Fri Apr 29 09:03:17 2022] DELETE /compute/v2.1/servers/e74dc909-2e3d-4acb-a05a-ed18d4c0f699 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 29 09:03:17.762993 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-66b4a8e3-9b43-4e3d-8ab2-9f59f2d41ba1 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Calling method '>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 09:03:17.763626 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-66b4a8e3-9b43-4e3d-8ab2-9f59f2d41ba1 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] [instance: e74dc909-2e3d-4acb-a05a-ed18d4c0f699] Fetching instance by UUID {{(pid=123458) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 09:03:17.769622 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-66b4a8e3-9b43-4e3d-8ab2-9f59f2d41ba1 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:03:17.770069 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-66b4a8e3-9b43-4e3d-8ab2-9f59f2d41ba1 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:03:17.770836 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-66b4a8e3-9b43-4e3d-8ab2-9f59f2d41ba1 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:03:17.771273 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-66b4a8e3-9b43-4e3d-8ab2-9f59f2d41ba1 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:03:17.784633 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.wsgi [None req-66b4a8e3-9b43-4e3d-8ab2-9f59f2d41ba1 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] HTTP exception thrown: Instance e74dc909-2e3d-4acb-a05a-ed18d4c0f699 could not be found. Apr 29 09:03:17.785211 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-66b4a8e3-9b43-4e3d-8ab2-9f59f2d41ba1 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Returning 404 to user: Instance e74dc909-2e3d-4acb-a05a-ed18d4c0f699 could not be found. {{(pid=123458) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 29 09:03:17.786033 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-66b4a8e3-9b43-4e3d-8ab2-9f59f2d41ba1 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] 10.222.0.31 "GET /compute/v2.1/servers/e74dc909-2e3d-4acb-a05a-ed18d4c0f699" status: 404 len: 111 microversion: 2.20 time: 0.027597 Apr 29 09:03:17.786569 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 598/1188] 10.222.0.31 () {60 vars in 1276 bytes} [Fri Apr 29 09:03:17 2022] GET /compute/v2.1/servers/e74dc909-2e3d-4acb-a05a-ed18d4c0f699 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 29 09:03:18.242949 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-0e74e741-cdd6-4db3-856f-bb63e6acece3 tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] Calling method '>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 09:03:18.243261 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-0e74e741-cdd6-4db3-856f-bb63e6acece3 tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] [instance: 4cd472ef-6069-4ede-a481-7e09b8de064d] Fetching instance by UUID {{(pid=123459) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 09:03:18.250237 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-0e74e741-cdd6-4db3-856f-bb63e6acece3 tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:03:18.250683 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-0e74e741-cdd6-4db3-856f-bb63e6acece3 tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:03:18.251452 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-0e74e741-cdd6-4db3-856f-bb63e6acece3 tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:03:18.251880 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-0e74e741-cdd6-4db3-856f-bb63e6acece3 tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:03:18.398352 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-0e74e741-cdd6-4db3-856f-bb63e6acece3 tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a82490fb17d42bf8c19f676fb687033', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8dd37ae188e415e86f551e3f760319e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 09:03:18.405722 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-0e74e741-cdd6-4db3-856f-bb63e6acece3 tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] 10.222.0.31 "GET /compute/v2.1/servers/4cd472ef-6069-4ede-a481-7e09b8de064d" status: 200 len: 1266 microversion: 2.1 time: 0.166805 Apr 29 09:03:18.406644 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 591/1189] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 09:03:18 2022] GET /compute/v2.1/servers/4cd472ef-6069-4ede-a481-7e09b8de064d => generated 1266 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 09:03:19.423027 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-6bc66b52-b72f-4060-a0a0-5a64053f4945 tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] Calling method '>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 09:03:19.423708 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-6bc66b52-b72f-4060-a0a0-5a64053f4945 tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] [instance: 4cd472ef-6069-4ede-a481-7e09b8de064d] Fetching instance by UUID {{(pid=123458) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 09:03:19.430014 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-6bc66b52-b72f-4060-a0a0-5a64053f4945 tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:03:19.430470 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-6bc66b52-b72f-4060-a0a0-5a64053f4945 tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:03:19.431250 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-6bc66b52-b72f-4060-a0a0-5a64053f4945 tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:03:19.431690 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-6bc66b52-b72f-4060-a0a0-5a64053f4945 tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:03:19.569455 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-6bc66b52-b72f-4060-a0a0-5a64053f4945 tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a82490fb17d42bf8c19f676fb687033', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8dd37ae188e415e86f551e3f760319e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 09:03:19.577545 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-6bc66b52-b72f-4060-a0a0-5a64053f4945 tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] 10.222.0.31 "GET /compute/v2.1/servers/4cd472ef-6069-4ede-a481-7e09b8de064d" status: 200 len: 1266 microversion: 2.1 time: 0.158315 Apr 29 09:03:19.578127 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 599/1190] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 09:03:19 2022] GET /compute/v2.1/servers/4cd472ef-6069-4ede-a481-7e09b8de064d => generated 1266 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 09:03:20.595243 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-1adb2cb3-5cea-447e-b7df-65304379c2cf tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] Calling method '>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 09:03:20.595910 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-1adb2cb3-5cea-447e-b7df-65304379c2cf tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] [instance: 4cd472ef-6069-4ede-a481-7e09b8de064d] Fetching instance by UUID {{(pid=123459) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 09:03:20.602404 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-1adb2cb3-5cea-447e-b7df-65304379c2cf tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:03:20.602850 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-1adb2cb3-5cea-447e-b7df-65304379c2cf tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:03:20.603615 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-1adb2cb3-5cea-447e-b7df-65304379c2cf tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:03:20.604050 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-1adb2cb3-5cea-447e-b7df-65304379c2cf tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:03:20.733393 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-1adb2cb3-5cea-447e-b7df-65304379c2cf tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a82490fb17d42bf8c19f676fb687033', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8dd37ae188e415e86f551e3f760319e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 09:03:20.740742 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-1adb2cb3-5cea-447e-b7df-65304379c2cf tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] 10.222.0.31 "GET /compute/v2.1/servers/4cd472ef-6069-4ede-a481-7e09b8de064d" status: 200 len: 1266 microversion: 2.1 time: 0.150288 Apr 29 09:03:20.741305 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 592/1191] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 09:03:20 2022] GET /compute/v2.1/servers/4cd472ef-6069-4ede-a481-7e09b8de064d => generated 1266 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 09:03:21.758725 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-4572bd2c-4ece-4424-a5f0-58ae90683a37 tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] Calling method '>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 09:03:21.759336 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-4572bd2c-4ece-4424-a5f0-58ae90683a37 tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] [instance: 4cd472ef-6069-4ede-a481-7e09b8de064d] Fetching instance by UUID {{(pid=123458) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 09:03:21.765949 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-4572bd2c-4ece-4424-a5f0-58ae90683a37 tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:03:21.766329 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-4572bd2c-4ece-4424-a5f0-58ae90683a37 tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:03:21.767101 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-4572bd2c-4ece-4424-a5f0-58ae90683a37 tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:03:21.767539 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-4572bd2c-4ece-4424-a5f0-58ae90683a37 tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:03:21.904943 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-4572bd2c-4ece-4424-a5f0-58ae90683a37 tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a82490fb17d42bf8c19f676fb687033', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8dd37ae188e415e86f551e3f760319e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 09:03:21.913610 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-4572bd2c-4ece-4424-a5f0-58ae90683a37 tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] 10.222.0.31 "GET /compute/v2.1/servers/4cd472ef-6069-4ede-a481-7e09b8de064d" status: 200 len: 1266 microversion: 2.1 time: 0.158697 Apr 29 09:03:21.914559 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 600/1192] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 09:03:21 2022] GET /compute/v2.1/servers/4cd472ef-6069-4ede-a481-7e09b8de064d => generated 1266 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 09:03:22.933385 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-51d47700-f561-4115-876c-25300d2a756f tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] Calling method '>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 09:03:22.934235 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-51d47700-f561-4115-876c-25300d2a756f tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] [instance: 4cd472ef-6069-4ede-a481-7e09b8de064d] Fetching instance by UUID {{(pid=123459) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 09:03:22.940447 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-51d47700-f561-4115-876c-25300d2a756f tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:03:22.940902 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-51d47700-f561-4115-876c-25300d2a756f tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:03:22.941666 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-51d47700-f561-4115-876c-25300d2a756f tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:03:22.942092 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-51d47700-f561-4115-876c-25300d2a756f tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:03:23.077254 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-51d47700-f561-4115-876c-25300d2a756f tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a82490fb17d42bf8c19f676fb687033', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8dd37ae188e415e86f551e3f760319e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 09:03:23.086254 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-51d47700-f561-4115-876c-25300d2a756f tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] 10.222.0.31 "GET /compute/v2.1/servers/4cd472ef-6069-4ede-a481-7e09b8de064d" status: 200 len: 1266 microversion: 2.1 time: 0.156383 Apr 29 09:03:23.087300 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 593/1193] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 09:03:22 2022] GET /compute/v2.1/servers/4cd472ef-6069-4ede-a481-7e09b8de064d => generated 1266 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 09:03:24.104279 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-fa18af85-967e-4356-91cb-d68758528274 tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] Calling method '>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 09:03:24.104995 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-fa18af85-967e-4356-91cb-d68758528274 tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] [instance: 4cd472ef-6069-4ede-a481-7e09b8de064d] Fetching instance by UUID {{(pid=123458) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 09:03:24.112449 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-fa18af85-967e-4356-91cb-d68758528274 tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:03:24.112915 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-fa18af85-967e-4356-91cb-d68758528274 tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:03:24.113698 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-fa18af85-967e-4356-91cb-d68758528274 tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:03:24.114161 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-fa18af85-967e-4356-91cb-d68758528274 tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:03:24.207163 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-d15cca1b-db13-478e-b527-99bf9865c467 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Calling method '>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 09:03:24.207982 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-d15cca1b-db13-478e-b527-99bf9865c467 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] [instance: 406b5ad6-698e-457f-93f4-cdfd45fb3e8e] Fetching instance by UUID {{(pid=123459) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 09:03:24.216612 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-d15cca1b-db13-478e-b527-99bf9865c467 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:03:24.217187 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-d15cca1b-db13-478e-b527-99bf9865c467 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:03:24.218248 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-d15cca1b-db13-478e-b527-99bf9865c467 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:03:24.218680 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-d15cca1b-db13-478e-b527-99bf9865c467 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:03:24.236973 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.wsgi [None req-d15cca1b-db13-478e-b527-99bf9865c467 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] HTTP exception thrown: Instance 406b5ad6-698e-457f-93f4-cdfd45fb3e8e could not be found. Apr 29 09:03:24.237942 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-d15cca1b-db13-478e-b527-99bf9865c467 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Returning 404 to user: Instance 406b5ad6-698e-457f-93f4-cdfd45fb3e8e could not be found. {{(pid=123459) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 29 09:03:24.238782 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-d15cca1b-db13-478e-b527-99bf9865c467 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] 10.222.0.31 "DELETE /compute/v2.1/servers/406b5ad6-698e-457f-93f4-cdfd45fb3e8e" status: 404 len: 111 microversion: 2.20 time: 0.040286 Apr 29 09:03:24.239709 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 594/1194] 10.222.0.31 () {60 vars in 1279 bytes} [Fri Apr 29 09:03:24 2022] DELETE /compute/v2.1/servers/406b5ad6-698e-457f-93f4-cdfd45fb3e8e => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 29 09:03:24.249717 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-6bd191b2-4d4b-475d-af99-5f9e6e651309 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Calling method '>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 09:03:24.250514 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-6bd191b2-4d4b-475d-af99-5f9e6e651309 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] [instance: 406b5ad6-698e-457f-93f4-cdfd45fb3e8e] Fetching instance by UUID {{(pid=123459) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 09:03:24.257260 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-6bd191b2-4d4b-475d-af99-5f9e6e651309 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:03:24.257708 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-6bd191b2-4d4b-475d-af99-5f9e6e651309 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:03:24.258515 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-6bd191b2-4d4b-475d-af99-5f9e6e651309 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:03:24.258939 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-6bd191b2-4d4b-475d-af99-5f9e6e651309 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:03:24.274705 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.wsgi [None req-6bd191b2-4d4b-475d-af99-5f9e6e651309 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] HTTP exception thrown: Instance 406b5ad6-698e-457f-93f4-cdfd45fb3e8e could not be found. Apr 29 09:03:24.275344 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-6bd191b2-4d4b-475d-af99-5f9e6e651309 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] Returning 404 to user: Instance 406b5ad6-698e-457f-93f4-cdfd45fb3e8e could not be found. {{(pid=123459) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 29 09:03:24.276816 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-6bd191b2-4d4b-475d-af99-5f9e6e651309 tempest-AttachVolumeShelveTestJSON-495592871 tempest-AttachVolumeShelveTestJSON-495592871-project] 10.222.0.31 "GET /compute/v2.1/servers/406b5ad6-698e-457f-93f4-cdfd45fb3e8e" status: 404 len: 111 microversion: 2.20 time: 0.032434 Apr 29 09:03:24.277497 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 595/1195] 10.222.0.31 () {60 vars in 1276 bytes} [Fri Apr 29 09:03:24 2022] GET /compute/v2.1/servers/406b5ad6-698e-457f-93f4-cdfd45fb3e8e => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Apr 29 09:03:24.309960 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-fa18af85-967e-4356-91cb-d68758528274 tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a82490fb17d42bf8c19f676fb687033', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8dd37ae188e415e86f551e3f760319e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 09:03:24.326552 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-fa18af85-967e-4356-91cb-d68758528274 tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] 10.222.0.31 "GET /compute/v2.1/servers/4cd472ef-6069-4ede-a481-7e09b8de064d" status: 200 len: 1266 microversion: 2.1 time: 0.225394 Apr 29 09:03:24.338731 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 601/1196] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 09:03:24 2022] GET /compute/v2.1/servers/4cd472ef-6069-4ede-a481-7e09b8de064d => generated 1266 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 09:03:25.355427 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-476ef339-6df7-49fd-b50a-df9f0d69b2a9 tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] Calling method '>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 09:03:25.356513 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-476ef339-6df7-49fd-b50a-df9f0d69b2a9 tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] [instance: 4cd472ef-6069-4ede-a481-7e09b8de064d] Fetching instance by UUID {{(pid=123459) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 09:03:25.364970 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-476ef339-6df7-49fd-b50a-df9f0d69b2a9 tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:03:25.365618 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-476ef339-6df7-49fd-b50a-df9f0d69b2a9 tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:03:25.366437 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-476ef339-6df7-49fd-b50a-df9f0d69b2a9 tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:03:25.367526 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-476ef339-6df7-49fd-b50a-df9f0d69b2a9 tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:03:25.598031 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-476ef339-6df7-49fd-b50a-df9f0d69b2a9 tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a82490fb17d42bf8c19f676fb687033', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8dd37ae188e415e86f551e3f760319e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 09:03:25.610863 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-476ef339-6df7-49fd-b50a-df9f0d69b2a9 tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] 10.222.0.31 "GET /compute/v2.1/servers/4cd472ef-6069-4ede-a481-7e09b8de064d" status: 200 len: 1266 microversion: 2.1 time: 0.259360 Apr 29 09:03:25.611875 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 596/1197] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 09:03:25 2022] GET /compute/v2.1/servers/4cd472ef-6069-4ede-a481-7e09b8de064d => generated 1266 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 09:03:26.633772 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-d19a0953-6367-4db9-a852-fc1290adec39 tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] Calling method '>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 09:03:26.634371 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-d19a0953-6367-4db9-a852-fc1290adec39 tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] [instance: 4cd472ef-6069-4ede-a481-7e09b8de064d] Fetching instance by UUID {{(pid=123458) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 09:03:26.641774 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-d19a0953-6367-4db9-a852-fc1290adec39 tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:03:26.642600 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-d19a0953-6367-4db9-a852-fc1290adec39 tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:03:26.643667 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-d19a0953-6367-4db9-a852-fc1290adec39 tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:03:26.644479 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-d19a0953-6367-4db9-a852-fc1290adec39 tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:03:26.876050 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-d19a0953-6367-4db9-a852-fc1290adec39 tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a82490fb17d42bf8c19f676fb687033', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8dd37ae188e415e86f551e3f760319e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 09:03:26.891363 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-d19a0953-6367-4db9-a852-fc1290adec39 tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] 10.222.0.31 "GET /compute/v2.1/servers/4cd472ef-6069-4ede-a481-7e09b8de064d" status: 200 len: 1266 microversion: 2.1 time: 0.260579 Apr 29 09:03:26.904400 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 602/1198] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 09:03:26 2022] GET /compute/v2.1/servers/4cd472ef-6069-4ede-a481-7e09b8de064d => generated 1266 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 09:03:27.067133 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [req-e11324ff-59dc-4dd7-b750-b13391d21e22 req-507b82a9-e697-43a7-b444-a4ba790734ae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4cd472ef-6069-4ede-a481-7e09b8de064d", "name": "network-vif-plugged", "status": "completed", "tag": "30512652-ebc0-4dcf-8b65-9b0f2e8e0c5c"}]} {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 29 09:03:27.079852 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [req-e11324ff-59dc-4dd7-b750-b13391d21e22 req-507b82a9-e697-43a7-b444-a4ba790734ae service nova] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:03:27.080660 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [req-e11324ff-59dc-4dd7-b750-b13391d21e22 req-507b82a9-e697-43a7-b444-a4ba790734ae service nova] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:03:27.122439 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.compute.server_external_events [req-e11324ff-59dc-4dd7-b750-b13391d21e22 req-507b82a9-e697-43a7-b444-a4ba790734ae service nova] Creating event network-vif-plugged:30512652-ebc0-4dcf-8b65-9b0f2e8e0c5c for instance 4cd472ef-6069-4ede-a481-7e09b8de064d on hv-cinder-83987 Apr 29 09:03:27.129025 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [req-e11324ff-59dc-4dd7-b750-b13391d21e22 req-507b82a9-e697-43a7-b444-a4ba790734ae service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.241363 Apr 29 09:03:27.129930 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 597/1199] 10.222.0.31 () {64 vars in 1317 bytes} [Fri Apr 29 09:03:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 29 09:03:27.914500 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-5c5fb1d0-cd86-43b2-965a-b3d104bb119e tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] Calling method '>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 09:03:27.915996 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-5c5fb1d0-cd86-43b2-965a-b3d104bb119e tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] [instance: 4cd472ef-6069-4ede-a481-7e09b8de064d] Fetching instance by UUID {{(pid=123458) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 09:03:27.923459 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-5c5fb1d0-cd86-43b2-965a-b3d104bb119e tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:03:27.924334 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-5c5fb1d0-cd86-43b2-965a-b3d104bb119e tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:03:27.925612 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-5c5fb1d0-cd86-43b2-965a-b3d104bb119e tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:03:27.926284 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-5c5fb1d0-cd86-43b2-965a-b3d104bb119e tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:03:28.158121 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-5c5fb1d0-cd86-43b2-965a-b3d104bb119e tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a82490fb17d42bf8c19f676fb687033', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8dd37ae188e415e86f551e3f760319e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 09:03:28.171007 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-5c5fb1d0-cd86-43b2-965a-b3d104bb119e tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] 10.222.0.31 "GET /compute/v2.1/servers/4cd472ef-6069-4ede-a481-7e09b8de064d" status: 200 len: 1266 microversion: 2.1 time: 0.265444 Apr 29 09:03:28.171604 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 603/1200] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 09:03:27 2022] GET /compute/v2.1/servers/4cd472ef-6069-4ede-a481-7e09b8de064d => generated 1266 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 09:03:29.187569 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-e2b053f4-05e9-4fb9-8935-3b2bded3cb5c tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] Calling method '>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 09:03:29.188389 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-e2b053f4-05e9-4fb9-8935-3b2bded3cb5c tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] [instance: 4cd472ef-6069-4ede-a481-7e09b8de064d] Fetching instance by UUID {{(pid=123459) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 09:03:29.195641 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-e2b053f4-05e9-4fb9-8935-3b2bded3cb5c tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:03:29.195959 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-e2b053f4-05e9-4fb9-8935-3b2bded3cb5c tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:03:29.196839 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-e2b053f4-05e9-4fb9-8935-3b2bded3cb5c tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:03:29.197193 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-e2b053f4-05e9-4fb9-8935-3b2bded3cb5c tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:03:29.386862 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-e2b053f4-05e9-4fb9-8935-3b2bded3cb5c tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a82490fb17d42bf8c19f676fb687033', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8dd37ae188e415e86f551e3f760319e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 09:03:29.399126 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-e2b053f4-05e9-4fb9-8935-3b2bded3cb5c tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] 10.222.0.31 "GET /compute/v2.1/servers/4cd472ef-6069-4ede-a481-7e09b8de064d" status: 200 len: 1266 microversion: 2.1 time: 0.213868 Apr 29 09:03:29.400480 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 598/1201] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 09:03:29 2022] GET /compute/v2.1/servers/4cd472ef-6069-4ede-a481-7e09b8de064d => generated 1266 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 09:03:30.419203 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-7f27d11d-5dcb-4136-b613-33a700cc56a8 tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] Calling method '>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 09:03:30.419814 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-7f27d11d-5dcb-4136-b613-33a700cc56a8 tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] [instance: 4cd472ef-6069-4ede-a481-7e09b8de064d] Fetching instance by UUID {{(pid=123458) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 09:03:30.426764 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-7f27d11d-5dcb-4136-b613-33a700cc56a8 tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:03:30.427430 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-7f27d11d-5dcb-4136-b613-33a700cc56a8 tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:03:30.428251 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-7f27d11d-5dcb-4136-b613-33a700cc56a8 tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:03:30.429051 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-7f27d11d-5dcb-4136-b613-33a700cc56a8 tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:03:30.616397 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-7f27d11d-5dcb-4136-b613-33a700cc56a8 tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a82490fb17d42bf8c19f676fb687033', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8dd37ae188e415e86f551e3f760319e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 09:03:30.624927 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-7f27d11d-5dcb-4136-b613-33a700cc56a8 tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] 10.222.0.31 "GET /compute/v2.1/servers/4cd472ef-6069-4ede-a481-7e09b8de064d" status: 200 len: 1453 microversion: 2.1 time: 0.210107 Apr 29 09:03:30.625506 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 604/1202] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 09:03:30 2022] GET /compute/v2.1/servers/4cd472ef-6069-4ede-a481-7e09b8de064d => generated 1453 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 09:03:30.642056 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-b93a31b1-3b18-4739-b7e3-21839a480f5a tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] Calling method '>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 09:03:30.642666 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-b93a31b1-3b18-4739-b7e3-21839a480f5a tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] [instance: 4cd472ef-6069-4ede-a481-7e09b8de064d] Fetching instance by UUID {{(pid=123459) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 09:03:30.649732 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-b93a31b1-3b18-4739-b7e3-21839a480f5a tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:03:30.650180 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-b93a31b1-3b18-4739-b7e3-21839a480f5a tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:03:30.650951 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-b93a31b1-3b18-4739-b7e3-21839a480f5a tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:03:30.651555 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-b93a31b1-3b18-4739-b7e3-21839a480f5a tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:03:30.869084 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-b93a31b1-3b18-4739-b7e3-21839a480f5a tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a82490fb17d42bf8c19f676fb687033', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8dd37ae188e415e86f551e3f760319e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 09:03:30.877883 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-b93a31b1-3b18-4739-b7e3-21839a480f5a tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] 10.222.0.31 "GET /compute/v2.1/servers/4cd472ef-6069-4ede-a481-7e09b8de064d" status: 200 len: 1453 microversion: 2.1 time: 0.240256 Apr 29 09:03:30.878581 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 599/1203] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 09:03:30 2022] GET /compute/v2.1/servers/4cd472ef-6069-4ede-a481-7e09b8de064d => generated 1453 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 09:03:34.146197 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [req-6994141c-dab4-49d7-b399-e802b073dfb7 req-454df4e9-73ef-4f2e-93fe-a274377f505c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4cd472ef-6069-4ede-a481-7e09b8de064d", "tag": "30512652-ebc0-4dcf-8b65-9b0f2e8e0c5c"}]} {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 29 09:03:34.159741 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [req-6994141c-dab4-49d7-b399-e802b073dfb7 req-454df4e9-73ef-4f2e-93fe-a274377f505c service nova] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:03:34.161490 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [req-6994141c-dab4-49d7-b399-e802b073dfb7 req-454df4e9-73ef-4f2e-93fe-a274377f505c service nova] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:03:34.180014 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.compute.server_external_events [req-6994141c-dab4-49d7-b399-e802b073dfb7 req-454df4e9-73ef-4f2e-93fe-a274377f505c service nova] Creating event network-changed:30512652-ebc0-4dcf-8b65-9b0f2e8e0c5c for instance 4cd472ef-6069-4ede-a481-7e09b8de064d on hv-cinder-83987 Apr 29 09:03:34.191776 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [req-6994141c-dab4-49d7-b399-e802b073dfb7 req-454df4e9-73ef-4f2e-93fe-a274377f505c service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048838 Apr 29 09:03:34.193419 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 605/1204] 10.222.0.31 () {64 vars in 1317 bytes} [Fri Apr 29 09:03:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 29 09:03:35.866184 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-a410db6d-5b34-4d04-9ec6-7c3ebfcc28db tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Action: 'create', calling method: .version_select at 0x7f6238535550>, body: {"keypair": {"name": "tempest-keypair-986686593"}} {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 29 09:03:35.880596 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.quota [None req-a410db6d-5b34-4d04-9ec6-7c3ebfcc28db tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Getting quotas for project aba74bd5665f48f69b0d080b09b8ade5. Resources: {'key_pairs'} {{(pid=123459) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 29 09:03:35.884342 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.quota [None req-a410db6d-5b34-4d04-9ec6-7c3ebfcc28db tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Getting quotas for user 0fe54d1c29bf4300a2d2c9365d1d6dfc and project aba74bd5665f48f69b0d080b09b8ade5. Resources: {'key_pairs'} {{(pid=123459) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 29 09:03:36.101493 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.quota [None req-a410db6d-5b34-4d04-9ec6-7c3ebfcc28db tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Getting quotas for project aba74bd5665f48f69b0d080b09b8ade5. Resources: {'key_pairs'} {{(pid=123459) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 29 09:03:36.104992 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.quota [None req-a410db6d-5b34-4d04-9ec6-7c3ebfcc28db tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Getting quotas for user 0fe54d1c29bf4300a2d2c9365d1d6dfc and project aba74bd5665f48f69b0d080b09b8ade5. Resources: {'key_pairs'} {{(pid=123459) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 29 09:03:36.118159 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-a410db6d-5b34-4d04-9ec6-7c3ebfcc28db tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] 10.222.0.31 "POST /compute/v2.1/os-keypairs" status: 200 len: 2300 microversion: 2.1 time: 0.366416 Apr 29 09:03:36.118755 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 600/1205] 10.222.0.31 () {60 vars in 1157 bytes} [Fri Apr 29 09:03:35 2022] POST /compute/v2.1/os-keypairs => generated 2300 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 09:03:37.845915 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-7b2716e4-f8ae-43c4-bf57-309200889899 tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-633036813", "imageRef": "e0678f88-0b68-4453-b569-29fd065e544e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "1a79dedb-df01-4141-9876-7ec3cac354d9"}], "security_groups": [{"name": "tempest-securitygroup--513568090"}], "key_name": "tempest-keypair-986686593", "user_data": "}} {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 29 09:03:37.953851 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.network.neutron [None req-7b2716e4-f8ae-43c4-bf57-309200889899 tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] validate_networks() for [('1a79dedb-df01-4141-9876-7ec3cac354d9', None, None, None, None, None)] {{(pid=123458) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 29 09:03:38.411410 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.virt.hardware [None req-7b2716e4-f8ae-43c4-bf57-309200889899 tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Flavor limits 0:0:0 {{(pid=123458) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 29 09:03:38.412597 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.virt.hardware [None req-7b2716e4-f8ae-43c4-bf57-309200889899 tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Image limits 0:0:0 {{(pid=123458) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 29 09:03:38.412597 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.virt.hardware [None req-7b2716e4-f8ae-43c4-bf57-309200889899 tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Flavor pref 0:0:0 {{(pid=123458) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 29 09:03:38.413090 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.virt.hardware [None req-7b2716e4-f8ae-43c4-bf57-309200889899 tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Image pref 0:0:0 {{(pid=123458) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 29 09:03:38.413578 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.virt.hardware [None req-7b2716e4-f8ae-43c4-bf57-309200889899 tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123458) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 29 09:03:38.423649 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-7b2716e4-f8ae-43c4-bf57-309200889899 tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:03:38.424103 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-7b2716e4-f8ae-43c4-bf57-309200889899 tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:03:38.424952 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-7b2716e4-f8ae-43c4-bf57-309200889899 tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:03:38.425390 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-7b2716e4-f8ae-43c4-bf57-309200889899 tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:03:38.446560 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.quota [None req-7b2716e4-f8ae-43c4-bf57-309200889899 tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Getting quotas for project aba74bd5665f48f69b0d080b09b8ade5. Resources: {'instances', 'cores', 'ram'} {{(pid=123458) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 29 09:03:38.451250 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.quota [None req-7b2716e4-f8ae-43c4-bf57-309200889899 tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Getting quotas for user 0fe54d1c29bf4300a2d2c9365d1d6dfc and project aba74bd5665f48f69b0d080b09b8ade5. Resources: {'instances', 'cores', 'ram'} {{(pid=123458) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 29 09:03:38.462832 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-7b2716e4-f8ae-43c4-bf57-309200889899 tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Going to run 1 instances... {{(pid=123458) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 29 09:03:38.465253 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-7b2716e4-f8ae-43c4-bf57-309200889899 tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] [instance: 4e638d0d-740f-4461-a3de-b5e5a048de54] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e0678f88-0b68-4453-b569-29fd065e544e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123458) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 29 09:03:38.528442 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-7b2716e4-f8ae-43c4-bf57-309200889899 tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] 10.222.0.31 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.694049 Apr 29 09:03:38.529347 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 606/1206] 10.222.0.31 () {60 vars in 1146 bytes} [Fri Apr 29 09:03:37 2022] POST /compute/v2.1/servers => generated 401 bytes in 696 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 29 09:03:38.539608 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-de1f9a14-f35a-460a-a6f6-f0fff13d807f tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Calling method '>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 09:03:38.540699 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-de1f9a14-f35a-460a-a6f6-f0fff13d807f tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] [instance: 4e638d0d-740f-4461-a3de-b5e5a048de54] Fetching instance by UUID {{(pid=123459) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 09:03:38.614155 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-de1f9a14-f35a-460a-a6f6-f0fff13d807f tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fe54d1c29bf4300a2d2c9365d1d6dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aba74bd5665f48f69b0d080b09b8ade5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 09:03:38.620965 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-de1f9a14-f35a-460a-a6f6-f0fff13d807f tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] 10.222.0.31 "GET /compute/v2.1/servers/4e638d0d-740f-4461-a3de-b5e5a048de54" status: 200 len: 1236 microversion: 2.1 time: 0.085739 Apr 29 09:03:38.621603 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 601/1207] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 09:03:38 2022] GET /compute/v2.1/servers/4e638d0d-740f-4461-a3de-b5e5a048de54 => generated 1236 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 09:03:39.639980 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-8029ce10-b1af-4970-80f2-524f152839d9 tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Calling method '>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 09:03:39.640589 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-8029ce10-b1af-4970-80f2-524f152839d9 tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] [instance: 4e638d0d-740f-4461-a3de-b5e5a048de54] Fetching instance by UUID {{(pid=123458) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 09:03:39.646867 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-8029ce10-b1af-4970-80f2-524f152839d9 tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:03:39.647320 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-8029ce10-b1af-4970-80f2-524f152839d9 tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:03:39.648093 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-8029ce10-b1af-4970-80f2-524f152839d9 tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:03:39.648557 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-8029ce10-b1af-4970-80f2-524f152839d9 tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:03:39.710769 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-8029ce10-b1af-4970-80f2-524f152839d9 tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fe54d1c29bf4300a2d2c9365d1d6dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aba74bd5665f48f69b0d080b09b8ade5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 09:03:39.718278 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-8029ce10-b1af-4970-80f2-524f152839d9 tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] 10.222.0.31 "GET /compute/v2.1/servers/4e638d0d-740f-4461-a3de-b5e5a048de54" status: 200 len: 1288 microversion: 2.1 time: 0.083414 Apr 29 09:03:39.718854 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 607/1208] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 09:03:39 2022] GET /compute/v2.1/servers/4e638d0d-740f-4461-a3de-b5e5a048de54 => generated 1288 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 29 09:03:40.734721 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-5469c000-fa2b-4c9b-8738-69239ab482d5 tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Calling method '>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 09:03:40.735363 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-5469c000-fa2b-4c9b-8738-69239ab482d5 tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] [instance: 4e638d0d-740f-4461-a3de-b5e5a048de54] Fetching instance by UUID {{(pid=123459) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 09:03:40.741738 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-5469c000-fa2b-4c9b-8738-69239ab482d5 tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:03:40.742176 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-5469c000-fa2b-4c9b-8738-69239ab482d5 tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:03:40.742938 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-5469c000-fa2b-4c9b-8738-69239ab482d5 tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:03:40.743368 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-5469c000-fa2b-4c9b-8738-69239ab482d5 tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:03:40.807041 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-5469c000-fa2b-4c9b-8738-69239ab482d5 tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fe54d1c29bf4300a2d2c9365d1d6dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aba74bd5665f48f69b0d080b09b8ade5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 09:03:40.815177 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-5469c000-fa2b-4c9b-8738-69239ab482d5 tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] 10.222.0.31 "GET /compute/v2.1/servers/4e638d0d-740f-4461-a3de-b5e5a048de54" status: 200 len: 1288 microversion: 2.1 time: 0.084532 Apr 29 09:03:40.815743 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 602/1209] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 09:03:40 2022] GET /compute/v2.1/servers/4e638d0d-740f-4461-a3de-b5e5a048de54 => generated 1288 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 09:03:41.831715 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-1e87afad-20ee-471d-838d-1ca356de44c2 tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Calling method '>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 09:03:41.832432 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-1e87afad-20ee-471d-838d-1ca356de44c2 tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] [instance: 4e638d0d-740f-4461-a3de-b5e5a048de54] Fetching instance by UUID {{(pid=123458) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 09:03:41.839411 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-1e87afad-20ee-471d-838d-1ca356de44c2 tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:03:41.839862 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-1e87afad-20ee-471d-838d-1ca356de44c2 tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:03:41.841349 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-1e87afad-20ee-471d-838d-1ca356de44c2 tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:03:41.841794 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-1e87afad-20ee-471d-838d-1ca356de44c2 tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:03:41.904113 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-1e87afad-20ee-471d-838d-1ca356de44c2 tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fe54d1c29bf4300a2d2c9365d1d6dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aba74bd5665f48f69b0d080b09b8ade5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 09:03:41.911970 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-1e87afad-20ee-471d-838d-1ca356de44c2 tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] 10.222.0.31 "GET /compute/v2.1/servers/4e638d0d-740f-4461-a3de-b5e5a048de54" status: 200 len: 1296 microversion: 2.1 time: 0.084056 Apr 29 09:03:41.912579 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 608/1210] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 09:03:41 2022] GET /compute/v2.1/servers/4e638d0d-740f-4461-a3de-b5e5a048de54 => generated 1296 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 09:03:42.930098 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-62a93803-1519-4bbf-b555-83e3e217464b tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Calling method '>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 09:03:42.930690 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-62a93803-1519-4bbf-b555-83e3e217464b tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] [instance: 4e638d0d-740f-4461-a3de-b5e5a048de54] Fetching instance by UUID {{(pid=123459) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 09:03:42.938253 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-62a93803-1519-4bbf-b555-83e3e217464b tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:03:42.938708 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-62a93803-1519-4bbf-b555-83e3e217464b tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:03:42.939493 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-62a93803-1519-4bbf-b555-83e3e217464b tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:03:42.939932 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-62a93803-1519-4bbf-b555-83e3e217464b tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:03:43.002544 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-62a93803-1519-4bbf-b555-83e3e217464b tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fe54d1c29bf4300a2d2c9365d1d6dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aba74bd5665f48f69b0d080b09b8ade5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 09:03:43.009882 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-62a93803-1519-4bbf-b555-83e3e217464b tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] 10.222.0.31 "GET /compute/v2.1/servers/4e638d0d-740f-4461-a3de-b5e5a048de54" status: 200 len: 1296 microversion: 2.1 time: 0.083761 Apr 29 09:03:43.010429 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 603/1211] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 09:03:42 2022] GET /compute/v2.1/servers/4e638d0d-740f-4461-a3de-b5e5a048de54 => generated 1296 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 29 09:03:44.027897 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-a93538d8-cef0-46c1-8143-41c2c5fce999 tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Calling method '>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 09:03:44.029715 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-a93538d8-cef0-46c1-8143-41c2c5fce999 tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] [instance: 4e638d0d-740f-4461-a3de-b5e5a048de54] Fetching instance by UUID {{(pid=123458) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 09:03:44.038989 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-a93538d8-cef0-46c1-8143-41c2c5fce999 tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:03:44.039446 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-a93538d8-cef0-46c1-8143-41c2c5fce999 tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:03:44.040330 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-a93538d8-cef0-46c1-8143-41c2c5fce999 tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:03:44.040712 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-a93538d8-cef0-46c1-8143-41c2c5fce999 tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:03:44.278101 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-a93538d8-cef0-46c1-8143-41c2c5fce999 tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fe54d1c29bf4300a2d2c9365d1d6dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aba74bd5665f48f69b0d080b09b8ade5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 09:03:44.285623 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-a93538d8-cef0-46c1-8143-41c2c5fce999 tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] 10.222.0.31 "GET /compute/v2.1/servers/4e638d0d-740f-4461-a3de-b5e5a048de54" status: 200 len: 1361 microversion: 2.1 time: 0.262588 Apr 29 09:03:44.286194 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 609/1212] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 09:03:44 2022] GET /compute/v2.1/servers/4e638d0d-740f-4461-a3de-b5e5a048de54 => generated 1361 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 09:03:44.708936 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [req-0e5aa6f8-d93f-49de-8361-0efb9df94b50 req-570a9b0d-3394-4379-a4d8-eeb23abeff00 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4e638d0d-740f-4461-a3de-b5e5a048de54", "tag": "5c22483b-a6ab-4eee-8e1e-95997e13d961"}]} {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 29 09:03:44.724921 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [req-0e5aa6f8-d93f-49de-8361-0efb9df94b50 req-570a9b0d-3394-4379-a4d8-eeb23abeff00 service nova] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:03:44.725358 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [req-0e5aa6f8-d93f-49de-8361-0efb9df94b50 req-570a9b0d-3394-4379-a4d8-eeb23abeff00 service nova] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:03:44.748860 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.compute.server_external_events [req-0e5aa6f8-d93f-49de-8361-0efb9df94b50 req-570a9b0d-3394-4379-a4d8-eeb23abeff00 service nova] Creating event network-changed:5c22483b-a6ab-4eee-8e1e-95997e13d961 for instance 4e638d0d-740f-4461-a3de-b5e5a048de54 on hv-cinder-83987 Apr 29 09:03:44.754358 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [req-0e5aa6f8-d93f-49de-8361-0efb9df94b50 req-570a9b0d-3394-4379-a4d8-eeb23abeff00 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049971 Apr 29 09:03:44.755189 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 604/1213] 10.222.0.31 () {64 vars in 1317 bytes} [Fri Apr 29 09:03:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 29 09:03:45.303006 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-fde45231-1e57-4a4e-a1da-1e570064782d tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Calling method '>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 09:03:45.303689 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-fde45231-1e57-4a4e-a1da-1e570064782d tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] [instance: 4e638d0d-740f-4461-a3de-b5e5a048de54] Fetching instance by UUID {{(pid=123458) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 09:03:45.309971 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-fde45231-1e57-4a4e-a1da-1e570064782d tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:03:45.310426 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-fde45231-1e57-4a4e-a1da-1e570064782d tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:03:45.311242 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-fde45231-1e57-4a4e-a1da-1e570064782d tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:03:45.311709 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-fde45231-1e57-4a4e-a1da-1e570064782d tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:03:45.450806 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-fde45231-1e57-4a4e-a1da-1e570064782d tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fe54d1c29bf4300a2d2c9365d1d6dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aba74bd5665f48f69b0d080b09b8ade5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 09:03:45.458709 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-fde45231-1e57-4a4e-a1da-1e570064782d tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] 10.222.0.31 "GET /compute/v2.1/servers/4e638d0d-740f-4461-a3de-b5e5a048de54" status: 200 len: 1361 microversion: 2.1 time: 0.159857 Apr 29 09:03:45.459287 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 610/1214] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 09:03:45 2022] GET /compute/v2.1/servers/4e638d0d-740f-4461-a3de-b5e5a048de54 => generated 1361 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 09:03:46.479847 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-72ca0ebc-58c0-467b-a20f-fde9f342d2c1 tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Calling method '>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 09:03:46.480592 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-72ca0ebc-58c0-467b-a20f-fde9f342d2c1 tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] [instance: 4e638d0d-740f-4461-a3de-b5e5a048de54] Fetching instance by UUID {{(pid=123459) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 09:03:46.487375 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-72ca0ebc-58c0-467b-a20f-fde9f342d2c1 tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:03:46.487840 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-72ca0ebc-58c0-467b-a20f-fde9f342d2c1 tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:03:46.488666 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-72ca0ebc-58c0-467b-a20f-fde9f342d2c1 tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:03:46.489073 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-72ca0ebc-58c0-467b-a20f-fde9f342d2c1 tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:03:46.622171 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-72ca0ebc-58c0-467b-a20f-fde9f342d2c1 tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fe54d1c29bf4300a2d2c9365d1d6dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aba74bd5665f48f69b0d080b09b8ade5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 09:03:46.629799 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-72ca0ebc-58c0-467b-a20f-fde9f342d2c1 tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] 10.222.0.31 "GET /compute/v2.1/servers/4e638d0d-740f-4461-a3de-b5e5a048de54" status: 200 len: 1361 microversion: 2.1 time: 0.154621 Apr 29 09:03:46.630370 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 605/1215] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 09:03:46 2022] GET /compute/v2.1/servers/4e638d0d-740f-4461-a3de-b5e5a048de54 => generated 1361 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 09:03:47.646823 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-49438b54-c82f-4405-8643-0a2faf299cc2 tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Calling method '>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 09:03:47.647429 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-49438b54-c82f-4405-8643-0a2faf299cc2 tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] [instance: 4e638d0d-740f-4461-a3de-b5e5a048de54] Fetching instance by UUID {{(pid=123458) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 09:03:47.654440 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-49438b54-c82f-4405-8643-0a2faf299cc2 tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:03:47.654891 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-49438b54-c82f-4405-8643-0a2faf299cc2 tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:03:47.655662 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-49438b54-c82f-4405-8643-0a2faf299cc2 tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:03:47.656102 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-49438b54-c82f-4405-8643-0a2faf299cc2 tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:03:47.785087 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-49438b54-c82f-4405-8643-0a2faf299cc2 tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fe54d1c29bf4300a2d2c9365d1d6dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aba74bd5665f48f69b0d080b09b8ade5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 09:03:47.792637 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-49438b54-c82f-4405-8643-0a2faf299cc2 tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] 10.222.0.31 "GET /compute/v2.1/servers/4e638d0d-740f-4461-a3de-b5e5a048de54" status: 200 len: 1361 microversion: 2.1 time: 0.149620 Apr 29 09:03:47.793192 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 611/1216] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 09:03:47 2022] GET /compute/v2.1/servers/4e638d0d-740f-4461-a3de-b5e5a048de54 => generated 1361 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 09:03:48.809268 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-c06c288f-4ee0-4704-90e8-98e451c50cf3 tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Calling method '>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 09:03:48.810547 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-c06c288f-4ee0-4704-90e8-98e451c50cf3 tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] [instance: 4e638d0d-740f-4461-a3de-b5e5a048de54] Fetching instance by UUID {{(pid=123459) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 09:03:48.817396 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-c06c288f-4ee0-4704-90e8-98e451c50cf3 tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:03:48.817842 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-c06c288f-4ee0-4704-90e8-98e451c50cf3 tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:03:48.818616 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-c06c288f-4ee0-4704-90e8-98e451c50cf3 tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:03:48.819052 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-c06c288f-4ee0-4704-90e8-98e451c50cf3 tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:03:48.951487 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-c06c288f-4ee0-4704-90e8-98e451c50cf3 tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fe54d1c29bf4300a2d2c9365d1d6dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aba74bd5665f48f69b0d080b09b8ade5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 09:03:48.959436 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-c06c288f-4ee0-4704-90e8-98e451c50cf3 tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] 10.222.0.31 "GET /compute/v2.1/servers/4e638d0d-740f-4461-a3de-b5e5a048de54" status: 200 len: 1361 microversion: 2.1 time: 0.153926 Apr 29 09:03:48.960038 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 606/1217] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 09:03:48 2022] GET /compute/v2.1/servers/4e638d0d-740f-4461-a3de-b5e5a048de54 => generated 1361 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 09:03:49.976434 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-024fa7ec-9942-46bc-8768-10b1985316e6 tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Calling method '>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 09:03:49.980899 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-024fa7ec-9942-46bc-8768-10b1985316e6 tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] [instance: 4e638d0d-740f-4461-a3de-b5e5a048de54] Fetching instance by UUID {{(pid=123458) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 09:03:49.987408 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-024fa7ec-9942-46bc-8768-10b1985316e6 tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:03:49.987863 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-024fa7ec-9942-46bc-8768-10b1985316e6 tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:03:49.988673 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-024fa7ec-9942-46bc-8768-10b1985316e6 tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:03:49.989116 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-024fa7ec-9942-46bc-8768-10b1985316e6 tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:03:50.116615 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-024fa7ec-9942-46bc-8768-10b1985316e6 tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fe54d1c29bf4300a2d2c9365d1d6dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aba74bd5665f48f69b0d080b09b8ade5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 09:03:50.124688 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-024fa7ec-9942-46bc-8768-10b1985316e6 tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] 10.222.0.31 "GET /compute/v2.1/servers/4e638d0d-740f-4461-a3de-b5e5a048de54" status: 200 len: 1361 microversion: 2.1 time: 0.152183 Apr 29 09:03:50.125260 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 612/1218] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 09:03:49 2022] GET /compute/v2.1/servers/4e638d0d-740f-4461-a3de-b5e5a048de54 => generated 1361 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 09:03:51.141225 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-d73eba2d-e14a-43f7-a2bc-99c4d30d99b4 tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Calling method '>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 09:03:51.141776 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-d73eba2d-e14a-43f7-a2bc-99c4d30d99b4 tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] [instance: 4e638d0d-740f-4461-a3de-b5e5a048de54] Fetching instance by UUID {{(pid=123459) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 09:03:51.148029 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-d73eba2d-e14a-43f7-a2bc-99c4d30d99b4 tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:03:51.148500 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-d73eba2d-e14a-43f7-a2bc-99c4d30d99b4 tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:03:51.149260 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-d73eba2d-e14a-43f7-a2bc-99c4d30d99b4 tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:03:51.149696 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-d73eba2d-e14a-43f7-a2bc-99c4d30d99b4 tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:03:51.279319 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-d73eba2d-e14a-43f7-a2bc-99c4d30d99b4 tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fe54d1c29bf4300a2d2c9365d1d6dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aba74bd5665f48f69b0d080b09b8ade5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 09:03:51.286751 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-d73eba2d-e14a-43f7-a2bc-99c4d30d99b4 tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] 10.222.0.31 "GET /compute/v2.1/servers/4e638d0d-740f-4461-a3de-b5e5a048de54" status: 200 len: 1361 microversion: 2.1 time: 0.149421 Apr 29 09:03:51.287307 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 607/1219] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 09:03:51 2022] GET /compute/v2.1/servers/4e638d0d-740f-4461-a3de-b5e5a048de54 => generated 1361 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 09:03:52.304546 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-9c5b828f-cf98-4dbb-9cef-5551b50b9492 tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Calling method '>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 09:03:52.305160 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-9c5b828f-cf98-4dbb-9cef-5551b50b9492 tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] [instance: 4e638d0d-740f-4461-a3de-b5e5a048de54] Fetching instance by UUID {{(pid=123458) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 09:03:52.311619 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-9c5b828f-cf98-4dbb-9cef-5551b50b9492 tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:03:52.312099 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-9c5b828f-cf98-4dbb-9cef-5551b50b9492 tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:03:52.312925 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-9c5b828f-cf98-4dbb-9cef-5551b50b9492 tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:03:52.313371 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-9c5b828f-cf98-4dbb-9cef-5551b50b9492 tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:03:52.450087 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-9c5b828f-cf98-4dbb-9cef-5551b50b9492 tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fe54d1c29bf4300a2d2c9365d1d6dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aba74bd5665f48f69b0d080b09b8ade5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 09:03:52.458560 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-9c5b828f-cf98-4dbb-9cef-5551b50b9492 tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] 10.222.0.31 "GET /compute/v2.1/servers/4e638d0d-740f-4461-a3de-b5e5a048de54" status: 200 len: 1361 microversion: 2.1 time: 0.158155 Apr 29 09:03:52.459168 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 613/1220] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 09:03:52 2022] GET /compute/v2.1/servers/4e638d0d-740f-4461-a3de-b5e5a048de54 => generated 1361 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 09:03:53.476635 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-90564404-c7c2-4690-b8ca-d08066ffde81 tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Calling method '>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 09:03:53.477223 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-90564404-c7c2-4690-b8ca-d08066ffde81 tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] [instance: 4e638d0d-740f-4461-a3de-b5e5a048de54] Fetching instance by UUID {{(pid=123459) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 09:03:53.483908 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-90564404-c7c2-4690-b8ca-d08066ffde81 tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:03:53.484407 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-90564404-c7c2-4690-b8ca-d08066ffde81 tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:03:53.485577 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-90564404-c7c2-4690-b8ca-d08066ffde81 tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:03:53.486019 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-90564404-c7c2-4690-b8ca-d08066ffde81 tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:03:53.637904 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-90564404-c7c2-4690-b8ca-d08066ffde81 tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fe54d1c29bf4300a2d2c9365d1d6dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aba74bd5665f48f69b0d080b09b8ade5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 09:03:53.645332 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-90564404-c7c2-4690-b8ca-d08066ffde81 tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] 10.222.0.31 "GET /compute/v2.1/servers/4e638d0d-740f-4461-a3de-b5e5a048de54" status: 200 len: 1361 microversion: 2.1 time: 0.172580 Apr 29 09:03:53.645893 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 608/1221] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 09:03:53 2022] GET /compute/v2.1/servers/4e638d0d-740f-4461-a3de-b5e5a048de54 => generated 1361 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 09:03:54.504970 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [req-ec7a1382-be35-4144-bc1f-4fb3ded69ee7 req-f6af5ab4-dcc4-423b-b455-c9f7119dd6ff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4e638d0d-740f-4461-a3de-b5e5a048de54", "name": "network-vif-plugged", "status": "completed", "tag": "5c22483b-a6ab-4eee-8e1e-95997e13d961"}]} {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 29 09:03:54.516404 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [req-ec7a1382-be35-4144-bc1f-4fb3ded69ee7 req-f6af5ab4-dcc4-423b-b455-c9f7119dd6ff service nova] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:03:54.516404 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [req-ec7a1382-be35-4144-bc1f-4fb3ded69ee7 req-f6af5ab4-dcc4-423b-b455-c9f7119dd6ff service nova] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:03:54.528070 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.compute.server_external_events [req-ec7a1382-be35-4144-bc1f-4fb3ded69ee7 req-f6af5ab4-dcc4-423b-b455-c9f7119dd6ff service nova] Creating event network-vif-plugged:5c22483b-a6ab-4eee-8e1e-95997e13d961 for instance 4e638d0d-740f-4461-a3de-b5e5a048de54 on hv-cinder-83987 Apr 29 09:03:54.533307 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [req-ec7a1382-be35-4144-bc1f-4fb3ded69ee7 req-f6af5ab4-dcc4-423b-b455-c9f7119dd6ff service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031978 Apr 29 09:03:54.534110 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 614/1222] 10.222.0.31 () {64 vars in 1317 bytes} [Fri Apr 29 09:03:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 29 09:03:54.663497 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-9df3aade-d99e-4a61-b184-b81b68e701f6 tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Calling method '>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 09:03:54.664198 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-9df3aade-d99e-4a61-b184-b81b68e701f6 tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] [instance: 4e638d0d-740f-4461-a3de-b5e5a048de54] Fetching instance by UUID {{(pid=123459) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 09:03:54.670916 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-9df3aade-d99e-4a61-b184-b81b68e701f6 tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:03:54.671559 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-9df3aade-d99e-4a61-b184-b81b68e701f6 tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:03:54.672264 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-9df3aade-d99e-4a61-b184-b81b68e701f6 tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:03:54.672718 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-9df3aade-d99e-4a61-b184-b81b68e701f6 tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:03:54.814960 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-9df3aade-d99e-4a61-b184-b81b68e701f6 tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fe54d1c29bf4300a2d2c9365d1d6dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aba74bd5665f48f69b0d080b09b8ade5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 09:03:54.822310 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-9df3aade-d99e-4a61-b184-b81b68e701f6 tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] 10.222.0.31 "GET /compute/v2.1/servers/4e638d0d-740f-4461-a3de-b5e5a048de54" status: 200 len: 1361 microversion: 2.1 time: 0.163441 Apr 29 09:03:54.822876 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 609/1223] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 09:03:54 2022] GET /compute/v2.1/servers/4e638d0d-740f-4461-a3de-b5e5a048de54 => generated 1361 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 09:03:55.840011 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-bc63e316-354c-4083-a5c6-a8f9807f0910 tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Calling method '>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 09:03:55.840647 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-bc63e316-354c-4083-a5c6-a8f9807f0910 tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] [instance: 4e638d0d-740f-4461-a3de-b5e5a048de54] Fetching instance by UUID {{(pid=123458) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 09:03:55.848159 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-bc63e316-354c-4083-a5c6-a8f9807f0910 tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:03:55.848639 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-bc63e316-354c-4083-a5c6-a8f9807f0910 tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:03:55.849419 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-bc63e316-354c-4083-a5c6-a8f9807f0910 tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:03:55.849851 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-bc63e316-354c-4083-a5c6-a8f9807f0910 tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:03:55.990011 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-bc63e316-354c-4083-a5c6-a8f9807f0910 tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fe54d1c29bf4300a2d2c9365d1d6dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aba74bd5665f48f69b0d080b09b8ade5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 09:03:55.997807 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-bc63e316-354c-4083-a5c6-a8f9807f0910 tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] 10.222.0.31 "GET /compute/v2.1/servers/4e638d0d-740f-4461-a3de-b5e5a048de54" status: 200 len: 1361 microversion: 2.1 time: 0.162046 Apr 29 09:03:55.999248 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 615/1224] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 09:03:55 2022] GET /compute/v2.1/servers/4e638d0d-740f-4461-a3de-b5e5a048de54 => generated 1361 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 09:03:57.014795 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-4fc80b46-d880-42b6-92ba-ebe14454475f tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Calling method '>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 09:03:57.015369 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-4fc80b46-d880-42b6-92ba-ebe14454475f tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] [instance: 4e638d0d-740f-4461-a3de-b5e5a048de54] Fetching instance by UUID {{(pid=123459) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 09:03:57.021706 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-4fc80b46-d880-42b6-92ba-ebe14454475f tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:03:57.022153 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-4fc80b46-d880-42b6-92ba-ebe14454475f tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:03:57.022922 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-4fc80b46-d880-42b6-92ba-ebe14454475f tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:03:57.023355 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-4fc80b46-d880-42b6-92ba-ebe14454475f tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:03:57.153456 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-4fc80b46-d880-42b6-92ba-ebe14454475f tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fe54d1c29bf4300a2d2c9365d1d6dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aba74bd5665f48f69b0d080b09b8ade5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 09:03:57.161460 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-4fc80b46-d880-42b6-92ba-ebe14454475f tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] 10.222.0.31 "GET /compute/v2.1/servers/4e638d0d-740f-4461-a3de-b5e5a048de54" status: 200 len: 1548 microversion: 2.1 time: 0.150673 Apr 29 09:03:57.162024 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 610/1225] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 09:03:57 2022] GET /compute/v2.1/servers/4e638d0d-740f-4461-a3de-b5e5a048de54 => generated 1548 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 09:03:57.177758 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-c0dec1aa-4142-41db-a536-4e2a77edd1df tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Calling method '>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 09:03:57.178237 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-c0dec1aa-4142-41db-a536-4e2a77edd1df tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] [instance: 4e638d0d-740f-4461-a3de-b5e5a048de54] Fetching instance by UUID {{(pid=123458) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 09:03:57.184649 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-c0dec1aa-4142-41db-a536-4e2a77edd1df tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:03:57.185106 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-c0dec1aa-4142-41db-a536-4e2a77edd1df tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:03:57.185893 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-c0dec1aa-4142-41db-a536-4e2a77edd1df tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:03:57.186336 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-c0dec1aa-4142-41db-a536-4e2a77edd1df tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:03:57.277648 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-c0dec1aa-4142-41db-a536-4e2a77edd1df tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] 10.222.0.31 "GET /compute/v2.1/servers/4e638d0d-740f-4461-a3de-b5e5a048de54/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.103747 Apr 29 09:03:57.278295 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 616/1226] 10.222.0.31 () {58 vars in 1274 bytes} [Fri Apr 29 09:03:57 2022] GET /compute/v2.1/servers/4e638d0d-740f-4461-a3de-b5e5a048de54/os-interface => generated 285 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 29 09:03:58.312612 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [req-ab07581b-7c7d-4123-a1b1-dbba5aec9e78 req-60bf86f1-135b-4415-87ea-a5be7b48e137 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4e638d0d-740f-4461-a3de-b5e5a048de54", "tag": "5c22483b-a6ab-4eee-8e1e-95997e13d961"}]} {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 29 09:03:58.321292 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [req-ab07581b-7c7d-4123-a1b1-dbba5aec9e78 req-60bf86f1-135b-4415-87ea-a5be7b48e137 service nova] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:03:58.321770 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [req-ab07581b-7c7d-4123-a1b1-dbba5aec9e78 req-60bf86f1-135b-4415-87ea-a5be7b48e137 service nova] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:03:58.334236 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.compute.server_external_events [req-ab07581b-7c7d-4123-a1b1-dbba5aec9e78 req-60bf86f1-135b-4415-87ea-a5be7b48e137 service nova] Creating event network-changed:5c22483b-a6ab-4eee-8e1e-95997e13d961 for instance 4e638d0d-740f-4461-a3de-b5e5a048de54 on hv-cinder-83987 Apr 29 09:03:58.339626 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [req-ab07581b-7c7d-4123-a1b1-dbba5aec9e78 req-60bf86f1-135b-4415-87ea-a5be7b48e137 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031595 Apr 29 09:03:58.343335 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 611/1227] 10.222.0.31 () {64 vars in 1317 bytes} [Fri Apr 29 09:03:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 29 09:04:30.582291 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 29 09:04:30.583057 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: Fri Apr 29 09:04:30 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 29 09:05:28.239211 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-8ee119c3-fdde-470e-93fb-8e8cbb9a2c12 tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Calling method '>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 09:05:28.239835 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-8ee119c3-fdde-470e-93fb-8e8cbb9a2c12 tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] [instance: 4e638d0d-740f-4461-a3de-b5e5a048de54] Fetching instance by UUID {{(pid=123458) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 09:05:28.245815 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-8ee119c3-fdde-470e-93fb-8e8cbb9a2c12 tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:05:28.246268 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-8ee119c3-fdde-470e-93fb-8e8cbb9a2c12 tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:05:28.247052 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-8ee119c3-fdde-470e-93fb-8e8cbb9a2c12 tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:05:28.247500 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-8ee119c3-fdde-470e-93fb-8e8cbb9a2c12 tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:05:28.271634 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-8ee119c3-fdde-470e-93fb-8e8cbb9a2c12 tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] 10.222.0.31 "GET /compute/v2.1/servers/4e638d0d-740f-4461-a3de-b5e5a048de54/ips" status: 200 len: 146 microversion: 2.1 time: 0.038399 Apr 29 09:05:28.272226 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 617/1228] 10.222.0.31 () {58 vars in 1247 bytes} [Fri Apr 29 09:05:28 2022] GET /compute/v2.1/servers/4e638d0d-740f-4461-a3de-b5e5a048de54/ips => generated 146 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 29 09:05:30.298457 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-942f3008-5414-4f31-bb79-6d74995f9047 tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8c61b8bb-a412-4426-9a74-675d3af13369"}} {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 29 09:05:30.300395 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-942f3008-5414-4f31-bb79-6d74995f9047 tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] [instance: 4e638d0d-740f-4461-a3de-b5e5a048de54] Fetching instance by UUID {{(pid=123459) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 09:05:30.307153 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-942f3008-5414-4f31-bb79-6d74995f9047 tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:05:30.307915 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-942f3008-5414-4f31-bb79-6d74995f9047 tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:05:30.309161 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-942f3008-5414-4f31-bb79-6d74995f9047 tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:05:30.309684 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-942f3008-5414-4f31-bb79-6d74995f9047 tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:05:30.584325 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-942f3008-5414-4f31-bb79-6d74995f9047 tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] 10.222.0.31 "POST /compute/v2.1/servers/4e638d0d-740f-4461-a3de-b5e5a048de54/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.291591 Apr 29 09:05:30.584978 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 612/1229] 10.222.0.31 () {60 vars in 1322 bytes} [Fri Apr 29 09:05:30 2022] POST /compute/v2.1/servers/4e638d0d-740f-4461-a3de-b5e5a048de54/os-volume_attachments => generated 194 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 29 09:05:38.106741 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-51121901-89ec-4ef7-be37-8f0ff86443fe tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 29 09:05:38.113173 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-51121901-89ec-4ef7-be37-8f0ff86443fe tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:05:38.113630 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-51121901-89ec-4ef7-be37-8f0ff86443fe tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:05:38.179242 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-51121901-89ec-4ef7-be37-8f0ff86443fe tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] [instance: 4e638d0d-740f-4461-a3de-b5e5a048de54] Going to try to stop instance {{(pid=123458) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Apr 29 09:05:38.226675 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-51121901-89ec-4ef7-be37-8f0ff86443fe tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] 10.222.0.31 "POST /compute/v2.1/servers/4e638d0d-740f-4461-a3de-b5e5a048de54/action" status: 202 len: 0 microversion: 2.1 time: 0.123883 Apr 29 09:05:38.227304 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 618/1230] 10.222.0.31 () {60 vars in 1277 bytes} [Fri Apr 29 09:05:38 2022] POST /compute/v2.1/servers/4e638d0d-740f-4461-a3de-b5e5a048de54/action => generated 0 bytes in 125 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 29 09:05:38.237310 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-59fec6d1-3222-4e98-b7b3-cadabee7757e tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Calling method '>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 09:05:38.237957 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-59fec6d1-3222-4e98-b7b3-cadabee7757e tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] [instance: 4e638d0d-740f-4461-a3de-b5e5a048de54] Fetching instance by UUID {{(pid=123459) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 09:05:38.245688 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-59fec6d1-3222-4e98-b7b3-cadabee7757e tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:05:38.246149 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-59fec6d1-3222-4e98-b7b3-cadabee7757e tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:05:38.246943 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-59fec6d1-3222-4e98-b7b3-cadabee7757e tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:05:38.247498 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-59fec6d1-3222-4e98-b7b3-cadabee7757e tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:05:38.381284 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-59fec6d1-3222-4e98-b7b3-cadabee7757e tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fe54d1c29bf4300a2d2c9365d1d6dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aba74bd5665f48f69b0d080b09b8ade5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 09:05:38.389052 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-59fec6d1-3222-4e98-b7b3-cadabee7757e tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] 10.222.0.31 "GET /compute/v2.1/servers/4e638d0d-740f-4461-a3de-b5e5a048de54" status: 200 len: 1722 microversion: 2.1 time: 0.157198 Apr 29 09:05:38.389609 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 613/1231] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 09:05:38 2022] GET /compute/v2.1/servers/4e638d0d-740f-4461-a3de-b5e5a048de54 => generated 1722 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 29 09:05:39.408101 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-9a2fb0e3-a88d-42d5-acbe-b503c0b4c739 tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Calling method '>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 09:05:39.409698 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-9a2fb0e3-a88d-42d5-acbe-b503c0b4c739 tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] [instance: 4e638d0d-740f-4461-a3de-b5e5a048de54] Fetching instance by UUID {{(pid=123458) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 09:05:39.415874 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-9a2fb0e3-a88d-42d5-acbe-b503c0b4c739 tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:05:39.416465 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-9a2fb0e3-a88d-42d5-acbe-b503c0b4c739 tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:05:39.417313 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-9a2fb0e3-a88d-42d5-acbe-b503c0b4c739 tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:05:39.417761 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-9a2fb0e3-a88d-42d5-acbe-b503c0b4c739 tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:05:39.561983 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-9a2fb0e3-a88d-42d5-acbe-b503c0b4c739 tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fe54d1c29bf4300a2d2c9365d1d6dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aba74bd5665f48f69b0d080b09b8ade5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 09:05:39.571091 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-9a2fb0e3-a88d-42d5-acbe-b503c0b4c739 tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] 10.222.0.31 "GET /compute/v2.1/servers/4e638d0d-740f-4461-a3de-b5e5a048de54" status: 200 len: 1722 microversion: 2.1 time: 0.167575 Apr 29 09:05:39.571666 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 619/1232] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 09:05:39 2022] GET /compute/v2.1/servers/4e638d0d-740f-4461-a3de-b5e5a048de54 => generated 1722 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 09:05:40.589289 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-95fb7c27-cb81-475e-ad5f-e06ae37cf482 tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Calling method '>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 09:05:40.589890 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-95fb7c27-cb81-475e-ad5f-e06ae37cf482 tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] [instance: 4e638d0d-740f-4461-a3de-b5e5a048de54] Fetching instance by UUID {{(pid=123459) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 09:05:40.597810 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-95fb7c27-cb81-475e-ad5f-e06ae37cf482 tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:05:40.598272 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-95fb7c27-cb81-475e-ad5f-e06ae37cf482 tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:05:40.599058 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-95fb7c27-cb81-475e-ad5f-e06ae37cf482 tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:05:40.599498 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-95fb7c27-cb81-475e-ad5f-e06ae37cf482 tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:05:40.741933 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-95fb7c27-cb81-475e-ad5f-e06ae37cf482 tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fe54d1c29bf4300a2d2c9365d1d6dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aba74bd5665f48f69b0d080b09b8ade5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 09:05:40.750286 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-95fb7c27-cb81-475e-ad5f-e06ae37cf482 tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] 10.222.0.31 "GET /compute/v2.1/servers/4e638d0d-740f-4461-a3de-b5e5a048de54" status: 200 len: 1722 microversion: 2.1 time: 0.164590 Apr 29 09:05:40.750867 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 614/1233] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 09:05:40 2022] GET /compute/v2.1/servers/4e638d0d-740f-4461-a3de-b5e5a048de54 => generated 1722 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 09:05:41.766901 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-37b25ee2-29f9-4607-abc1-bd6da2728528 tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Calling method '>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 09:05:41.767501 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-37b25ee2-29f9-4607-abc1-bd6da2728528 tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] [instance: 4e638d0d-740f-4461-a3de-b5e5a048de54] Fetching instance by UUID {{(pid=123458) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 09:05:41.774297 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-37b25ee2-29f9-4607-abc1-bd6da2728528 tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:05:41.774759 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-37b25ee2-29f9-4607-abc1-bd6da2728528 tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:05:41.775515 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-37b25ee2-29f9-4607-abc1-bd6da2728528 tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:05:41.775952 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-37b25ee2-29f9-4607-abc1-bd6da2728528 tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:05:41.911933 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-37b25ee2-29f9-4607-abc1-bd6da2728528 tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fe54d1c29bf4300a2d2c9365d1d6dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aba74bd5665f48f69b0d080b09b8ade5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 09:05:41.920560 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-37b25ee2-29f9-4607-abc1-bd6da2728528 tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] 10.222.0.31 "GET /compute/v2.1/servers/4e638d0d-740f-4461-a3de-b5e5a048de54" status: 200 len: 1722 microversion: 2.1 time: 0.157244 Apr 29 09:05:41.921162 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 620/1234] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 09:05:41 2022] GET /compute/v2.1/servers/4e638d0d-740f-4461-a3de-b5e5a048de54 => generated 1722 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 09:05:42.942811 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-f68b13df-eea8-40b4-a02d-03adf04a5632 tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Calling method '>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 09:05:42.943401 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-f68b13df-eea8-40b4-a02d-03adf04a5632 tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] [instance: 4e638d0d-740f-4461-a3de-b5e5a048de54] Fetching instance by UUID {{(pid=123459) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 09:05:42.950170 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-f68b13df-eea8-40b4-a02d-03adf04a5632 tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:05:42.950615 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-f68b13df-eea8-40b4-a02d-03adf04a5632 tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:05:42.951395 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-f68b13df-eea8-40b4-a02d-03adf04a5632 tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:05:42.951829 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-f68b13df-eea8-40b4-a02d-03adf04a5632 tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:05:43.088908 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-f68b13df-eea8-40b4-a02d-03adf04a5632 tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fe54d1c29bf4300a2d2c9365d1d6dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aba74bd5665f48f69b0d080b09b8ade5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 09:05:43.097624 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-f68b13df-eea8-40b4-a02d-03adf04a5632 tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] 10.222.0.31 "GET /compute/v2.1/servers/4e638d0d-740f-4461-a3de-b5e5a048de54" status: 200 len: 1722 microversion: 2.1 time: 0.159229 Apr 29 09:05:43.098213 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 615/1235] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 09:05:42 2022] GET /compute/v2.1/servers/4e638d0d-740f-4461-a3de-b5e5a048de54 => generated 1722 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 09:05:44.114839 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-a92bb90b-6a24-41ce-a32b-f65195291689 tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Calling method '>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 09:05:44.115543 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-a92bb90b-6a24-41ce-a32b-f65195291689 tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] [instance: 4e638d0d-740f-4461-a3de-b5e5a048de54] Fetching instance by UUID {{(pid=123458) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 09:05:44.122731 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-a92bb90b-6a24-41ce-a32b-f65195291689 tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:05:44.122731 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-a92bb90b-6a24-41ce-a32b-f65195291689 tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:05:44.123574 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-a92bb90b-6a24-41ce-a32b-f65195291689 tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:05:44.123942 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-a92bb90b-6a24-41ce-a32b-f65195291689 tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:05:44.259804 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-a92bb90b-6a24-41ce-a32b-f65195291689 tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fe54d1c29bf4300a2d2c9365d1d6dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aba74bd5665f48f69b0d080b09b8ade5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 09:05:44.268670 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-a92bb90b-6a24-41ce-a32b-f65195291689 tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] 10.222.0.31 "GET /compute/v2.1/servers/4e638d0d-740f-4461-a3de-b5e5a048de54" status: 200 len: 1722 microversion: 2.1 time: 0.157006 Apr 29 09:05:44.269255 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 621/1236] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 09:05:44 2022] GET /compute/v2.1/servers/4e638d0d-740f-4461-a3de-b5e5a048de54 => generated 1722 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 09:05:45.287262 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-73204785-11b5-4eed-90d8-313e3f2cc91c tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Calling method '>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 09:05:45.287946 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-73204785-11b5-4eed-90d8-313e3f2cc91c tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] [instance: 4e638d0d-740f-4461-a3de-b5e5a048de54] Fetching instance by UUID {{(pid=123459) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 09:05:45.294489 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-73204785-11b5-4eed-90d8-313e3f2cc91c tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:05:45.294933 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-73204785-11b5-4eed-90d8-313e3f2cc91c tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:05:45.295706 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-73204785-11b5-4eed-90d8-313e3f2cc91c tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:05:45.296152 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-73204785-11b5-4eed-90d8-313e3f2cc91c tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:05:45.430704 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-73204785-11b5-4eed-90d8-313e3f2cc91c tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fe54d1c29bf4300a2d2c9365d1d6dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aba74bd5665f48f69b0d080b09b8ade5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 09:05:45.438641 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-73204785-11b5-4eed-90d8-313e3f2cc91c tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] 10.222.0.31 "GET /compute/v2.1/servers/4e638d0d-740f-4461-a3de-b5e5a048de54" status: 200 len: 1722 microversion: 2.1 time: 0.155866 Apr 29 09:05:45.439207 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 616/1237] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 09:05:45 2022] GET /compute/v2.1/servers/4e638d0d-740f-4461-a3de-b5e5a048de54 => generated 1722 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 09:05:46.455957 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-175ef8cf-a00d-43c7-a32d-37e3e20c455a tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Calling method '>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 09:05:46.456628 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-175ef8cf-a00d-43c7-a32d-37e3e20c455a tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] [instance: 4e638d0d-740f-4461-a3de-b5e5a048de54] Fetching instance by UUID {{(pid=123458) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 09:05:46.463087 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-175ef8cf-a00d-43c7-a32d-37e3e20c455a tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:05:46.463537 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-175ef8cf-a00d-43c7-a32d-37e3e20c455a tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:05:46.464353 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-175ef8cf-a00d-43c7-a32d-37e3e20c455a tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:05:46.464797 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-175ef8cf-a00d-43c7-a32d-37e3e20c455a tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:05:46.605745 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-175ef8cf-a00d-43c7-a32d-37e3e20c455a tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fe54d1c29bf4300a2d2c9365d1d6dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aba74bd5665f48f69b0d080b09b8ade5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 09:05:46.614836 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-175ef8cf-a00d-43c7-a32d-37e3e20c455a tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] 10.222.0.31 "GET /compute/v2.1/servers/4e638d0d-740f-4461-a3de-b5e5a048de54" status: 200 len: 1722 microversion: 2.1 time: 0.162839 Apr 29 09:05:46.615437 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 622/1238] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 09:05:46 2022] GET /compute/v2.1/servers/4e638d0d-740f-4461-a3de-b5e5a048de54 => generated 1722 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 09:05:47.636956 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-04831fb6-faf0-43e4-8509-e1b1888bae61 tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Calling method '>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 09:05:47.637512 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-04831fb6-faf0-43e4-8509-e1b1888bae61 tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] [instance: 4e638d0d-740f-4461-a3de-b5e5a048de54] Fetching instance by UUID {{(pid=123459) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 09:05:47.645351 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-04831fb6-faf0-43e4-8509-e1b1888bae61 tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:05:47.645802 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-04831fb6-faf0-43e4-8509-e1b1888bae61 tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:05:47.646588 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-04831fb6-faf0-43e4-8509-e1b1888bae61 tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:05:47.647027 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-04831fb6-faf0-43e4-8509-e1b1888bae61 tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:05:47.788000 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-04831fb6-faf0-43e4-8509-e1b1888bae61 tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fe54d1c29bf4300a2d2c9365d1d6dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aba74bd5665f48f69b0d080b09b8ade5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 09:05:47.796073 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-04831fb6-faf0-43e4-8509-e1b1888bae61 tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] 10.222.0.31 "GET /compute/v2.1/servers/4e638d0d-740f-4461-a3de-b5e5a048de54" status: 200 len: 1722 microversion: 2.1 time: 0.163116 Apr 29 09:05:47.796671 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 617/1239] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 09:05:47 2022] GET /compute/v2.1/servers/4e638d0d-740f-4461-a3de-b5e5a048de54 => generated 1722 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 09:05:48.814424 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-21af18b3-e6eb-4673-b7e6-03730603622e tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Calling method '>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 09:05:48.815081 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-21af18b3-e6eb-4673-b7e6-03730603622e tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] [instance: 4e638d0d-740f-4461-a3de-b5e5a048de54] Fetching instance by UUID {{(pid=123458) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 09:05:48.821628 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-21af18b3-e6eb-4673-b7e6-03730603622e tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:05:48.822078 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-21af18b3-e6eb-4673-b7e6-03730603622e tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:05:48.822844 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-21af18b3-e6eb-4673-b7e6-03730603622e tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:05:48.823273 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-21af18b3-e6eb-4673-b7e6-03730603622e tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:05:48.962681 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-21af18b3-e6eb-4673-b7e6-03730603622e tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fe54d1c29bf4300a2d2c9365d1d6dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aba74bd5665f48f69b0d080b09b8ade5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 09:05:48.970553 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-21af18b3-e6eb-4673-b7e6-03730603622e tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] 10.222.0.31 "GET /compute/v2.1/servers/4e638d0d-740f-4461-a3de-b5e5a048de54" status: 200 len: 1722 microversion: 2.1 time: 0.159997 Apr 29 09:05:48.971118 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 623/1240] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 09:05:48 2022] GET /compute/v2.1/servers/4e638d0d-740f-4461-a3de-b5e5a048de54 => generated 1722 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 09:05:49.989136 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-0e111ce7-683b-401a-bc61-945a3ec5e27f tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Calling method '>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 09:05:49.989746 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-0e111ce7-683b-401a-bc61-945a3ec5e27f tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] [instance: 4e638d0d-740f-4461-a3de-b5e5a048de54] Fetching instance by UUID {{(pid=123459) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 09:05:49.997230 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-0e111ce7-683b-401a-bc61-945a3ec5e27f tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:05:49.998006 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-0e111ce7-683b-401a-bc61-945a3ec5e27f tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:05:49.999357 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-0e111ce7-683b-401a-bc61-945a3ec5e27f tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:05:50.001230 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-0e111ce7-683b-401a-bc61-945a3ec5e27f tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:05:50.141070 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-0e111ce7-683b-401a-bc61-945a3ec5e27f tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fe54d1c29bf4300a2d2c9365d1d6dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aba74bd5665f48f69b0d080b09b8ade5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 09:05:50.150126 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-0e111ce7-683b-401a-bc61-945a3ec5e27f tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] 10.222.0.31 "GET /compute/v2.1/servers/4e638d0d-740f-4461-a3de-b5e5a048de54" status: 200 len: 1722 microversion: 2.1 time: 0.164752 Apr 29 09:05:50.150706 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 618/1241] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 09:05:49 2022] GET /compute/v2.1/servers/4e638d0d-740f-4461-a3de-b5e5a048de54 => generated 1722 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 09:05:51.167613 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-8c7c2efe-ea06-4c9f-9be4-e80d3165a3d1 tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Calling method '>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 09:05:51.168289 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-8c7c2efe-ea06-4c9f-9be4-e80d3165a3d1 tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] [instance: 4e638d0d-740f-4461-a3de-b5e5a048de54] Fetching instance by UUID {{(pid=123458) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 09:05:51.175882 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-8c7c2efe-ea06-4c9f-9be4-e80d3165a3d1 tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:05:51.176492 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-8c7c2efe-ea06-4c9f-9be4-e80d3165a3d1 tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:05:51.177346 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-8c7c2efe-ea06-4c9f-9be4-e80d3165a3d1 tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:05:51.177772 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-8c7c2efe-ea06-4c9f-9be4-e80d3165a3d1 tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:05:51.313660 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-8c7c2efe-ea06-4c9f-9be4-e80d3165a3d1 tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fe54d1c29bf4300a2d2c9365d1d6dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aba74bd5665f48f69b0d080b09b8ade5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 09:05:51.322109 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-8c7c2efe-ea06-4c9f-9be4-e80d3165a3d1 tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] 10.222.0.31 "GET /compute/v2.1/servers/4e638d0d-740f-4461-a3de-b5e5a048de54" status: 200 len: 1722 microversion: 2.1 time: 0.158659 Apr 29 09:05:51.322692 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 624/1242] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 09:05:51 2022] GET /compute/v2.1/servers/4e638d0d-740f-4461-a3de-b5e5a048de54 => generated 1722 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 09:05:52.340734 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-ede7bc8f-acd2-4726-8a31-41c3d6da15a0 tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Calling method '>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 09:05:52.341340 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-ede7bc8f-acd2-4726-8a31-41c3d6da15a0 tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] [instance: 4e638d0d-740f-4461-a3de-b5e5a048de54] Fetching instance by UUID {{(pid=123459) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 09:05:52.348286 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-ede7bc8f-acd2-4726-8a31-41c3d6da15a0 tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:05:52.349152 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-ede7bc8f-acd2-4726-8a31-41c3d6da15a0 tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:05:52.349523 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-ede7bc8f-acd2-4726-8a31-41c3d6da15a0 tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:05:52.349963 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-ede7bc8f-acd2-4726-8a31-41c3d6da15a0 tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:05:52.488145 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-ede7bc8f-acd2-4726-8a31-41c3d6da15a0 tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fe54d1c29bf4300a2d2c9365d1d6dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aba74bd5665f48f69b0d080b09b8ade5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 09:05:52.496463 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-ede7bc8f-acd2-4726-8a31-41c3d6da15a0 tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] 10.222.0.31 "GET /compute/v2.1/servers/4e638d0d-740f-4461-a3de-b5e5a048de54" status: 200 len: 1722 microversion: 2.1 time: 0.159552 Apr 29 09:05:52.497051 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 619/1243] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 09:05:52 2022] GET /compute/v2.1/servers/4e638d0d-740f-4461-a3de-b5e5a048de54 => generated 1722 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 09:05:53.370969 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-6d48d46d-8778-4152-b6cc-2f539072f5c7 tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] Calling method '>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 09:05:53.371820 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-6d48d46d-8778-4152-b6cc-2f539072f5c7 tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] [instance: 4cd472ef-6069-4ede-a481-7e09b8de064d] Fetching instance by UUID {{(pid=123458) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 09:05:53.374874 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [req-2c801cec-ed4a-4c38-8261-14e7827f7b4b req-8972a6a1-b64d-4e1e-8c71-74157ac5020f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4cd472ef-6069-4ede-a481-7e09b8de064d", "tag": "30512652-ebc0-4dcf-8b65-9b0f2e8e0c5c"}]} {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 29 09:05:53.379195 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-6d48d46d-8778-4152-b6cc-2f539072f5c7 tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:05:53.379727 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-6d48d46d-8778-4152-b6cc-2f539072f5c7 tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:05:53.380857 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-6d48d46d-8778-4152-b6cc-2f539072f5c7 tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:05:53.381298 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-6d48d46d-8778-4152-b6cc-2f539072f5c7 tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:05:53.388622 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [req-2c801cec-ed4a-4c38-8261-14e7827f7b4b req-8972a6a1-b64d-4e1e-8c71-74157ac5020f service nova] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:05:53.389281 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [req-2c801cec-ed4a-4c38-8261-14e7827f7b4b req-8972a6a1-b64d-4e1e-8c71-74157ac5020f service nova] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:05:53.405448 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.compute.server_external_events [req-2c801cec-ed4a-4c38-8261-14e7827f7b4b req-8972a6a1-b64d-4e1e-8c71-74157ac5020f service nova] Creating event network-changed:30512652-ebc0-4dcf-8b65-9b0f2e8e0c5c for instance 4cd472ef-6069-4ede-a481-7e09b8de064d on hv-cinder-83987 Apr 29 09:05:53.411846 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [req-2c801cec-ed4a-4c38-8261-14e7827f7b4b req-8972a6a1-b64d-4e1e-8c71-74157ac5020f service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041892 Apr 29 09:05:53.412842 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 620/1244] 10.222.0.31 () {64 vars in 1317 bytes} [Fri Apr 29 09:05:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 29 09:05:53.415293 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-6d48d46d-8778-4152-b6cc-2f539072f5c7 tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] [instance: 4cd472ef-6069-4ede-a481-7e09b8de064d] Going to try to terminate instance {{(pid=123458) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 29 09:05:53.515537 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-118f9a39-d6c3-45d3-9e45-7fba11784ad0 tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Calling method '>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 09:05:53.515814 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-6d48d46d-8778-4152-b6cc-2f539072f5c7 tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] 10.222.0.31 "DELETE /compute/v2.1/servers/4cd472ef-6069-4ede-a481-7e09b8de064d" status: 204 len: 0 microversion: 2.1 time: 0.149097 Apr 29 09:05:53.516272 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-118f9a39-d6c3-45d3-9e45-7fba11784ad0 tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] [instance: 4e638d0d-740f-4461-a3de-b5e5a048de54] Fetching instance by UUID {{(pid=123459) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 09:05:53.519575 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 625/1245] 10.222.0.31 () {58 vars in 1238 bytes} [Fri Apr 29 09:05:53 2022] DELETE /compute/v2.1/servers/4cd472ef-6069-4ede-a481-7e09b8de064d => generated 0 bytes in 151 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 29 09:05:53.525651 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-31705ba4-8a47-4668-89b5-71fae6683363 tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] Calling method '>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 09:05:53.526372 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-31705ba4-8a47-4668-89b5-71fae6683363 tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] [instance: 4cd472ef-6069-4ede-a481-7e09b8de064d] Fetching instance by UUID {{(pid=123458) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 09:05:53.527016 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-118f9a39-d6c3-45d3-9e45-7fba11784ad0 tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:05:53.527655 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-118f9a39-d6c3-45d3-9e45-7fba11784ad0 tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:05:53.528681 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-118f9a39-d6c3-45d3-9e45-7fba11784ad0 tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:05:53.529374 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-118f9a39-d6c3-45d3-9e45-7fba11784ad0 tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:05:53.533037 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-31705ba4-8a47-4668-89b5-71fae6683363 tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:05:53.534112 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-31705ba4-8a47-4668-89b5-71fae6683363 tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:05:53.535851 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-31705ba4-8a47-4668-89b5-71fae6683363 tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:05:53.536343 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-31705ba4-8a47-4668-89b5-71fae6683363 tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:05:53.745434 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-31705ba4-8a47-4668-89b5-71fae6683363 tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a82490fb17d42bf8c19f676fb687033', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8dd37ae188e415e86f551e3f760319e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 09:05:53.751943 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-118f9a39-d6c3-45d3-9e45-7fba11784ad0 tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fe54d1c29bf4300a2d2c9365d1d6dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aba74bd5665f48f69b0d080b09b8ade5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 09:05:53.757830 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-31705ba4-8a47-4668-89b5-71fae6683363 tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] 10.222.0.31 "GET /compute/v2.1/servers/4cd472ef-6069-4ede-a481-7e09b8de064d" status: 200 len: 1578 microversion: 2.1 time: 0.236475 Apr 29 09:05:53.758913 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 626/1246] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 09:05:53 2022] GET /compute/v2.1/servers/4cd472ef-6069-4ede-a481-7e09b8de064d => generated 1578 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 29 09:05:53.762201 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-118f9a39-d6c3-45d3-9e45-7fba11784ad0 tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] 10.222.0.31 "GET /compute/v2.1/servers/4e638d0d-740f-4461-a3de-b5e5a048de54" status: 200 len: 1722 microversion: 2.1 time: 0.250906 Apr 29 09:05:53.762782 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 621/1247] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 09:05:53 2022] GET /compute/v2.1/servers/4e638d0d-740f-4461-a3de-b5e5a048de54 => generated 1722 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 29 09:05:54.777246 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-724a84b6-b95c-40e4-b72c-3e6f75bbeed3 tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] Calling method '>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 09:05:54.777914 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-724a84b6-b95c-40e4-b72c-3e6f75bbeed3 tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] [instance: 4cd472ef-6069-4ede-a481-7e09b8de064d] Fetching instance by UUID {{(pid=123458) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 09:05:54.785986 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-724a84b6-b95c-40e4-b72c-3e6f75bbeed3 tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:05:54.786770 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-724a84b6-b95c-40e4-b72c-3e6f75bbeed3 tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:05:54.787727 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-d64241d1-3251-455d-abc6-054a6314bbd4 tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Calling method '>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 09:05:54.788306 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-724a84b6-b95c-40e4-b72c-3e6f75bbeed3 tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:05:54.788444 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-d64241d1-3251-455d-abc6-054a6314bbd4 tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] [instance: 4e638d0d-740f-4461-a3de-b5e5a048de54] Fetching instance by UUID {{(pid=123459) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 09:05:54.788924 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-724a84b6-b95c-40e4-b72c-3e6f75bbeed3 tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:05:54.795533 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-d64241d1-3251-455d-abc6-054a6314bbd4 tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:05:54.795991 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-d64241d1-3251-455d-abc6-054a6314bbd4 tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:05:54.796857 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-d64241d1-3251-455d-abc6-054a6314bbd4 tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:05:54.797296 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-d64241d1-3251-455d-abc6-054a6314bbd4 tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:05:54.987603 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-d64241d1-3251-455d-abc6-054a6314bbd4 tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fe54d1c29bf4300a2d2c9365d1d6dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aba74bd5665f48f69b0d080b09b8ade5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 09:05:54.996727 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-d64241d1-3251-455d-abc6-054a6314bbd4 tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] 10.222.0.31 "GET /compute/v2.1/servers/4e638d0d-740f-4461-a3de-b5e5a048de54" status: 200 len: 1699 microversion: 2.1 time: 0.213518 Apr 29 09:05:54.997477 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 622/1248] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 09:05:54 2022] GET /compute/v2.1/servers/4e638d0d-740f-4461-a3de-b5e5a048de54 => generated 1699 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 29 09:05:55.019359 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-6248272d-6b02-41ac-ae0f-fa3328b8c06b tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 29 09:05:55.028894 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-6248272d-6b02-41ac-ae0f-fa3328b8c06b tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:05:55.029457 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-6248272d-6b02-41ac-ae0f-fa3328b8c06b tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:05:55.091383 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-724a84b6-b95c-40e4-b72c-3e6f75bbeed3 tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a82490fb17d42bf8c19f676fb687033', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8dd37ae188e415e86f551e3f760319e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 09:05:55.100693 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-724a84b6-b95c-40e4-b72c-3e6f75bbeed3 tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] 10.222.0.31 "GET /compute/v2.1/servers/4cd472ef-6069-4ede-a481-7e09b8de064d" status: 200 len: 1578 microversion: 2.1 time: 0.327678 Apr 29 09:05:55.101762 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 627/1249] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 09:05:54 2022] GET /compute/v2.1/servers/4cd472ef-6069-4ede-a481-7e09b8de064d => generated 1578 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 29 09:05:55.119866 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-6248272d-6b02-41ac-ae0f-fa3328b8c06b tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] [instance: 4e638d0d-740f-4461-a3de-b5e5a048de54] Going to try to start instance {{(pid=123459) start /opt/stack/nova/nova/compute/api.py:2730}} Apr 29 09:05:55.171382 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-6248272d-6b02-41ac-ae0f-fa3328b8c06b tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] 10.222.0.31 "POST /compute/v2.1/servers/4e638d0d-740f-4461-a3de-b5e5a048de54/action" status: 202 len: 0 microversion: 2.1 time: 0.159862 Apr 29 09:05:55.172487 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 623/1250] 10.222.0.31 () {60 vars in 1277 bytes} [Fri Apr 29 09:05:55 2022] POST /compute/v2.1/servers/4e638d0d-740f-4461-a3de-b5e5a048de54/action => generated 0 bytes in 162 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Apr 29 09:05:55.182145 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-5fb98293-015d-43f0-b482-e1fd8a19e507 tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Calling method '>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 09:05:55.182857 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-5fb98293-015d-43f0-b482-e1fd8a19e507 tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] [instance: 4e638d0d-740f-4461-a3de-b5e5a048de54] Fetching instance by UUID {{(pid=123458) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 09:05:55.190546 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-5fb98293-015d-43f0-b482-e1fd8a19e507 tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:05:55.191194 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-5fb98293-015d-43f0-b482-e1fd8a19e507 tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:05:55.192127 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-5fb98293-015d-43f0-b482-e1fd8a19e507 tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:05:55.192600 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-5fb98293-015d-43f0-b482-e1fd8a19e507 tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:05:55.414546 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-5fb98293-015d-43f0-b482-e1fd8a19e507 tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fe54d1c29bf4300a2d2c9365d1d6dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aba74bd5665f48f69b0d080b09b8ade5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 09:05:55.423049 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-5fb98293-015d-43f0-b482-e1fd8a19e507 tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] 10.222.0.31 "GET /compute/v2.1/servers/4e638d0d-740f-4461-a3de-b5e5a048de54" status: 200 len: 1708 microversion: 2.1 time: 0.245102 Apr 29 09:05:55.425142 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 628/1251] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 09:05:55 2022] GET /compute/v2.1/servers/4e638d0d-740f-4461-a3de-b5e5a048de54 => generated 1708 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 09:05:56.121886 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-5a66d6c3-73e1-47fe-804b-d375e56c0ada tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] Calling method '>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 09:05:56.123166 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-5a66d6c3-73e1-47fe-804b-d375e56c0ada tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] [instance: 4cd472ef-6069-4ede-a481-7e09b8de064d] Fetching instance by UUID {{(pid=123459) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 09:05:56.132499 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-5a66d6c3-73e1-47fe-804b-d375e56c0ada tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:05:56.133285 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-5a66d6c3-73e1-47fe-804b-d375e56c0ada tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:05:56.134502 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-5a66d6c3-73e1-47fe-804b-d375e56c0ada tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:05:56.135260 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-5a66d6c3-73e1-47fe-804b-d375e56c0ada tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:05:56.313181 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-5a66d6c3-73e1-47fe-804b-d375e56c0ada tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a82490fb17d42bf8c19f676fb687033', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8dd37ae188e415e86f551e3f760319e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 09:05:56.329208 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-5a66d6c3-73e1-47fe-804b-d375e56c0ada tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] 10.222.0.31 "GET /compute/v2.1/servers/4cd472ef-6069-4ede-a481-7e09b8de064d" status: 200 len: 1459 microversion: 2.1 time: 0.212488 Apr 29 09:05:56.330852 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 624/1252] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 09:05:56 2022] GET /compute/v2.1/servers/4cd472ef-6069-4ede-a481-7e09b8de064d => generated 1459 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 09:05:56.385876 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [req-a6bfec43-1f96-4a75-9cae-8e992301eb3c req-b0a141c4-658a-4a79-977e-cbad5a747caf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4cd472ef-6069-4ede-a481-7e09b8de064d", "name": "network-vif-deleted", "tag": "30512652-ebc0-4dcf-8b65-9b0f2e8e0c5c"}]} {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 29 09:05:56.402603 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [req-a6bfec43-1f96-4a75-9cae-8e992301eb3c req-b0a141c4-658a-4a79-977e-cbad5a747caf service nova] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:05:56.403365 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [req-a6bfec43-1f96-4a75-9cae-8e992301eb3c req-b0a141c4-658a-4a79-977e-cbad5a747caf service nova] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:05:56.432215 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.compute.server_external_events [req-a6bfec43-1f96-4a75-9cae-8e992301eb3c req-b0a141c4-658a-4a79-977e-cbad5a747caf service nova] Creating event network-vif-deleted:30512652-ebc0-4dcf-8b65-9b0f2e8e0c5c for instance 4cd472ef-6069-4ede-a481-7e09b8de064d on hv-cinder-83987 Apr 29 09:05:56.442026 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [req-a6bfec43-1f96-4a75-9cae-8e992301eb3c req-b0a141c4-658a-4a79-977e-cbad5a747caf service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063181 Apr 29 09:05:56.442175 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-4bfeada4-48c9-4044-a67d-800c91800360 tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Calling method '>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 09:05:56.442792 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-4bfeada4-48c9-4044-a67d-800c91800360 tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] [instance: 4e638d0d-740f-4461-a3de-b5e5a048de54] Fetching instance by UUID {{(pid=123459) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 09:05:56.443131 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 629/1253] 10.222.0.31 () {64 vars in 1317 bytes} [Fri Apr 29 09:05:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 29 09:05:56.452125 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-4bfeada4-48c9-4044-a67d-800c91800360 tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:05:56.452934 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-4bfeada4-48c9-4044-a67d-800c91800360 tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:05:56.454305 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-4bfeada4-48c9-4044-a67d-800c91800360 tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:05:56.455077 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-4bfeada4-48c9-4044-a67d-800c91800360 tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:05:56.629370 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-4bfeada4-48c9-4044-a67d-800c91800360 tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fe54d1c29bf4300a2d2c9365d1d6dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aba74bd5665f48f69b0d080b09b8ade5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 09:05:56.638028 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-4bfeada4-48c9-4044-a67d-800c91800360 tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] 10.222.0.31 "GET /compute/v2.1/servers/4e638d0d-740f-4461-a3de-b5e5a048de54" status: 200 len: 1708 microversion: 2.1 time: 0.200443 Apr 29 09:05:56.638620 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 625/1254] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 09:05:56 2022] GET /compute/v2.1/servers/4e638d0d-740f-4461-a3de-b5e5a048de54 => generated 1708 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 29 09:05:57.354909 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-2f279c05-cdbf-44fc-8b1a-a16217756c1b tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] Calling method '>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 09:05:57.355638 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-2f279c05-cdbf-44fc-8b1a-a16217756c1b tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] [instance: 4cd472ef-6069-4ede-a481-7e09b8de064d] Fetching instance by UUID {{(pid=123458) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 09:05:57.366397 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-2f279c05-cdbf-44fc-8b1a-a16217756c1b tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:05:57.366860 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-2f279c05-cdbf-44fc-8b1a-a16217756c1b tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:05:57.368121 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-2f279c05-cdbf-44fc-8b1a-a16217756c1b tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:05:57.368899 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-2f279c05-cdbf-44fc-8b1a-a16217756c1b tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:05:57.406454 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-2f279c05-cdbf-44fc-8b1a-a16217756c1b tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:05:57.407124 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-2f279c05-cdbf-44fc-8b1a-a16217756c1b tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:05:57.407341 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.objects.instance [None req-2f279c05-cdbf-44fc-8b1a-a16217756c1b tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] Lazy-loading 'fault' on Instance uuid 4cd472ef-6069-4ede-a481-7e09b8de064d {{(pid=123458) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 29 09:05:57.452830 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-2f279c05-cdbf-44fc-8b1a-a16217756c1b tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a82490fb17d42bf8c19f676fb687033', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8dd37ae188e415e86f551e3f760319e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 09:05:57.461868 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-2f279c05-cdbf-44fc-8b1a-a16217756c1b tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] 10.222.0.31 "GET /compute/v2.1/servers/4cd472ef-6069-4ede-a481-7e09b8de064d" status: 200 len: 1230 microversion: 2.1 time: 0.114406 Apr 29 09:05:57.462664 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 630/1255] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 09:05:57 2022] GET /compute/v2.1/servers/4cd472ef-6069-4ede-a481-7e09b8de064d => generated 1230 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 09:05:57.658383 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-d1f994b8-1e8a-4e05-853d-8e9dbc1213ef tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Calling method '>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 09:05:57.658881 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-d1f994b8-1e8a-4e05-853d-8e9dbc1213ef tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] [instance: 4e638d0d-740f-4461-a3de-b5e5a048de54] Fetching instance by UUID {{(pid=123459) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 09:05:57.665549 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-d1f994b8-1e8a-4e05-853d-8e9dbc1213ef tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:05:57.666000 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-d1f994b8-1e8a-4e05-853d-8e9dbc1213ef tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:05:57.666775 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-d1f994b8-1e8a-4e05-853d-8e9dbc1213ef tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:05:57.667203 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-d1f994b8-1e8a-4e05-853d-8e9dbc1213ef tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:05:57.825804 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-d1f994b8-1e8a-4e05-853d-8e9dbc1213ef tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fe54d1c29bf4300a2d2c9365d1d6dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aba74bd5665f48f69b0d080b09b8ade5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 09:05:57.835106 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-d1f994b8-1e8a-4e05-853d-8e9dbc1213ef tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] 10.222.0.31 "GET /compute/v2.1/servers/4e638d0d-740f-4461-a3de-b5e5a048de54" status: 200 len: 1712 microversion: 2.1 time: 0.181056 Apr 29 09:05:57.836257 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 626/1256] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 09:05:57 2022] GET /compute/v2.1/servers/4e638d0d-740f-4461-a3de-b5e5a048de54 => generated 1712 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 09:05:58.479202 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-e1284606-4293-4c5b-9f19-f950895447a7 tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] Calling method '>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 09:05:58.479814 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-e1284606-4293-4c5b-9f19-f950895447a7 tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] [instance: 4cd472ef-6069-4ede-a481-7e09b8de064d] Fetching instance by UUID {{(pid=123458) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 09:05:58.486421 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-e1284606-4293-4c5b-9f19-f950895447a7 tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:05:58.486905 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-e1284606-4293-4c5b-9f19-f950895447a7 tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:05:58.487807 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-e1284606-4293-4c5b-9f19-f950895447a7 tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:05:58.488283 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-e1284606-4293-4c5b-9f19-f950895447a7 tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:05:58.503203 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.wsgi [None req-e1284606-4293-4c5b-9f19-f950895447a7 tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] HTTP exception thrown: Instance 4cd472ef-6069-4ede-a481-7e09b8de064d could not be found. Apr 29 09:05:58.503805 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-e1284606-4293-4c5b-9f19-f950895447a7 tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] Returning 404 to user: Instance 4cd472ef-6069-4ede-a481-7e09b8de064d could not be found. {{(pid=123458) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 29 09:05:58.504688 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-e1284606-4293-4c5b-9f19-f950895447a7 tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] 10.222.0.31 "GET /compute/v2.1/servers/4cd472ef-6069-4ede-a481-7e09b8de064d" status: 404 len: 111 microversion: 2.1 time: 0.029384 Apr 29 09:05:58.505243 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 631/1257] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 09:05:58 2022] GET /compute/v2.1/servers/4cd472ef-6069-4ede-a481-7e09b8de064d => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 29 09:06:01.898587 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-1e4694bc-27af-4a1a-8a5b-0a77f2d0a99c tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] Calling method '>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 09:06:01.899181 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-1e4694bc-27af-4a1a-8a5b-0a77f2d0a99c tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] [instance: 887e5a2b-9898-497b-b429-8f3e0aed0911] Fetching instance by UUID {{(pid=123459) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 09:06:01.903489 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [req-a49b9049-3d93-4baf-9c63-fd19da35ef97 req-3419e33e-87d7-4bab-86cc-f2135f2ae3a8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "887e5a2b-9898-497b-b429-8f3e0aed0911", "tag": "1200c404-ce4f-4d5e-8e49-4db86d488ad8"}]} {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 29 09:06:01.905536 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-1e4694bc-27af-4a1a-8a5b-0a77f2d0a99c tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:06:01.905982 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-1e4694bc-27af-4a1a-8a5b-0a77f2d0a99c tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:06:01.906772 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-1e4694bc-27af-4a1a-8a5b-0a77f2d0a99c tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:06:01.907207 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-1e4694bc-27af-4a1a-8a5b-0a77f2d0a99c tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:06:01.912617 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [req-a49b9049-3d93-4baf-9c63-fd19da35ef97 req-3419e33e-87d7-4bab-86cc-f2135f2ae3a8 service nova] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:06:01.914357 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [req-a49b9049-3d93-4baf-9c63-fd19da35ef97 req-3419e33e-87d7-4bab-86cc-f2135f2ae3a8 service nova] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:06:01.931164 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.compute.server_external_events [req-a49b9049-3d93-4baf-9c63-fd19da35ef97 req-3419e33e-87d7-4bab-86cc-f2135f2ae3a8 service nova] Creating event network-changed:1200c404-ce4f-4d5e-8e49-4db86d488ad8 for instance 887e5a2b-9898-497b-b429-8f3e0aed0911 on hv-cinder-83987 Apr 29 09:06:01.936570 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [req-a49b9049-3d93-4baf-9c63-fd19da35ef97 req-3419e33e-87d7-4bab-86cc-f2135f2ae3a8 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037901 Apr 29 09:06:01.937569 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 632/1258] 10.222.0.31 () {64 vars in 1317 bytes} [Fri Apr 29 09:06:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 29 09:06:01.942871 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-1e4694bc-27af-4a1a-8a5b-0a77f2d0a99c tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] [instance: 887e5a2b-9898-497b-b429-8f3e0aed0911] Going to try to terminate instance {{(pid=123459) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 29 09:06:02.037352 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-1e4694bc-27af-4a1a-8a5b-0a77f2d0a99c tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] 10.222.0.31 "DELETE /compute/v2.1/servers/887e5a2b-9898-497b-b429-8f3e0aed0911" status: 204 len: 0 microversion: 2.1 time: 0.142859 Apr 29 09:06:02.038033 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 627/1259] 10.222.0.31 () {58 vars in 1238 bytes} [Fri Apr 29 09:06:01 2022] DELETE /compute/v2.1/servers/887e5a2b-9898-497b-b429-8f3e0aed0911 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 29 09:06:02.047785 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-060c07b9-392c-4524-bec1-2924f9d11d1b tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] Calling method '>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 09:06:02.049257 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-060c07b9-392c-4524-bec1-2924f9d11d1b tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] [instance: 887e5a2b-9898-497b-b429-8f3e0aed0911] Fetching instance by UUID {{(pid=123458) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 09:06:02.057882 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-060c07b9-392c-4524-bec1-2924f9d11d1b tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:06:02.058468 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-060c07b9-392c-4524-bec1-2924f9d11d1b tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:06:02.059264 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-060c07b9-392c-4524-bec1-2924f9d11d1b tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:06:02.059712 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-060c07b9-392c-4524-bec1-2924f9d11d1b tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:06:02.213789 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-060c07b9-392c-4524-bec1-2924f9d11d1b tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a82490fb17d42bf8c19f676fb687033', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8dd37ae188e415e86f551e3f760319e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 09:06:02.223064 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-060c07b9-392c-4524-bec1-2924f9d11d1b tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] 10.222.0.31 "GET /compute/v2.1/servers/887e5a2b-9898-497b-b429-8f3e0aed0911" status: 200 len: 1578 microversion: 2.1 time: 0.179237 Apr 29 09:06:02.228591 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 633/1260] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 09:06:02 2022] GET /compute/v2.1/servers/887e5a2b-9898-497b-b429-8f3e0aed0911 => generated 1578 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 29 09:06:03.248727 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-89128c11-59dc-424a-abba-ba973ee443cb tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] Calling method '>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 09:06:03.249434 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-89128c11-59dc-424a-abba-ba973ee443cb tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] [instance: 887e5a2b-9898-497b-b429-8f3e0aed0911] Fetching instance by UUID {{(pid=123459) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 09:06:03.257631 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-89128c11-59dc-424a-abba-ba973ee443cb tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:06:03.258083 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-89128c11-59dc-424a-abba-ba973ee443cb tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:06:03.258876 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-89128c11-59dc-424a-abba-ba973ee443cb tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:06:03.259319 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-89128c11-59dc-424a-abba-ba973ee443cb tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:06:03.513796 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [req-1c96ef30-39a9-4b02-ae5f-5ff9f1f2122b req-fa8d1afc-8ddd-4d73-9ea8-eee9baf67384 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "887e5a2b-9898-497b-b429-8f3e0aed0911", "name": "network-vif-deleted", "tag": "1200c404-ce4f-4d5e-8e49-4db86d488ad8"}]} {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 29 09:06:03.521698 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-89128c11-59dc-424a-abba-ba973ee443cb tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a82490fb17d42bf8c19f676fb687033', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8dd37ae188e415e86f551e3f760319e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 09:06:03.527997 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [req-1c96ef30-39a9-4b02-ae5f-5ff9f1f2122b req-fa8d1afc-8ddd-4d73-9ea8-eee9baf67384 service nova] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:06:03.528764 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [req-1c96ef30-39a9-4b02-ae5f-5ff9f1f2122b req-fa8d1afc-8ddd-4d73-9ea8-eee9baf67384 service nova] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:06:03.534627 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-89128c11-59dc-424a-abba-ba973ee443cb tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] 10.222.0.31 "GET /compute/v2.1/servers/887e5a2b-9898-497b-b429-8f3e0aed0911" status: 200 len: 1460 microversion: 2.1 time: 0.289785 Apr 29 09:06:03.536385 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 628/1261] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 09:06:03 2022] GET /compute/v2.1/servers/887e5a2b-9898-497b-b429-8f3e0aed0911 => generated 1460 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 09:06:03.545238 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.compute.server_external_events [req-1c96ef30-39a9-4b02-ae5f-5ff9f1f2122b req-fa8d1afc-8ddd-4d73-9ea8-eee9baf67384 service nova] Creating event network-vif-deleted:1200c404-ce4f-4d5e-8e49-4db86d488ad8 for instance 887e5a2b-9898-497b-b429-8f3e0aed0911 on hv-cinder-83987 Apr 29 09:06:03.550050 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [req-1c96ef30-39a9-4b02-ae5f-5ff9f1f2122b req-fa8d1afc-8ddd-4d73-9ea8-eee9baf67384 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041475 Apr 29 09:06:03.551552 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 634/1262] 10.222.0.31 () {64 vars in 1317 bytes} [Fri Apr 29 09:06:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 29 09:06:04.552340 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-fed9b97b-c78f-453e-a129-91f3088c432e tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] Calling method '>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 09:06:04.552974 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-fed9b97b-c78f-453e-a129-91f3088c432e tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] [instance: 887e5a2b-9898-497b-b429-8f3e0aed0911] Fetching instance by UUID {{(pid=123459) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 09:06:04.559347 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-fed9b97b-c78f-453e-a129-91f3088c432e tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:06:04.559790 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-fed9b97b-c78f-453e-a129-91f3088c432e tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:06:04.560575 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-fed9b97b-c78f-453e-a129-91f3088c432e tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:06:04.560999 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-fed9b97b-c78f-453e-a129-91f3088c432e tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:06:04.574857 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.wsgi [None req-fed9b97b-c78f-453e-a129-91f3088c432e tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] HTTP exception thrown: Instance 887e5a2b-9898-497b-b429-8f3e0aed0911 could not be found. Apr 29 09:06:04.575439 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-fed9b97b-c78f-453e-a129-91f3088c432e tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] Returning 404 to user: Instance 887e5a2b-9898-497b-b429-8f3e0aed0911 could not be found. {{(pid=123459) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 29 09:06:04.576285 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-fed9b97b-c78f-453e-a129-91f3088c432e tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] 10.222.0.31 "GET /compute/v2.1/servers/887e5a2b-9898-497b-b429-8f3e0aed0911" status: 404 len: 111 microversion: 2.1 time: 0.027841 Apr 29 09:06:04.576824 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 629/1263] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 09:06:04 2022] GET /compute/v2.1/servers/887e5a2b-9898-497b-b429-8f3e0aed0911 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 29 09:06:05.039506 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-3e249f5f-f3b5-4e70-88ce-4fac2a419560 tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] Calling method '>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 09:06:05.040121 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-3e249f5f-f3b5-4e70-88ce-4fac2a419560 tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] [instance: 8d96abf8-36ee-48bc-a692-27682f8c1c2e] Fetching instance by UUID {{(pid=123458) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 09:06:05.046349 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-3e249f5f-f3b5-4e70-88ce-4fac2a419560 tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:06:05.046803 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-3e249f5f-f3b5-4e70-88ce-4fac2a419560 tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:06:05.047583 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-3e249f5f-f3b5-4e70-88ce-4fac2a419560 tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:06:05.048022 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-3e249f5f-f3b5-4e70-88ce-4fac2a419560 tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:06:05.062524 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.wsgi [None req-3e249f5f-f3b5-4e70-88ce-4fac2a419560 tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] HTTP exception thrown: Instance 8d96abf8-36ee-48bc-a692-27682f8c1c2e could not be found. Apr 29 09:06:05.063061 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-3e249f5f-f3b5-4e70-88ce-4fac2a419560 tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] Returning 404 to user: Instance 8d96abf8-36ee-48bc-a692-27682f8c1c2e could not be found. {{(pid=123458) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 29 09:06:05.063925 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-3e249f5f-f3b5-4e70-88ce-4fac2a419560 tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] 10.222.0.31 "DELETE /compute/v2.1/servers/8d96abf8-36ee-48bc-a692-27682f8c1c2e" status: 404 len: 111 microversion: 2.1 time: 0.029419 Apr 29 09:06:05.064508 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 635/1264] 10.222.0.31 () {58 vars in 1238 bytes} [Fri Apr 29 09:06:05 2022] DELETE /compute/v2.1/servers/8d96abf8-36ee-48bc-a692-27682f8c1c2e => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 29 09:06:05.073395 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-d17d1c09-a5d3-4ffa-8042-21e962f10c8a tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] Calling method '>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 09:06:05.074005 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-d17d1c09-a5d3-4ffa-8042-21e962f10c8a tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] [instance: 8d96abf8-36ee-48bc-a692-27682f8c1c2e] Fetching instance by UUID {{(pid=123459) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 09:06:05.079909 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-d17d1c09-a5d3-4ffa-8042-21e962f10c8a tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:06:05.080399 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-d17d1c09-a5d3-4ffa-8042-21e962f10c8a tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:06:05.081165 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-d17d1c09-a5d3-4ffa-8042-21e962f10c8a tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:06:05.081601 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-d17d1c09-a5d3-4ffa-8042-21e962f10c8a tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:06:05.094762 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.wsgi [None req-d17d1c09-a5d3-4ffa-8042-21e962f10c8a tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] HTTP exception thrown: Instance 8d96abf8-36ee-48bc-a692-27682f8c1c2e could not be found. Apr 29 09:06:05.095342 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-d17d1c09-a5d3-4ffa-8042-21e962f10c8a tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] Returning 404 to user: Instance 8d96abf8-36ee-48bc-a692-27682f8c1c2e could not be found. {{(pid=123459) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 29 09:06:05.096179 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-d17d1c09-a5d3-4ffa-8042-21e962f10c8a tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] 10.222.0.31 "GET /compute/v2.1/servers/8d96abf8-36ee-48bc-a692-27682f8c1c2e" status: 404 len: 111 microversion: 2.1 time: 0.026652 Apr 29 09:06:05.096711 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 630/1265] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 09:06:05 2022] GET /compute/v2.1/servers/8d96abf8-36ee-48bc-a692-27682f8c1c2e => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 29 09:06:06.390978 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-092ed5ec-87e4-4fde-af33-483c5f4c2cf9 tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] Calling method '.version_select at 0x7f62383d4f70>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 09:06:06.394802 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: ERROR oslo.messaging._drivers.impl_rabbit [None req-092ed5ec-87e4-4fde-af33-483c5f4c2cf9 tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] [738d42f2-cfe4-4e14-94ad-d4003876a5a6] AMQP server on 10.222.0.31:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Apr 29 09:06:07.403431 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO oslo.messaging._drivers.impl_rabbit [None req-092ed5ec-87e4-4fde-af33-483c5f4c2cf9 tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] [738d42f2-cfe4-4e14-94ad-d4003876a5a6] Reconnected to AMQP server on 10.222.0.31:5672 via [amqp] client with port 49418. Apr 29 09:06:07.423302 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-092ed5ec-87e4-4fde-af33-483c5f4c2cf9 tempest-TestVolumeBootPattern-54423211 tempest-TestVolumeBootPattern-54423211-project] 10.222.0.31 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1636555824" status: 202 len: 0 microversion: 2.1 time: 1.036115 Apr 29 09:06:07.423905 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 636/1266] 10.222.0.31 () {58 vars in 1262 bytes} [Fri Apr 29 09:06:06 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1636555824 => generated 0 bytes in 1037 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 29 09:06:12.997403 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 29 09:06:12.998086 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: Fri Apr 29 09:06:12 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 29 09:06:53.088462 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-f9df28f8-b6b1-4ae4-8743-8bcea4305cb5 tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Calling method '>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 09:06:53.089326 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-f9df28f8-b6b1-4ae4-8743-8bcea4305cb5 tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] [instance: 4e638d0d-740f-4461-a3de-b5e5a048de54] Fetching instance by UUID {{(pid=123459) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 09:06:53.095240 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-f9df28f8-b6b1-4ae4-8743-8bcea4305cb5 tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:06:53.095689 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-f9df28f8-b6b1-4ae4-8743-8bcea4305cb5 tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:06:53.096486 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-f9df28f8-b6b1-4ae4-8743-8bcea4305cb5 tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:06:53.096923 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-f9df28f8-b6b1-4ae4-8743-8bcea4305cb5 tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:06:53.406029 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.objects.instance [None req-f9df28f8-b6b1-4ae4-8743-8bcea4305cb5 tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Lazy-loading 'services' on Instance uuid 4e638d0d-740f-4461-a3de-b5e5a048de54 {{(pid=123459) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 29 09:06:53.474259 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-f9df28f8-b6b1-4ae4-8743-8bcea4305cb5 tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] 10.222.0.31 "DELETE /compute/v2.1/servers/4e638d0d-740f-4461-a3de-b5e5a048de54/os-volume_attachments/8c61b8bb-a412-4426-9a74-675d3af13369" status: 202 len: 0 microversion: 2.1 time: 0.390272 Apr 29 09:06:53.474842 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 631/1267] 10.222.0.31 () {58 vars in 1415 bytes} [Fri Apr 29 09:06:53 2022] DELETE /compute/v2.1/servers/4e638d0d-740f-4461-a3de-b5e5a048de54/os-volume_attachments/8c61b8bb-a412-4426-9a74-675d3af13369 => generated 0 bytes in 392 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 29 09:06:54.589449 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-192d762a-33d8-45d3-a0d4-2a47e9de6f28 tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 29 09:06:54.595481 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-192d762a-33d8-45d3-a0d4-2a47e9de6f28 tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:06:54.595931 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-192d762a-33d8-45d3-a0d4-2a47e9de6f28 tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:06:54.618292 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-192d762a-33d8-45d3-a0d4-2a47e9de6f28 tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] [instance: 4e638d0d-740f-4461-a3de-b5e5a048de54] Going to try to stop instance {{(pid=123458) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Apr 29 09:06:54.661113 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-192d762a-33d8-45d3-a0d4-2a47e9de6f28 tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] 10.222.0.31 "POST /compute/v2.1/servers/4e638d0d-740f-4461-a3de-b5e5a048de54/action" status: 202 len: 0 microversion: 2.1 time: 0.077138 Apr 29 09:06:54.661932 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 637/1268] 10.222.0.31 () {60 vars in 1277 bytes} [Fri Apr 29 09:06:54 2022] POST /compute/v2.1/servers/4e638d0d-740f-4461-a3de-b5e5a048de54/action => generated 0 bytes in 79 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 29 09:06:54.672080 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-6241ba20-3442-430e-b656-86208ee1891c tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Calling method '>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 09:06:54.672810 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-6241ba20-3442-430e-b656-86208ee1891c tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] [instance: 4e638d0d-740f-4461-a3de-b5e5a048de54] Fetching instance by UUID {{(pid=123459) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 09:06:54.679005 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-6241ba20-3442-430e-b656-86208ee1891c tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:06:54.679462 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-6241ba20-3442-430e-b656-86208ee1891c tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:06:54.680269 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-6241ba20-3442-430e-b656-86208ee1891c tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:06:54.680739 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-6241ba20-3442-430e-b656-86208ee1891c tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:06:54.818486 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-6241ba20-3442-430e-b656-86208ee1891c tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fe54d1c29bf4300a2d2c9365d1d6dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aba74bd5665f48f69b0d080b09b8ade5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 09:06:54.826009 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-6241ba20-3442-430e-b656-86208ee1891c tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] 10.222.0.31 "GET /compute/v2.1/servers/4e638d0d-740f-4461-a3de-b5e5a048de54" status: 200 len: 1676 microversion: 2.1 time: 0.159721 Apr 29 09:06:54.826576 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 632/1269] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 09:06:54 2022] GET /compute/v2.1/servers/4e638d0d-740f-4461-a3de-b5e5a048de54 => generated 1676 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 09:06:55.844178 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-35fdc1db-c275-4ecb-930d-e0d4bcd06342 tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Calling method '>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 09:06:55.844876 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-35fdc1db-c275-4ecb-930d-e0d4bcd06342 tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] [instance: 4e638d0d-740f-4461-a3de-b5e5a048de54] Fetching instance by UUID {{(pid=123458) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 09:06:55.851312 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-35fdc1db-c275-4ecb-930d-e0d4bcd06342 tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:06:55.851755 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-35fdc1db-c275-4ecb-930d-e0d4bcd06342 tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:06:55.852542 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-35fdc1db-c275-4ecb-930d-e0d4bcd06342 tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:06:55.852978 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-35fdc1db-c275-4ecb-930d-e0d4bcd06342 tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:06:56.085777 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-35fdc1db-c275-4ecb-930d-e0d4bcd06342 tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fe54d1c29bf4300a2d2c9365d1d6dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aba74bd5665f48f69b0d080b09b8ade5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 09:06:56.093609 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-35fdc1db-c275-4ecb-930d-e0d4bcd06342 tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] 10.222.0.31 "GET /compute/v2.1/servers/4e638d0d-740f-4461-a3de-b5e5a048de54" status: 200 len: 1676 microversion: 2.1 time: 0.253684 Apr 29 09:06:56.094175 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 638/1270] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 09:06:55 2022] GET /compute/v2.1/servers/4e638d0d-740f-4461-a3de-b5e5a048de54 => generated 1676 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 09:06:57.111034 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-460c7624-2359-434a-aac4-647cd58e6786 tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Calling method '>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 09:06:57.111635 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-460c7624-2359-434a-aac4-647cd58e6786 tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] [instance: 4e638d0d-740f-4461-a3de-b5e5a048de54] Fetching instance by UUID {{(pid=123459) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 09:06:57.118034 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-460c7624-2359-434a-aac4-647cd58e6786 tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:06:57.118482 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-460c7624-2359-434a-aac4-647cd58e6786 tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:06:57.119246 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-460c7624-2359-434a-aac4-647cd58e6786 tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:06:57.119682 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-460c7624-2359-434a-aac4-647cd58e6786 tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:06:57.249879 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-460c7624-2359-434a-aac4-647cd58e6786 tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fe54d1c29bf4300a2d2c9365d1d6dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aba74bd5665f48f69b0d080b09b8ade5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 09:06:57.257467 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-460c7624-2359-434a-aac4-647cd58e6786 tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] 10.222.0.31 "GET /compute/v2.1/servers/4e638d0d-740f-4461-a3de-b5e5a048de54" status: 200 len: 1676 microversion: 2.1 time: 0.150345 Apr 29 09:06:57.258035 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 633/1271] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 09:06:57 2022] GET /compute/v2.1/servers/4e638d0d-740f-4461-a3de-b5e5a048de54 => generated 1676 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 09:06:58.274544 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-b19ff16a-5569-478e-9f72-32526ddd3211 tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Calling method '>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 09:06:58.275202 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-b19ff16a-5569-478e-9f72-32526ddd3211 tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] [instance: 4e638d0d-740f-4461-a3de-b5e5a048de54] Fetching instance by UUID {{(pid=123458) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 09:06:58.282477 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-b19ff16a-5569-478e-9f72-32526ddd3211 tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:06:58.282928 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-b19ff16a-5569-478e-9f72-32526ddd3211 tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:06:58.283700 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-b19ff16a-5569-478e-9f72-32526ddd3211 tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:06:58.284152 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-b19ff16a-5569-478e-9f72-32526ddd3211 tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:06:58.411807 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-b19ff16a-5569-478e-9f72-32526ddd3211 tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fe54d1c29bf4300a2d2c9365d1d6dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aba74bd5665f48f69b0d080b09b8ade5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 09:06:58.419306 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-b19ff16a-5569-478e-9f72-32526ddd3211 tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] 10.222.0.31 "GET /compute/v2.1/servers/4e638d0d-740f-4461-a3de-b5e5a048de54" status: 200 len: 1676 microversion: 2.1 time: 0.148628 Apr 29 09:06:58.419862 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 639/1272] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 09:06:58 2022] GET /compute/v2.1/servers/4e638d0d-740f-4461-a3de-b5e5a048de54 => generated 1676 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 09:06:59.435839 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-8a023768-3c1f-4828-9d24-8e1e157450dc tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Calling method '>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 09:06:59.436484 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-8a023768-3c1f-4828-9d24-8e1e157450dc tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] [instance: 4e638d0d-740f-4461-a3de-b5e5a048de54] Fetching instance by UUID {{(pid=123459) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 09:06:59.442870 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-8a023768-3c1f-4828-9d24-8e1e157450dc tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:06:59.443323 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-8a023768-3c1f-4828-9d24-8e1e157450dc tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:06:59.444095 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-8a023768-3c1f-4828-9d24-8e1e157450dc tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:06:59.444565 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-8a023768-3c1f-4828-9d24-8e1e157450dc tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:06:59.572636 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-8a023768-3c1f-4828-9d24-8e1e157450dc tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fe54d1c29bf4300a2d2c9365d1d6dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aba74bd5665f48f69b0d080b09b8ade5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 09:06:59.580535 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-8a023768-3c1f-4828-9d24-8e1e157450dc tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] 10.222.0.31 "GET /compute/v2.1/servers/4e638d0d-740f-4461-a3de-b5e5a048de54" status: 200 len: 1676 microversion: 2.1 time: 0.148881 Apr 29 09:06:59.581098 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 634/1273] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 09:06:59 2022] GET /compute/v2.1/servers/4e638d0d-740f-4461-a3de-b5e5a048de54 => generated 1676 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 09:07:00.598335 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-4e7c14e2-e40f-480e-853b-e7ddc2b242df tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Calling method '>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 09:07:00.598956 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-4e7c14e2-e40f-480e-853b-e7ddc2b242df tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] [instance: 4e638d0d-740f-4461-a3de-b5e5a048de54] Fetching instance by UUID {{(pid=123458) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 09:07:00.606693 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-4e7c14e2-e40f-480e-853b-e7ddc2b242df tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:07:00.607177 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-4e7c14e2-e40f-480e-853b-e7ddc2b242df tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:07:00.607964 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-4e7c14e2-e40f-480e-853b-e7ddc2b242df tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:07:00.608438 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-4e7c14e2-e40f-480e-853b-e7ddc2b242df tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:07:00.737392 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-4e7c14e2-e40f-480e-853b-e7ddc2b242df tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fe54d1c29bf4300a2d2c9365d1d6dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aba74bd5665f48f69b0d080b09b8ade5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 09:07:00.744658 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-4e7c14e2-e40f-480e-853b-e7ddc2b242df tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] 10.222.0.31 "GET /compute/v2.1/servers/4e638d0d-740f-4461-a3de-b5e5a048de54" status: 200 len: 1676 microversion: 2.1 time: 0.150275 Apr 29 09:07:00.745246 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 640/1274] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 09:07:00 2022] GET /compute/v2.1/servers/4e638d0d-740f-4461-a3de-b5e5a048de54 => generated 1676 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 09:07:01.762962 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-ef6f5e37-e42d-4fb3-ba2f-c5f618db38fb tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Calling method '>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 09:07:01.763565 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-ef6f5e37-e42d-4fb3-ba2f-c5f618db38fb tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] [instance: 4e638d0d-740f-4461-a3de-b5e5a048de54] Fetching instance by UUID {{(pid=123459) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 09:07:01.769932 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-ef6f5e37-e42d-4fb3-ba2f-c5f618db38fb tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:07:01.770390 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-ef6f5e37-e42d-4fb3-ba2f-c5f618db38fb tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:07:01.771158 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-ef6f5e37-e42d-4fb3-ba2f-c5f618db38fb tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:07:01.771598 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-ef6f5e37-e42d-4fb3-ba2f-c5f618db38fb tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:07:01.903041 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-ef6f5e37-e42d-4fb3-ba2f-c5f618db38fb tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fe54d1c29bf4300a2d2c9365d1d6dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aba74bd5665f48f69b0d080b09b8ade5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 09:07:01.910379 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-ef6f5e37-e42d-4fb3-ba2f-c5f618db38fb tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] 10.222.0.31 "GET /compute/v2.1/servers/4e638d0d-740f-4461-a3de-b5e5a048de54" status: 200 len: 1676 microversion: 2.1 time: 0.151404 Apr 29 09:07:01.910956 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 635/1275] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 09:07:01 2022] GET /compute/v2.1/servers/4e638d0d-740f-4461-a3de-b5e5a048de54 => generated 1676 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 29 09:07:02.928124 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-94228c05-c202-4b75-8f0c-404f7c001f2a tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Calling method '>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 09:07:02.928763 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-94228c05-c202-4b75-8f0c-404f7c001f2a tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] [instance: 4e638d0d-740f-4461-a3de-b5e5a048de54] Fetching instance by UUID {{(pid=123458) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 09:07:02.935956 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-94228c05-c202-4b75-8f0c-404f7c001f2a tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:07:02.936431 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-94228c05-c202-4b75-8f0c-404f7c001f2a tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:07:02.937218 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-94228c05-c202-4b75-8f0c-404f7c001f2a tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:07:02.937661 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-94228c05-c202-4b75-8f0c-404f7c001f2a tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:07:03.069931 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-94228c05-c202-4b75-8f0c-404f7c001f2a tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fe54d1c29bf4300a2d2c9365d1d6dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aba74bd5665f48f69b0d080b09b8ade5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 09:07:03.078157 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-94228c05-c202-4b75-8f0c-404f7c001f2a tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] 10.222.0.31 "GET /compute/v2.1/servers/4e638d0d-740f-4461-a3de-b5e5a048de54" status: 200 len: 1676 microversion: 2.1 time: 0.153915 Apr 29 09:07:03.078734 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 641/1276] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 09:07:02 2022] GET /compute/v2.1/servers/4e638d0d-740f-4461-a3de-b5e5a048de54 => generated 1676 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 09:07:04.095738 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-5d7107a5-0fe9-4e43-a817-9a10ff7c2d43 tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Calling method '>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 09:07:04.096406 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-5d7107a5-0fe9-4e43-a817-9a10ff7c2d43 tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] [instance: 4e638d0d-740f-4461-a3de-b5e5a048de54] Fetching instance by UUID {{(pid=123459) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 09:07:04.102679 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-5d7107a5-0fe9-4e43-a817-9a10ff7c2d43 tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:07:04.103119 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-5d7107a5-0fe9-4e43-a817-9a10ff7c2d43 tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:07:04.103879 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-5d7107a5-0fe9-4e43-a817-9a10ff7c2d43 tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:07:04.104340 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-5d7107a5-0fe9-4e43-a817-9a10ff7c2d43 tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:07:04.230565 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-5d7107a5-0fe9-4e43-a817-9a10ff7c2d43 tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fe54d1c29bf4300a2d2c9365d1d6dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aba74bd5665f48f69b0d080b09b8ade5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 09:07:04.237907 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-5d7107a5-0fe9-4e43-a817-9a10ff7c2d43 tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] 10.222.0.31 "GET /compute/v2.1/servers/4e638d0d-740f-4461-a3de-b5e5a048de54" status: 200 len: 1676 microversion: 2.1 time: 0.145992 Apr 29 09:07:04.238480 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 636/1277] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 09:07:04 2022] GET /compute/v2.1/servers/4e638d0d-740f-4461-a3de-b5e5a048de54 => generated 1676 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 09:07:05.255092 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-b7d39854-0cc4-440e-895e-e4f2a4daff92 tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Calling method '>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 09:07:05.255702 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-b7d39854-0cc4-440e-895e-e4f2a4daff92 tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] [instance: 4e638d0d-740f-4461-a3de-b5e5a048de54] Fetching instance by UUID {{(pid=123458) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 09:07:05.262634 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-b7d39854-0cc4-440e-895e-e4f2a4daff92 tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:07:05.263080 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-b7d39854-0cc4-440e-895e-e4f2a4daff92 tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:07:05.263855 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-b7d39854-0cc4-440e-895e-e4f2a4daff92 tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:07:05.264323 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-b7d39854-0cc4-440e-895e-e4f2a4daff92 tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:07:05.402127 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-b7d39854-0cc4-440e-895e-e4f2a4daff92 tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fe54d1c29bf4300a2d2c9365d1d6dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aba74bd5665f48f69b0d080b09b8ade5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 09:07:05.409604 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-b7d39854-0cc4-440e-895e-e4f2a4daff92 tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] 10.222.0.31 "GET /compute/v2.1/servers/4e638d0d-740f-4461-a3de-b5e5a048de54" status: 200 len: 1653 microversion: 2.1 time: 0.158629 Apr 29 09:07:05.410165 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 642/1278] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 09:07:05 2022] GET /compute/v2.1/servers/4e638d0d-740f-4461-a3de-b5e5a048de54 => generated 1653 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 09:07:05.426255 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-798f9e8f-7d02-48d8-99ac-a292d8a7641d tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 29 09:07:05.432539 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-798f9e8f-7d02-48d8-99ac-a292d8a7641d tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:07:05.432975 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-798f9e8f-7d02-48d8-99ac-a292d8a7641d tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:07:05.454894 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-798f9e8f-7d02-48d8-99ac-a292d8a7641d tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] [instance: 4e638d0d-740f-4461-a3de-b5e5a048de54] Going to try to start instance {{(pid=123459) start /opt/stack/nova/nova/compute/api.py:2730}} Apr 29 09:07:05.504637 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-798f9e8f-7d02-48d8-99ac-a292d8a7641d tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] 10.222.0.31 "POST /compute/v2.1/servers/4e638d0d-740f-4461-a3de-b5e5a048de54/action" status: 202 len: 0 microversion: 2.1 time: 0.081786 Apr 29 09:07:05.505457 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 637/1279] 10.222.0.31 () {60 vars in 1277 bytes} [Fri Apr 29 09:07:05 2022] POST /compute/v2.1/servers/4e638d0d-740f-4461-a3de-b5e5a048de54/action => generated 0 bytes in 84 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 29 09:07:05.513547 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-ca4e1cb1-cc1f-4db4-b9c9-a89ee5292c89 tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Calling method '>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 09:07:05.514180 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-ca4e1cb1-cc1f-4db4-b9c9-a89ee5292c89 tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] [instance: 4e638d0d-740f-4461-a3de-b5e5a048de54] Fetching instance by UUID {{(pid=123458) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 09:07:05.520168 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-ca4e1cb1-cc1f-4db4-b9c9-a89ee5292c89 tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:07:05.520629 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-ca4e1cb1-cc1f-4db4-b9c9-a89ee5292c89 tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:07:05.521417 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-ca4e1cb1-cc1f-4db4-b9c9-a89ee5292c89 tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:07:05.521852 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-ca4e1cb1-cc1f-4db4-b9c9-a89ee5292c89 tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:07:05.660312 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-ca4e1cb1-cc1f-4db4-b9c9-a89ee5292c89 tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fe54d1c29bf4300a2d2c9365d1d6dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aba74bd5665f48f69b0d080b09b8ade5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 09:07:05.669341 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-ca4e1cb1-cc1f-4db4-b9c9-a89ee5292c89 tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] 10.222.0.31 "GET /compute/v2.1/servers/4e638d0d-740f-4461-a3de-b5e5a048de54" status: 200 len: 1662 microversion: 2.1 time: 0.159676 Apr 29 09:07:05.669932 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 643/1280] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 09:07:05 2022] GET /compute/v2.1/servers/4e638d0d-740f-4461-a3de-b5e5a048de54 => generated 1662 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 09:07:06.688034 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-1054fda3-2fc7-4144-a32c-965994e2e1d0 tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Calling method '>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 09:07:06.688662 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-1054fda3-2fc7-4144-a32c-965994e2e1d0 tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] [instance: 4e638d0d-740f-4461-a3de-b5e5a048de54] Fetching instance by UUID {{(pid=123459) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 09:07:06.695386 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-1054fda3-2fc7-4144-a32c-965994e2e1d0 tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:07:06.695934 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-1054fda3-2fc7-4144-a32c-965994e2e1d0 tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:07:06.697191 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-1054fda3-2fc7-4144-a32c-965994e2e1d0 tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:07:06.697637 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-1054fda3-2fc7-4144-a32c-965994e2e1d0 tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:07:06.837755 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-1054fda3-2fc7-4144-a32c-965994e2e1d0 tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fe54d1c29bf4300a2d2c9365d1d6dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aba74bd5665f48f69b0d080b09b8ade5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 09:07:06.845319 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-1054fda3-2fc7-4144-a32c-965994e2e1d0 tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] 10.222.0.31 "GET /compute/v2.1/servers/4e638d0d-740f-4461-a3de-b5e5a048de54" status: 200 len: 1662 microversion: 2.1 time: 0.162026 Apr 29 09:07:06.845879 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 638/1281] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 09:07:06 2022] GET /compute/v2.1/servers/4e638d0d-740f-4461-a3de-b5e5a048de54 => generated 1662 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 09:07:07.862735 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-84dfe9cb-3017-4788-9061-02531d427434 tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Calling method '>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 09:07:07.863473 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-84dfe9cb-3017-4788-9061-02531d427434 tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] [instance: 4e638d0d-740f-4461-a3de-b5e5a048de54] Fetching instance by UUID {{(pid=123458) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 09:07:07.869853 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-84dfe9cb-3017-4788-9061-02531d427434 tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:07:07.870303 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-84dfe9cb-3017-4788-9061-02531d427434 tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:07:07.871753 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-84dfe9cb-3017-4788-9061-02531d427434 tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:07:07.872222 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-84dfe9cb-3017-4788-9061-02531d427434 tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:07:08.007821 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-84dfe9cb-3017-4788-9061-02531d427434 tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fe54d1c29bf4300a2d2c9365d1d6dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aba74bd5665f48f69b0d080b09b8ade5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 09:07:08.016083 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-84dfe9cb-3017-4788-9061-02531d427434 tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] 10.222.0.31 "GET /compute/v2.1/servers/4e638d0d-740f-4461-a3de-b5e5a048de54" status: 200 len: 1666 microversion: 2.1 time: 0.157241 Apr 29 09:07:08.016706 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 644/1282] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 09:07:07 2022] GET /compute/v2.1/servers/4e638d0d-740f-4461-a3de-b5e5a048de54 => generated 1666 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 09:07:50.590869 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 29 09:07:50.591550 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: Fri Apr 29 09:07:50 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 29 09:08:11.311269 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-9b18f96f-658a-44be-9198-6d1b84c0b964 tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Calling method '>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 09:08:11.312312 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-9b18f96f-658a-44be-9198-6d1b84c0b964 tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] [instance: 4e638d0d-740f-4461-a3de-b5e5a048de54] Fetching instance by UUID {{(pid=123459) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 09:08:11.319531 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-9b18f96f-658a-44be-9198-6d1b84c0b964 tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:08:11.319997 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-9b18f96f-658a-44be-9198-6d1b84c0b964 tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:08:11.320872 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-9b18f96f-658a-44be-9198-6d1b84c0b964 tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:08:11.321371 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-9b18f96f-658a-44be-9198-6d1b84c0b964 tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:08:11.352568 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-9b18f96f-658a-44be-9198-6d1b84c0b964 tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] 10.222.0.31 "GET /compute/v2.1/servers/4e638d0d-740f-4461-a3de-b5e5a048de54/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046078 Apr 29 09:08:11.353323 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 639/1283] 10.222.0.31 () {58 vars in 1301 bytes} [Fri Apr 29 09:08:11 2022] GET /compute/v2.1/servers/4e638d0d-740f-4461-a3de-b5e5a048de54/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 29 09:08:11.414545 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-f26b3429-3bb0-4dc1-9ab6-d83477a79730 tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Calling method '>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 09:08:11.415113 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-f26b3429-3bb0-4dc1-9ab6-d83477a79730 tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] [instance: 4e638d0d-740f-4461-a3de-b5e5a048de54] Fetching instance by UUID {{(pid=123458) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 09:08:11.421088 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-f26b3429-3bb0-4dc1-9ab6-d83477a79730 tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:08:11.421543 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-f26b3429-3bb0-4dc1-9ab6-d83477a79730 tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:08:11.422325 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-f26b3429-3bb0-4dc1-9ab6-d83477a79730 tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:08:11.422775 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-f26b3429-3bb0-4dc1-9ab6-d83477a79730 tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:08:11.451690 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-f26b3429-3bb0-4dc1-9ab6-d83477a79730 tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] [instance: 4e638d0d-740f-4461-a3de-b5e5a048de54] Going to try to terminate instance {{(pid=123458) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 29 09:08:11.535737 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-f26b3429-3bb0-4dc1-9ab6-d83477a79730 tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] 10.222.0.31 "DELETE /compute/v2.1/servers/4e638d0d-740f-4461-a3de-b5e5a048de54" status: 204 len: 0 microversion: 2.1 time: 0.126142 Apr 29 09:08:11.536301 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 645/1284] 10.222.0.31 () {58 vars in 1238 bytes} [Fri Apr 29 09:08:11 2022] DELETE /compute/v2.1/servers/4e638d0d-740f-4461-a3de-b5e5a048de54 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 29 09:08:11.545496 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-94d5ef5a-c490-4a66-a932-d1f8cd1c5c47 tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Calling method '>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 09:08:11.546099 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-94d5ef5a-c490-4a66-a932-d1f8cd1c5c47 tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] [instance: 4e638d0d-740f-4461-a3de-b5e5a048de54] Fetching instance by UUID {{(pid=123459) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 09:08:11.552286 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-94d5ef5a-c490-4a66-a932-d1f8cd1c5c47 tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:08:11.552739 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-94d5ef5a-c490-4a66-a932-d1f8cd1c5c47 tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:08:11.553502 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-94d5ef5a-c490-4a66-a932-d1f8cd1c5c47 tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:08:11.553931 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-94d5ef5a-c490-4a66-a932-d1f8cd1c5c47 tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:08:11.688114 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-94d5ef5a-c490-4a66-a932-d1f8cd1c5c47 tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fe54d1c29bf4300a2d2c9365d1d6dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aba74bd5665f48f69b0d080b09b8ade5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 09:08:11.696254 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-94d5ef5a-c490-4a66-a932-d1f8cd1c5c47 tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] 10.222.0.31 "GET /compute/v2.1/servers/4e638d0d-740f-4461-a3de-b5e5a048de54" status: 200 len: 1672 microversion: 2.1 time: 0.155127 Apr 29 09:08:11.696822 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 640/1285] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 09:08:11 2022] GET /compute/v2.1/servers/4e638d0d-740f-4461-a3de-b5e5a048de54 => generated 1672 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 09:08:12.714554 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-b84b52e9-8956-4be0-9a7a-8adcf6ccf7e6 tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Calling method '>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 09:08:12.715308 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-b84b52e9-8956-4be0-9a7a-8adcf6ccf7e6 tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] [instance: 4e638d0d-740f-4461-a3de-b5e5a048de54] Fetching instance by UUID {{(pid=123458) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 09:08:12.722563 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-b84b52e9-8956-4be0-9a7a-8adcf6ccf7e6 tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:08:12.723024 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-b84b52e9-8956-4be0-9a7a-8adcf6ccf7e6 tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:08:12.723834 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-b84b52e9-8956-4be0-9a7a-8adcf6ccf7e6 tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:08:12.724332 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-b84b52e9-8956-4be0-9a7a-8adcf6ccf7e6 tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:08:12.876518 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-b84b52e9-8956-4be0-9a7a-8adcf6ccf7e6 tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fe54d1c29bf4300a2d2c9365d1d6dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aba74bd5665f48f69b0d080b09b8ade5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 09:08:12.884740 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-b84b52e9-8956-4be0-9a7a-8adcf6ccf7e6 tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] 10.222.0.31 "GET /compute/v2.1/servers/4e638d0d-740f-4461-a3de-b5e5a048de54" status: 200 len: 1672 microversion: 2.1 time: 0.174530 Apr 29 09:08:12.885768 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 646/1286] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 09:08:12 2022] GET /compute/v2.1/servers/4e638d0d-740f-4461-a3de-b5e5a048de54 => generated 1672 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 09:08:13.902284 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-406e3e0a-af30-4c06-a9ab-8397063996ca tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Calling method '>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 09:08:13.902884 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-406e3e0a-af30-4c06-a9ab-8397063996ca tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] [instance: 4e638d0d-740f-4461-a3de-b5e5a048de54] Fetching instance by UUID {{(pid=123459) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 09:08:13.909401 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-406e3e0a-af30-4c06-a9ab-8397063996ca tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:08:13.909838 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-406e3e0a-af30-4c06-a9ab-8397063996ca tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:08:13.910604 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-406e3e0a-af30-4c06-a9ab-8397063996ca tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:08:13.911039 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-406e3e0a-af30-4c06-a9ab-8397063996ca tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:08:14.102181 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-406e3e0a-af30-4c06-a9ab-8397063996ca tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fe54d1c29bf4300a2d2c9365d1d6dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aba74bd5665f48f69b0d080b09b8ade5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 09:08:14.109564 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-406e3e0a-af30-4c06-a9ab-8397063996ca tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] 10.222.0.31 "GET /compute/v2.1/servers/4e638d0d-740f-4461-a3de-b5e5a048de54" status: 200 len: 1672 microversion: 2.1 time: 0.211148 Apr 29 09:08:14.110139 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 641/1287] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 09:08:13 2022] GET /compute/v2.1/servers/4e638d0d-740f-4461-a3de-b5e5a048de54 => generated 1672 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 09:08:14.883492 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [req-d7feb6f7-8150-4926-a879-a4bfe10ae792 req-ce8c3b79-0257-4cfd-9d13-388655ad3b26 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4e638d0d-740f-4461-a3de-b5e5a048de54", "name": "network-vif-deleted", "tag": "5c22483b-a6ab-4eee-8e1e-95997e13d961"}]} {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 29 09:08:14.892959 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [req-d7feb6f7-8150-4926-a879-a4bfe10ae792 req-ce8c3b79-0257-4cfd-9d13-388655ad3b26 service nova] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:08:14.894849 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [req-d7feb6f7-8150-4926-a879-a4bfe10ae792 req-ce8c3b79-0257-4cfd-9d13-388655ad3b26 service nova] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:08:14.907500 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.compute.server_external_events [req-d7feb6f7-8150-4926-a879-a4bfe10ae792 req-ce8c3b79-0257-4cfd-9d13-388655ad3b26 service nova] Creating event network-vif-deleted:5c22483b-a6ab-4eee-8e1e-95997e13d961 for instance 4e638d0d-740f-4461-a3de-b5e5a048de54 on hv-cinder-83987 Apr 29 09:08:14.914659 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [req-d7feb6f7-8150-4926-a879-a4bfe10ae792 req-ce8c3b79-0257-4cfd-9d13-388655ad3b26 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034836 Apr 29 09:08:14.915634 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 647/1288] 10.222.0.31 () {64 vars in 1317 bytes} [Fri Apr 29 09:08:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 29 09:08:15.126808 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-17081d66-093f-42a7-8b47-61af2991c746 tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Calling method '>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 09:08:15.128225 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-17081d66-093f-42a7-8b47-61af2991c746 tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] [instance: 4e638d0d-740f-4461-a3de-b5e5a048de54] Fetching instance by UUID {{(pid=123459) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 09:08:15.134519 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-17081d66-093f-42a7-8b47-61af2991c746 tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:08:15.134970 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-17081d66-093f-42a7-8b47-61af2991c746 tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:08:15.135743 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-17081d66-093f-42a7-8b47-61af2991c746 tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:08:15.136198 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-17081d66-093f-42a7-8b47-61af2991c746 tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:08:15.168858 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-17081d66-093f-42a7-8b47-61af2991c746 tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:08:15.169221 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-17081d66-093f-42a7-8b47-61af2991c746 tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:08:15.169667 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.objects.instance [None req-17081d66-093f-42a7-8b47-61af2991c746 tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Lazy-loading 'fault' on Instance uuid 4e638d0d-740f-4461-a3de-b5e5a048de54 {{(pid=123459) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 29 09:08:15.211211 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-17081d66-093f-42a7-8b47-61af2991c746 tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fe54d1c29bf4300a2d2c9365d1d6dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aba74bd5665f48f69b0d080b09b8ade5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 09:08:15.218688 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-17081d66-093f-42a7-8b47-61af2991c746 tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] 10.222.0.31 "GET /compute/v2.1/servers/4e638d0d-740f-4461-a3de-b5e5a048de54" status: 200 len: 1326 microversion: 2.1 time: 0.095730 Apr 29 09:08:15.219372 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 642/1289] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 09:08:15 2022] GET /compute/v2.1/servers/4e638d0d-740f-4461-a3de-b5e5a048de54 => generated 1326 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 09:08:16.236318 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-9f358ff8-f9b2-4f5e-ae2e-91b784f9a454 tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Calling method '>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 09:08:16.237029 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-9f358ff8-f9b2-4f5e-ae2e-91b784f9a454 tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] [instance: 4e638d0d-740f-4461-a3de-b5e5a048de54] Fetching instance by UUID {{(pid=123458) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 09:08:16.243231 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-9f358ff8-f9b2-4f5e-ae2e-91b784f9a454 tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:08:16.243680 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-9f358ff8-f9b2-4f5e-ae2e-91b784f9a454 tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:08:16.244484 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-9f358ff8-f9b2-4f5e-ae2e-91b784f9a454 tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:08:16.244926 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-9f358ff8-f9b2-4f5e-ae2e-91b784f9a454 tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:08:16.258171 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.wsgi [None req-9f358ff8-f9b2-4f5e-ae2e-91b784f9a454 tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] HTTP exception thrown: Instance 4e638d0d-740f-4461-a3de-b5e5a048de54 could not be found. Apr 29 09:08:16.258753 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-9f358ff8-f9b2-4f5e-ae2e-91b784f9a454 tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Returning 404 to user: Instance 4e638d0d-740f-4461-a3de-b5e5a048de54 could not be found. {{(pid=123458) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 29 09:08:16.259572 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-9f358ff8-f9b2-4f5e-ae2e-91b784f9a454 tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] 10.222.0.31 "GET /compute/v2.1/servers/4e638d0d-740f-4461-a3de-b5e5a048de54" status: 404 len: 111 microversion: 2.1 time: 0.027963 Apr 29 09:08:16.260102 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 648/1290] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 09:08:16 2022] GET /compute/v2.1/servers/4e638d0d-740f-4461-a3de-b5e5a048de54 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 29 09:08:16.269114 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-65471123-bc7b-4716-9ead-b8f42bbf601b tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Calling method '.version_select at 0x7f623cab6ee0>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 09:08:16.272563 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: ERROR oslo.messaging._drivers.impl_rabbit [None req-65471123-bc7b-4716-9ead-b8f42bbf601b tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] [ee32127b-b0d6-409b-acd1-bfa6e483e56a] AMQP server on 10.222.0.31:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Apr 29 09:08:17.281009 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO oslo.messaging._drivers.impl_rabbit [None req-65471123-bc7b-4716-9ead-b8f42bbf601b tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] [ee32127b-b0d6-409b-acd1-bfa6e483e56a] Reconnected to AMQP server on 10.222.0.31:5672 via [amqp] client with port 49572. Apr 29 09:08:17.301936 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-65471123-bc7b-4716-9ead-b8f42bbf601b tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] 10.222.0.31 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-986686593" status: 202 len: 0 microversion: 2.1 time: 1.037312 Apr 29 09:08:17.302523 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 643/1291] 10.222.0.31 () {58 vars in 1217 bytes} [Fri Apr 29 09:08:16 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-986686593 => generated 0 bytes in 1039 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 29 09:08:18.178800 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-fe785549-3974-4980-b388-ad80726d463b tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Action: 'create', calling method: .version_select at 0x7f623849d040>, body: {"keypair": {"name": "tempest-keypair-613605565"}} {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 29 09:08:18.193331 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.quota [None req-fe785549-3974-4980-b388-ad80726d463b tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Getting quotas for project aba74bd5665f48f69b0d080b09b8ade5. Resources: {'key_pairs'} {{(pid=123458) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 29 09:08:18.197056 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.quota [None req-fe785549-3974-4980-b388-ad80726d463b tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Getting quotas for user 0fe54d1c29bf4300a2d2c9365d1d6dfc and project aba74bd5665f48f69b0d080b09b8ade5. Resources: {'key_pairs'} {{(pid=123458) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 29 09:08:18.378598 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.quota [None req-fe785549-3974-4980-b388-ad80726d463b tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Getting quotas for project aba74bd5665f48f69b0d080b09b8ade5. Resources: {'key_pairs'} {{(pid=123458) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 29 09:08:18.382252 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.quota [None req-fe785549-3974-4980-b388-ad80726d463b tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Getting quotas for user 0fe54d1c29bf4300a2d2c9365d1d6dfc and project aba74bd5665f48f69b0d080b09b8ade5. Resources: {'key_pairs'} {{(pid=123458) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 29 09:08:18.395883 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-fe785549-3974-4980-b388-ad80726d463b tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] 10.222.0.31 "POST /compute/v2.1/os-keypairs" status: 200 len: 2300 microversion: 2.1 time: 0.221057 Apr 29 09:08:18.396527 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 649/1292] 10.222.0.31 () {60 vars in 1157 bytes} [Fri Apr 29 09:08:18 2022] POST /compute/v2.1/os-keypairs => generated 2300 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 09:08:19.659590 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-31a1945f-1f1b-4a1b-92fc-a4bf626c64ab tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-276774477", "imageRef": "e0678f88-0b68-4453-b569-29fd065e544e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "1a79dedb-df01-4141-9876-7ec3cac354d9"}], "security_groups": [{"name": "tempest-securitygroup--1533784209"}], "key_name": "tempest-keypair-613605565", "user_data": "}} {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 29 09:08:19.762925 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.network.neutron [None req-31a1945f-1f1b-4a1b-92fc-a4bf626c64ab tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] validate_networks() for [('1a79dedb-df01-4141-9876-7ec3cac354d9', None, None, None, None, None)] {{(pid=123459) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 29 09:08:20.182352 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.virt.hardware [None req-31a1945f-1f1b-4a1b-92fc-a4bf626c64ab tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Flavor limits 0:0:0 {{(pid=123459) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 29 09:08:20.182776 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.virt.hardware [None req-31a1945f-1f1b-4a1b-92fc-a4bf626c64ab tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Image limits 0:0:0 {{(pid=123459) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 29 09:08:20.183257 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.virt.hardware [None req-31a1945f-1f1b-4a1b-92fc-a4bf626c64ab tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Flavor pref 0:0:0 {{(pid=123459) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 29 09:08:20.183663 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.virt.hardware [None req-31a1945f-1f1b-4a1b-92fc-a4bf626c64ab tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Image pref 0:0:0 {{(pid=123459) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 29 09:08:20.184074 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.virt.hardware [None req-31a1945f-1f1b-4a1b-92fc-a4bf626c64ab tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123459) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 29 09:08:20.192809 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-31a1945f-1f1b-4a1b-92fc-a4bf626c64ab tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:08:20.193264 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-31a1945f-1f1b-4a1b-92fc-a4bf626c64ab tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:08:20.194069 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-31a1945f-1f1b-4a1b-92fc-a4bf626c64ab tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:08:20.194503 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-31a1945f-1f1b-4a1b-92fc-a4bf626c64ab tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:08:20.211837 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.quota [None req-31a1945f-1f1b-4a1b-92fc-a4bf626c64ab tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Getting quotas for project aba74bd5665f48f69b0d080b09b8ade5. Resources: {'instances', 'cores', 'ram'} {{(pid=123459) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 29 09:08:20.216256 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.quota [None req-31a1945f-1f1b-4a1b-92fc-a4bf626c64ab tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Getting quotas for user 0fe54d1c29bf4300a2d2c9365d1d6dfc and project aba74bd5665f48f69b0d080b09b8ade5. Resources: {'instances', 'cores', 'ram'} {{(pid=123459) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 29 09:08:20.227736 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-31a1945f-1f1b-4a1b-92fc-a4bf626c64ab tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Going to run 1 instances... {{(pid=123459) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 29 09:08:20.230041 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-31a1945f-1f1b-4a1b-92fc-a4bf626c64ab tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] [instance: 4b6f9c5a-d8c7-42d2-8a30-979b4f6bdaac] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e0678f88-0b68-4453-b569-29fd065e544e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123459) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 29 09:08:20.275920 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-31a1945f-1f1b-4a1b-92fc-a4bf626c64ab tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] 10.222.0.31 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.621233 Apr 29 09:08:20.276606 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 644/1293] 10.222.0.31 () {60 vars in 1146 bytes} [Fri Apr 29 09:08:19 2022] POST /compute/v2.1/servers => generated 402 bytes in 623 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 29 09:08:20.287537 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-3c39e0d2-657a-41ee-a7c9-3701d2003b6f tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Calling method '>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 09:08:20.288479 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-3c39e0d2-657a-41ee-a7c9-3701d2003b6f tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] [instance: 4b6f9c5a-d8c7-42d2-8a30-979b4f6bdaac] Fetching instance by UUID {{(pid=123458) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 09:08:20.349386 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-3c39e0d2-657a-41ee-a7c9-3701d2003b6f tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fe54d1c29bf4300a2d2c9365d1d6dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aba74bd5665f48f69b0d080b09b8ade5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 09:08:20.359805 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-3c39e0d2-657a-41ee-a7c9-3701d2003b6f tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] 10.222.0.31 "GET /compute/v2.1/servers/4b6f9c5a-d8c7-42d2-8a30-979b4f6bdaac" status: 200 len: 1236 microversion: 2.1 time: 0.076808 Apr 29 09:08:20.360811 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 650/1294] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 09:08:20 2022] GET /compute/v2.1/servers/4b6f9c5a-d8c7-42d2-8a30-979b4f6bdaac => generated 1236 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 09:08:21.379028 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-ee6f487e-fd77-4f5a-b6ca-b1f7e8c838db tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Calling method '>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 09:08:21.379737 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-ee6f487e-fd77-4f5a-b6ca-b1f7e8c838db tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] [instance: 4b6f9c5a-d8c7-42d2-8a30-979b4f6bdaac] Fetching instance by UUID {{(pid=123459) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 09:08:21.386569 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-ee6f487e-fd77-4f5a-b6ca-b1f7e8c838db tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:08:21.387036 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-ee6f487e-fd77-4f5a-b6ca-b1f7e8c838db tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:08:21.387856 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-ee6f487e-fd77-4f5a-b6ca-b1f7e8c838db tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:08:21.388329 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-ee6f487e-fd77-4f5a-b6ca-b1f7e8c838db tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:08:21.464667 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-ee6f487e-fd77-4f5a-b6ca-b1f7e8c838db tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fe54d1c29bf4300a2d2c9365d1d6dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aba74bd5665f48f69b0d080b09b8ade5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 09:08:21.473698 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-ee6f487e-fd77-4f5a-b6ca-b1f7e8c838db tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] 10.222.0.31 "GET /compute/v2.1/servers/4b6f9c5a-d8c7-42d2-8a30-979b4f6bdaac" status: 200 len: 1306 microversion: 2.1 time: 0.100109 Apr 29 09:08:21.474267 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 645/1295] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 09:08:21 2022] GET /compute/v2.1/servers/4b6f9c5a-d8c7-42d2-8a30-979b4f6bdaac => generated 1306 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 09:08:22.493019 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-74336467-104e-4d13-a3e8-583239c33dad tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Calling method '>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 09:08:22.493622 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-74336467-104e-4d13-a3e8-583239c33dad tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] [instance: 4b6f9c5a-d8c7-42d2-8a30-979b4f6bdaac] Fetching instance by UUID {{(pid=123458) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 09:08:22.500057 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-74336467-104e-4d13-a3e8-583239c33dad tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:08:22.500550 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-74336467-104e-4d13-a3e8-583239c33dad tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:08:22.501334 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-74336467-104e-4d13-a3e8-583239c33dad tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:08:22.501777 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-74336467-104e-4d13-a3e8-583239c33dad tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:08:22.652332 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-74336467-104e-4d13-a3e8-583239c33dad tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fe54d1c29bf4300a2d2c9365d1d6dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aba74bd5665f48f69b0d080b09b8ade5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 09:08:22.661619 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-74336467-104e-4d13-a3e8-583239c33dad tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] 10.222.0.31 "GET /compute/v2.1/servers/4b6f9c5a-d8c7-42d2-8a30-979b4f6bdaac" status: 200 len: 1362 microversion: 2.1 time: 0.172420 Apr 29 09:08:22.662208 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 651/1296] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 09:08:22 2022] GET /compute/v2.1/servers/4b6f9c5a-d8c7-42d2-8a30-979b4f6bdaac => generated 1362 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 09:08:22.932258 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [req-7e707ee7-c9eb-406a-bb06-1066b5355d4a req-c68ff73c-7db2-4921-89f9-b1f23d4100d8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4b6f9c5a-d8c7-42d2-8a30-979b4f6bdaac", "tag": "14dea86b-96df-4276-a0a6-00104aef95b8"}]} {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 29 09:08:22.944577 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [req-7e707ee7-c9eb-406a-bb06-1066b5355d4a req-c68ff73c-7db2-4921-89f9-b1f23d4100d8 service nova] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:08:22.945005 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [req-7e707ee7-c9eb-406a-bb06-1066b5355d4a req-c68ff73c-7db2-4921-89f9-b1f23d4100d8 service nova] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:08:22.957597 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.compute.server_external_events [req-7e707ee7-c9eb-406a-bb06-1066b5355d4a req-c68ff73c-7db2-4921-89f9-b1f23d4100d8 service nova] Creating event network-changed:14dea86b-96df-4276-a0a6-00104aef95b8 for instance 4b6f9c5a-d8c7-42d2-8a30-979b4f6bdaac on hv-cinder-83987 Apr 29 09:08:22.962910 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [req-7e707ee7-c9eb-406a-bb06-1066b5355d4a req-c68ff73c-7db2-4921-89f9-b1f23d4100d8 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.118672 Apr 29 09:08:22.964160 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 646/1297] 10.222.0.31 () {64 vars in 1317 bytes} [Fri Apr 29 09:08:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 29 09:08:23.679162 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-6136cfdb-b73d-4544-a2af-25151bbc6fb9 tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Calling method '>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 09:08:23.679703 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-6136cfdb-b73d-4544-a2af-25151bbc6fb9 tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] [instance: 4b6f9c5a-d8c7-42d2-8a30-979b4f6bdaac] Fetching instance by UUID {{(pid=123458) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 09:08:23.686141 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-6136cfdb-b73d-4544-a2af-25151bbc6fb9 tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:08:23.686591 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-6136cfdb-b73d-4544-a2af-25151bbc6fb9 tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:08:23.687360 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-6136cfdb-b73d-4544-a2af-25151bbc6fb9 tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:08:23.687800 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-6136cfdb-b73d-4544-a2af-25151bbc6fb9 tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:08:23.818011 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-6136cfdb-b73d-4544-a2af-25151bbc6fb9 tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fe54d1c29bf4300a2d2c9365d1d6dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aba74bd5665f48f69b0d080b09b8ade5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 09:08:23.825376 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-6136cfdb-b73d-4544-a2af-25151bbc6fb9 tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] 10.222.0.31 "GET /compute/v2.1/servers/4b6f9c5a-d8c7-42d2-8a30-979b4f6bdaac" status: 200 len: 1362 microversion: 2.1 time: 0.150332 Apr 29 09:08:23.825944 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 652/1298] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 09:08:23 2022] GET /compute/v2.1/servers/4b6f9c5a-d8c7-42d2-8a30-979b4f6bdaac => generated 1362 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 09:08:24.844017 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-a3d431f5-4767-4980-b64e-4964161c8a47 tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Calling method '>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 09:08:24.844745 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-a3d431f5-4767-4980-b64e-4964161c8a47 tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] [instance: 4b6f9c5a-d8c7-42d2-8a30-979b4f6bdaac] Fetching instance by UUID {{(pid=123459) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 09:08:24.851697 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-a3d431f5-4767-4980-b64e-4964161c8a47 tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:08:24.852165 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-a3d431f5-4767-4980-b64e-4964161c8a47 tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:08:24.852949 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-a3d431f5-4767-4980-b64e-4964161c8a47 tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:08:24.853381 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-a3d431f5-4767-4980-b64e-4964161c8a47 tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:08:24.987975 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-a3d431f5-4767-4980-b64e-4964161c8a47 tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fe54d1c29bf4300a2d2c9365d1d6dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aba74bd5665f48f69b0d080b09b8ade5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 09:08:24.995918 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-a3d431f5-4767-4980-b64e-4964161c8a47 tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] 10.222.0.31 "GET /compute/v2.1/servers/4b6f9c5a-d8c7-42d2-8a30-979b4f6bdaac" status: 200 len: 1362 microversion: 2.1 time: 0.156567 Apr 29 09:08:24.996497 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 647/1299] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 09:08:24 2022] GET /compute/v2.1/servers/4b6f9c5a-d8c7-42d2-8a30-979b4f6bdaac => generated 1362 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 09:08:26.013345 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-f4734529-8ebc-497a-bce4-784c064b138b tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Calling method '>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 09:08:26.013962 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-f4734529-8ebc-497a-bce4-784c064b138b tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] [instance: 4b6f9c5a-d8c7-42d2-8a30-979b4f6bdaac] Fetching instance by UUID {{(pid=123458) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 09:08:26.020886 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-f4734529-8ebc-497a-bce4-784c064b138b tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:08:26.021344 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-f4734529-8ebc-497a-bce4-784c064b138b tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:08:26.022126 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-f4734529-8ebc-497a-bce4-784c064b138b tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:08:26.022570 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-f4734529-8ebc-497a-bce4-784c064b138b tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:08:26.160202 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-f4734529-8ebc-497a-bce4-784c064b138b tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fe54d1c29bf4300a2d2c9365d1d6dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aba74bd5665f48f69b0d080b09b8ade5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 09:08:26.168095 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-f4734529-8ebc-497a-bce4-784c064b138b tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] 10.222.0.31 "GET /compute/v2.1/servers/4b6f9c5a-d8c7-42d2-8a30-979b4f6bdaac" status: 200 len: 1362 microversion: 2.1 time: 0.158607 Apr 29 09:08:26.168698 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 653/1300] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 09:08:26 2022] GET /compute/v2.1/servers/4b6f9c5a-d8c7-42d2-8a30-979b4f6bdaac => generated 1362 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 09:08:27.185934 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-321926af-ce68-4569-9f93-d67cb27d74dd tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Calling method '>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 09:08:27.186498 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-321926af-ce68-4569-9f93-d67cb27d74dd tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] [instance: 4b6f9c5a-d8c7-42d2-8a30-979b4f6bdaac] Fetching instance by UUID {{(pid=123459) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 09:08:27.193423 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-321926af-ce68-4569-9f93-d67cb27d74dd tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:08:27.193863 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-321926af-ce68-4569-9f93-d67cb27d74dd tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:08:27.194651 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-321926af-ce68-4569-9f93-d67cb27d74dd tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:08:27.195077 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-321926af-ce68-4569-9f93-d67cb27d74dd tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:08:27.325361 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-321926af-ce68-4569-9f93-d67cb27d74dd tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fe54d1c29bf4300a2d2c9365d1d6dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aba74bd5665f48f69b0d080b09b8ade5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 09:08:27.333480 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-321926af-ce68-4569-9f93-d67cb27d74dd tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] 10.222.0.31 "GET /compute/v2.1/servers/4b6f9c5a-d8c7-42d2-8a30-979b4f6bdaac" status: 200 len: 1362 microversion: 2.1 time: 0.150694 Apr 29 09:08:27.333860 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 648/1301] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 09:08:27 2022] GET /compute/v2.1/servers/4b6f9c5a-d8c7-42d2-8a30-979b4f6bdaac => generated 1362 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 09:08:28.351218 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-766febfa-7a17-47b6-b97c-e70754e900c5 tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Calling method '>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 09:08:28.351747 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-766febfa-7a17-47b6-b97c-e70754e900c5 tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] [instance: 4b6f9c5a-d8c7-42d2-8a30-979b4f6bdaac] Fetching instance by UUID {{(pid=123458) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 09:08:28.358210 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-766febfa-7a17-47b6-b97c-e70754e900c5 tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:08:28.358662 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-766febfa-7a17-47b6-b97c-e70754e900c5 tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:08:28.359434 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-766febfa-7a17-47b6-b97c-e70754e900c5 tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:08:28.359876 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-766febfa-7a17-47b6-b97c-e70754e900c5 tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:08:28.490948 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-766febfa-7a17-47b6-b97c-e70754e900c5 tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fe54d1c29bf4300a2d2c9365d1d6dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aba74bd5665f48f69b0d080b09b8ade5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 09:08:28.498449 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-766febfa-7a17-47b6-b97c-e70754e900c5 tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] 10.222.0.31 "GET /compute/v2.1/servers/4b6f9c5a-d8c7-42d2-8a30-979b4f6bdaac" status: 200 len: 1362 microversion: 2.1 time: 0.152212 Apr 29 09:08:28.499025 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 654/1302] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 09:08:28 2022] GET /compute/v2.1/servers/4b6f9c5a-d8c7-42d2-8a30-979b4f6bdaac => generated 1362 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 09:08:29.516367 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-b1d21b16-254c-4420-9b91-d1d61de2079c tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Calling method '>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 09:08:29.516974 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-b1d21b16-254c-4420-9b91-d1d61de2079c tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] [instance: 4b6f9c5a-d8c7-42d2-8a30-979b4f6bdaac] Fetching instance by UUID {{(pid=123459) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 09:08:29.523299 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-b1d21b16-254c-4420-9b91-d1d61de2079c tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:08:29.523746 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-b1d21b16-254c-4420-9b91-d1d61de2079c tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:08:29.524534 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-b1d21b16-254c-4420-9b91-d1d61de2079c tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:08:29.524970 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-b1d21b16-254c-4420-9b91-d1d61de2079c tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:08:29.652862 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-b1d21b16-254c-4420-9b91-d1d61de2079c tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fe54d1c29bf4300a2d2c9365d1d6dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aba74bd5665f48f69b0d080b09b8ade5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 09:08:29.660034 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-b1d21b16-254c-4420-9b91-d1d61de2079c tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] 10.222.0.31 "GET /compute/v2.1/servers/4b6f9c5a-d8c7-42d2-8a30-979b4f6bdaac" status: 200 len: 1362 microversion: 2.1 time: 0.147594 Apr 29 09:08:29.661284 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 649/1303] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 09:08:29 2022] GET /compute/v2.1/servers/4b6f9c5a-d8c7-42d2-8a30-979b4f6bdaac => generated 1362 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 09:08:30.037198 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [req-7bec4e35-117d-491e-9c07-6fe6ca6baf25 req-7e225624-3f12-4928-b7c3-3f5ed3045bd6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4b6f9c5a-d8c7-42d2-8a30-979b4f6bdaac", "name": "network-vif-plugged", "status": "completed", "tag": "14dea86b-96df-4276-a0a6-00104aef95b8"}]} {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 29 09:08:30.045509 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [req-7bec4e35-117d-491e-9c07-6fe6ca6baf25 req-7e225624-3f12-4928-b7c3-3f5ed3045bd6 service nova] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:08:30.045948 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [req-7bec4e35-117d-491e-9c07-6fe6ca6baf25 req-7e225624-3f12-4928-b7c3-3f5ed3045bd6 service nova] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:08:30.056819 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.compute.server_external_events [req-7bec4e35-117d-491e-9c07-6fe6ca6baf25 req-7e225624-3f12-4928-b7c3-3f5ed3045bd6 service nova] Creating event network-vif-plugged:14dea86b-96df-4276-a0a6-00104aef95b8 for instance 4b6f9c5a-d8c7-42d2-8a30-979b4f6bdaac on hv-cinder-83987 Apr 29 09:08:30.061611 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [req-7bec4e35-117d-491e-9c07-6fe6ca6baf25 req-7e225624-3f12-4928-b7c3-3f5ed3045bd6 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091107 Apr 29 09:08:30.062180 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 655/1304] 10.222.0.31 () {64 vars in 1317 bytes} [Fri Apr 29 09:08:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 29 09:08:30.678711 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-c7aa9276-f272-401f-9c80-114777682669 tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Calling method '>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 09:08:30.679276 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-c7aa9276-f272-401f-9c80-114777682669 tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] [instance: 4b6f9c5a-d8c7-42d2-8a30-979b4f6bdaac] Fetching instance by UUID {{(pid=123459) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 09:08:30.685525 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-c7aa9276-f272-401f-9c80-114777682669 tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:08:30.685969 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-c7aa9276-f272-401f-9c80-114777682669 tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:08:30.686719 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-c7aa9276-f272-401f-9c80-114777682669 tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:08:30.687144 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-c7aa9276-f272-401f-9c80-114777682669 tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:08:30.814702 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-c7aa9276-f272-401f-9c80-114777682669 tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fe54d1c29bf4300a2d2c9365d1d6dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aba74bd5665f48f69b0d080b09b8ade5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 09:08:30.822011 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-c7aa9276-f272-401f-9c80-114777682669 tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] 10.222.0.31 "GET /compute/v2.1/servers/4b6f9c5a-d8c7-42d2-8a30-979b4f6bdaac" status: 200 len: 1362 microversion: 2.1 time: 0.147728 Apr 29 09:08:30.822575 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 650/1305] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 09:08:30 2022] GET /compute/v2.1/servers/4b6f9c5a-d8c7-42d2-8a30-979b4f6bdaac => generated 1362 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 09:08:31.840614 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-92a271d6-be4f-4984-a4ff-14e6e3ed2cff tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Calling method '>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 09:08:31.841317 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-92a271d6-be4f-4984-a4ff-14e6e3ed2cff tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] [instance: 4b6f9c5a-d8c7-42d2-8a30-979b4f6bdaac] Fetching instance by UUID {{(pid=123458) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 09:08:31.847502 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-92a271d6-be4f-4984-a4ff-14e6e3ed2cff tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:08:31.848454 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-92a271d6-be4f-4984-a4ff-14e6e3ed2cff tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:08:31.849307 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-92a271d6-be4f-4984-a4ff-14e6e3ed2cff tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:08:31.849756 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-92a271d6-be4f-4984-a4ff-14e6e3ed2cff tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:08:31.983975 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-92a271d6-be4f-4984-a4ff-14e6e3ed2cff tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fe54d1c29bf4300a2d2c9365d1d6dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aba74bd5665f48f69b0d080b09b8ade5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 09:08:31.992620 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-92a271d6-be4f-4984-a4ff-14e6e3ed2cff tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] 10.222.0.31 "GET /compute/v2.1/servers/4b6f9c5a-d8c7-42d2-8a30-979b4f6bdaac" status: 200 len: 1362 microversion: 2.1 time: 0.156708 Apr 29 09:08:31.993449 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 656/1306] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 09:08:31 2022] GET /compute/v2.1/servers/4b6f9c5a-d8c7-42d2-8a30-979b4f6bdaac => generated 1362 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 09:08:33.010616 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-f065d1f6-34a9-43d8-bb7a-fb4a92d03572 tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Calling method '>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 09:08:33.011218 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-f065d1f6-34a9-43d8-bb7a-fb4a92d03572 tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] [instance: 4b6f9c5a-d8c7-42d2-8a30-979b4f6bdaac] Fetching instance by UUID {{(pid=123459) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 09:08:33.017541 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-f065d1f6-34a9-43d8-bb7a-fb4a92d03572 tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:08:33.017984 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-f065d1f6-34a9-43d8-bb7a-fb4a92d03572 tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:08:33.018974 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-f065d1f6-34a9-43d8-bb7a-fb4a92d03572 tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:08:33.019408 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-f065d1f6-34a9-43d8-bb7a-fb4a92d03572 tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:08:33.150523 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-f065d1f6-34a9-43d8-bb7a-fb4a92d03572 tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fe54d1c29bf4300a2d2c9365d1d6dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aba74bd5665f48f69b0d080b09b8ade5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 09:08:33.159577 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-f065d1f6-34a9-43d8-bb7a-fb4a92d03572 tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] 10.222.0.31 "GET /compute/v2.1/servers/4b6f9c5a-d8c7-42d2-8a30-979b4f6bdaac" status: 200 len: 1548 microversion: 2.1 time: 0.152813 Apr 29 09:08:33.160223 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 651/1307] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 09:08:33 2022] GET /compute/v2.1/servers/4b6f9c5a-d8c7-42d2-8a30-979b4f6bdaac => generated 1548 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 09:08:33.175715 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-43f8f731-ea69-4c69-8eff-072cb485d86c tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Calling method '>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 09:08:33.176760 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-43f8f731-ea69-4c69-8eff-072cb485d86c tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] [instance: 4b6f9c5a-d8c7-42d2-8a30-979b4f6bdaac] Fetching instance by UUID {{(pid=123458) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 09:08:33.183341 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-43f8f731-ea69-4c69-8eff-072cb485d86c tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:08:33.183795 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-43f8f731-ea69-4c69-8eff-072cb485d86c tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:08:33.184603 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-43f8f731-ea69-4c69-8eff-072cb485d86c tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:08:33.185104 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-43f8f731-ea69-4c69-8eff-072cb485d86c tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:08:33.260835 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-43f8f731-ea69-4c69-8eff-072cb485d86c tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] 10.222.0.31 "GET /compute/v2.1/servers/4b6f9c5a-d8c7-42d2-8a30-979b4f6bdaac/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.088906 Apr 29 09:08:33.261552 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 657/1308] 10.222.0.31 () {58 vars in 1274 bytes} [Fri Apr 29 09:08:33 2022] GET /compute/v2.1/servers/4b6f9c5a-d8c7-42d2-8a30-979b4f6bdaac/os-interface => generated 284 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 29 09:08:34.645861 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [req-d1587d4d-2865-47e5-aa05-72d8674b1e48 req-9907317c-12dd-47a5-ab00-a65f0399891f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4b6f9c5a-d8c7-42d2-8a30-979b4f6bdaac", "tag": "14dea86b-96df-4276-a0a6-00104aef95b8"}]} {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 29 09:08:34.653946 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [req-d1587d4d-2865-47e5-aa05-72d8674b1e48 req-9907317c-12dd-47a5-ab00-a65f0399891f service nova] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:08:34.654392 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [req-d1587d4d-2865-47e5-aa05-72d8674b1e48 req-9907317c-12dd-47a5-ab00-a65f0399891f service nova] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:08:34.668060 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.compute.server_external_events [req-d1587d4d-2865-47e5-aa05-72d8674b1e48 req-9907317c-12dd-47a5-ab00-a65f0399891f service nova] Creating event network-changed:14dea86b-96df-4276-a0a6-00104aef95b8 for instance 4b6f9c5a-d8c7-42d2-8a30-979b4f6bdaac on hv-cinder-83987 Apr 29 09:08:34.673194 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [req-d1587d4d-2865-47e5-aa05-72d8674b1e48 req-9907317c-12dd-47a5-ab00-a65f0399891f service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.088817 Apr 29 09:08:34.674090 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 652/1309] 10.222.0.31 () {64 vars in 1317 bytes} [Fri Apr 29 09:08:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 29 09:09:33.008544 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 29 09:09:33.009093 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: Fri Apr 29 09:09:33 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 29 09:09:49.668641 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-86a76879-1a0b-4ce7-aa85-f8b78a42ff10 tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Calling method '>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 09:09:49.669256 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-86a76879-1a0b-4ce7-aa85-f8b78a42ff10 tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] [instance: 4b6f9c5a-d8c7-42d2-8a30-979b4f6bdaac] Fetching instance by UUID {{(pid=123458) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 09:09:49.674967 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-86a76879-1a0b-4ce7-aa85-f8b78a42ff10 tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:09:49.675409 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-86a76879-1a0b-4ce7-aa85-f8b78a42ff10 tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:09:49.676190 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-86a76879-1a0b-4ce7-aa85-f8b78a42ff10 tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:09:49.676626 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-86a76879-1a0b-4ce7-aa85-f8b78a42ff10 tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:09:49.699735 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-86a76879-1a0b-4ce7-aa85-f8b78a42ff10 tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] 10.222.0.31 "GET /compute/v2.1/servers/4b6f9c5a-d8c7-42d2-8a30-979b4f6bdaac/ips" status: 200 len: 145 microversion: 2.1 time: 0.085210 Apr 29 09:09:49.700303 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 658/1310] 10.222.0.31 () {58 vars in 1247 bytes} [Fri Apr 29 09:09:49 2022] GET /compute/v2.1/servers/4b6f9c5a-d8c7-42d2-8a30-979b4f6bdaac/ips => generated 145 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 29 09:09:51.018502 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-83e2fe35-1357-4c96-8828-8aedde816df0 tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b4f35be4-12bc-48f9-b696-f0be0b70856a"}} {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 29 09:09:51.019679 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-83e2fe35-1357-4c96-8828-8aedde816df0 tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] [instance: 4b6f9c5a-d8c7-42d2-8a30-979b4f6bdaac] Fetching instance by UUID {{(pid=123459) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 09:09:51.026211 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-83e2fe35-1357-4c96-8828-8aedde816df0 tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:09:51.026661 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-83e2fe35-1357-4c96-8828-8aedde816df0 tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:09:51.027426 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-83e2fe35-1357-4c96-8828-8aedde816df0 tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:09:51.027863 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-83e2fe35-1357-4c96-8828-8aedde816df0 tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:09:51.282767 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-83e2fe35-1357-4c96-8828-8aedde816df0 tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] 10.222.0.31 "POST /compute/v2.1/servers/4b6f9c5a-d8c7-42d2-8a30-979b4f6bdaac/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.269768 Apr 29 09:09:51.283368 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 653/1311] 10.222.0.31 () {60 vars in 1322 bytes} [Fri Apr 29 09:09:51 2022] POST /compute/v2.1/servers/4b6f9c5a-d8c7-42d2-8a30-979b4f6bdaac/os-volume_attachments => generated 194 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 29 09:09:58.783466 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-b50561cd-6da6-47b7-9d58-4a7051888ac4 tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Calling method '>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 09:09:58.784424 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-b50561cd-6da6-47b7-9d58-4a7051888ac4 tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] [instance: 4b6f9c5a-d8c7-42d2-8a30-979b4f6bdaac] Fetching instance by UUID {{(pid=123458) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 09:09:58.791404 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-b50561cd-6da6-47b7-9d58-4a7051888ac4 tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:09:58.791843 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-b50561cd-6da6-47b7-9d58-4a7051888ac4 tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:09:58.792678 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-b50561cd-6da6-47b7-9d58-4a7051888ac4 tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:09:58.793109 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-b50561cd-6da6-47b7-9d58-4a7051888ac4 tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:09:58.826948 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-b50561cd-6da6-47b7-9d58-4a7051888ac4 tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] 10.222.0.31 "GET /compute/v2.1/servers/4b6f9c5a-d8c7-42d2-8a30-979b4f6bdaac/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046954 Apr 29 09:09:58.827977 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 659/1312] 10.222.0.31 () {58 vars in 1301 bytes} [Fri Apr 29 09:09:58 2022] GET /compute/v2.1/servers/4b6f9c5a-d8c7-42d2-8a30-979b4f6bdaac/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 29 09:09:58.840152 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-cae3f2ce-1c09-4872-8f31-59bca3c57445 tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Calling method '>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 09:09:58.840733 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-cae3f2ce-1c09-4872-8f31-59bca3c57445 tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] [instance: 4b6f9c5a-d8c7-42d2-8a30-979b4f6bdaac] Fetching instance by UUID {{(pid=123459) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 09:09:58.846861 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-cae3f2ce-1c09-4872-8f31-59bca3c57445 tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:09:58.847301 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-cae3f2ce-1c09-4872-8f31-59bca3c57445 tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:09:58.848057 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-cae3f2ce-1c09-4872-8f31-59bca3c57445 tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:09:58.848516 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-cae3f2ce-1c09-4872-8f31-59bca3c57445 tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:09:58.876224 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-cae3f2ce-1c09-4872-8f31-59bca3c57445 tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] 10.222.0.31 "GET /compute/v2.1/servers/4b6f9c5a-d8c7-42d2-8a30-979b4f6bdaac/os-volume_attachments/b4f35be4-12bc-48f9-b696-f0be0b70856a" status: 200 len: 194 microversion: 2.1 time: 0.041902 Apr 29 09:09:58.876793 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 654/1313] 10.222.0.31 () {58 vars in 1412 bytes} [Fri Apr 29 09:09:58 2022] GET /compute/v2.1/servers/4b6f9c5a-d8c7-42d2-8a30-979b4f6bdaac/os-volume_attachments/b4f35be4-12bc-48f9-b696-f0be0b70856a => generated 194 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 29 09:10:00.200030 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-b5b4c2c3-3ae3-4cac-9ae2-93f892b9d947 tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "dfe8ad5f-0854-4865-8818-e469a62273c2"}} {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 29 09:10:00.201208 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-b5b4c2c3-3ae3-4cac-9ae2-93f892b9d947 tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] [instance: 4b6f9c5a-d8c7-42d2-8a30-979b4f6bdaac] Fetching instance by UUID {{(pid=123458) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 09:10:00.207810 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-b5b4c2c3-3ae3-4cac-9ae2-93f892b9d947 tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:10:00.208296 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-b5b4c2c3-3ae3-4cac-9ae2-93f892b9d947 tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:10:00.209911 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-b5b4c2c3-3ae3-4cac-9ae2-93f892b9d947 tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:10:00.210346 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-b5b4c2c3-3ae3-4cac-9ae2-93f892b9d947 tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:10:00.485208 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-b5b4c2c3-3ae3-4cac-9ae2-93f892b9d947 tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] 10.222.0.31 "POST /compute/v2.1/servers/4b6f9c5a-d8c7-42d2-8a30-979b4f6bdaac/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.290888 Apr 29 09:10:00.485843 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 660/1314] 10.222.0.31 () {60 vars in 1322 bytes} [Fri Apr 29 09:10:00 2022] POST /compute/v2.1/servers/4b6f9c5a-d8c7-42d2-8a30-979b4f6bdaac/os-volume_attachments => generated 194 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 29 09:10:08.012806 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-d63270e2-e9b8-4dae-bb66-6e0d0d8ef58f tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Calling method '>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 09:10:08.013544 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-d63270e2-e9b8-4dae-bb66-6e0d0d8ef58f tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] [instance: 4b6f9c5a-d8c7-42d2-8a30-979b4f6bdaac] Fetching instance by UUID {{(pid=123459) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 09:10:08.019805 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-d63270e2-e9b8-4dae-bb66-6e0d0d8ef58f tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:10:08.020529 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-d63270e2-e9b8-4dae-bb66-6e0d0d8ef58f tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:10:08.020969 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-d63270e2-e9b8-4dae-bb66-6e0d0d8ef58f tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:10:08.021409 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-d63270e2-e9b8-4dae-bb66-6e0d0d8ef58f tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:10:08.053980 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-d63270e2-e9b8-4dae-bb66-6e0d0d8ef58f tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] 10.222.0.31 "GET /compute/v2.1/servers/4b6f9c5a-d8c7-42d2-8a30-979b4f6bdaac/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.045495 Apr 29 09:10:08.054599 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 655/1315] 10.222.0.31 () {58 vars in 1301 bytes} [Fri Apr 29 09:10:08 2022] GET /compute/v2.1/servers/4b6f9c5a-d8c7-42d2-8a30-979b4f6bdaac/os-volume_attachments => generated 371 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 29 09:10:08.209567 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-35ef6fce-17da-499c-850a-4a0fd5b29991 tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Calling method '>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 09:10:08.210857 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-35ef6fce-17da-499c-850a-4a0fd5b29991 tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] [instance: 4b6f9c5a-d8c7-42d2-8a30-979b4f6bdaac] Fetching instance by UUID {{(pid=123458) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 09:10:08.216734 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-35ef6fce-17da-499c-850a-4a0fd5b29991 tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:10:08.217175 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-35ef6fce-17da-499c-850a-4a0fd5b29991 tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:10:08.217976 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-35ef6fce-17da-499c-850a-4a0fd5b29991 tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:10:08.218416 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-35ef6fce-17da-499c-850a-4a0fd5b29991 tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:10:08.251897 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-35ef6fce-17da-499c-850a-4a0fd5b29991 tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] 10.222.0.31 "GET /compute/v2.1/servers/4b6f9c5a-d8c7-42d2-8a30-979b4f6bdaac/os-volume_attachments/b4f35be4-12bc-48f9-b696-f0be0b70856a" status: 200 len: 194 microversion: 2.1 time: 0.047459 Apr 29 09:10:08.252541 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 661/1316] 10.222.0.31 () {58 vars in 1412 bytes} [Fri Apr 29 09:10:08 2022] GET /compute/v2.1/servers/4b6f9c5a-d8c7-42d2-8a30-979b4f6bdaac/os-volume_attachments/b4f35be4-12bc-48f9-b696-f0be0b70856a => generated 194 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 29 09:10:08.262722 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-38559862-f798-486a-97e7-225fc685722f tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Calling method '>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 09:10:08.263216 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-38559862-f798-486a-97e7-225fc685722f tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] [instance: 4b6f9c5a-d8c7-42d2-8a30-979b4f6bdaac] Fetching instance by UUID {{(pid=123459) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 09:10:08.269760 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-38559862-f798-486a-97e7-225fc685722f tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:10:08.270241 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-38559862-f798-486a-97e7-225fc685722f tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:10:08.271027 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-38559862-f798-486a-97e7-225fc685722f tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:10:08.271464 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-38559862-f798-486a-97e7-225fc685722f tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:10:08.361373 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.objects.instance [None req-38559862-f798-486a-97e7-225fc685722f tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Lazy-loading 'services' on Instance uuid 4b6f9c5a-d8c7-42d2-8a30-979b4f6bdaac {{(pid=123459) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 29 09:10:08.437090 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-38559862-f798-486a-97e7-225fc685722f tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] 10.222.0.31 "DELETE /compute/v2.1/servers/4b6f9c5a-d8c7-42d2-8a30-979b4f6bdaac/os-volume_attachments/b4f35be4-12bc-48f9-b696-f0be0b70856a" status: 202 len: 0 microversion: 2.1 time: 0.178102 Apr 29 09:10:08.437779 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 656/1317] 10.222.0.31 () {58 vars in 1415 bytes} [Fri Apr 29 09:10:08 2022] DELETE /compute/v2.1/servers/4b6f9c5a-d8c7-42d2-8a30-979b4f6bdaac/os-volume_attachments/b4f35be4-12bc-48f9-b696-f0be0b70856a => generated 0 bytes in 180 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 29 09:10:09.563554 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-3c9853cc-6f5c-4dc0-92a4-1e00b81fdc13 tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Calling method '>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 09:10:09.564269 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-3c9853cc-6f5c-4dc0-92a4-1e00b81fdc13 tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] [instance: 4b6f9c5a-d8c7-42d2-8a30-979b4f6bdaac] Fetching instance by UUID {{(pid=123458) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 09:10:09.580591 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-3c9853cc-6f5c-4dc0-92a4-1e00b81fdc13 tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:10:09.580591 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-3c9853cc-6f5c-4dc0-92a4-1e00b81fdc13 tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:10:09.580591 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-3c9853cc-6f5c-4dc0-92a4-1e00b81fdc13 tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:10:09.580591 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-3c9853cc-6f5c-4dc0-92a4-1e00b81fdc13 tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:10:09.607290 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-3c9853cc-6f5c-4dc0-92a4-1e00b81fdc13 tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] 10.222.0.31 "GET /compute/v2.1/servers/4b6f9c5a-d8c7-42d2-8a30-979b4f6bdaac/os-volume_attachments/dfe8ad5f-0854-4865-8818-e469a62273c2" status: 200 len: 194 microversion: 2.1 time: 0.047658 Apr 29 09:10:09.607947 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 662/1318] 10.222.0.31 () {58 vars in 1412 bytes} [Fri Apr 29 09:10:09 2022] GET /compute/v2.1/servers/4b6f9c5a-d8c7-42d2-8a30-979b4f6bdaac/os-volume_attachments/dfe8ad5f-0854-4865-8818-e469a62273c2 => generated 194 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 29 09:10:09.623565 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-62e64c34-8a67-4833-9ec9-6d01778bcc04 tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Calling method '>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 09:10:09.624201 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-62e64c34-8a67-4833-9ec9-6d01778bcc04 tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] [instance: 4b6f9c5a-d8c7-42d2-8a30-979b4f6bdaac] Fetching instance by UUID {{(pid=123459) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 09:10:09.632944 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-62e64c34-8a67-4833-9ec9-6d01778bcc04 tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:10:09.633418 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-62e64c34-8a67-4833-9ec9-6d01778bcc04 tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:10:09.634716 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-62e64c34-8a67-4833-9ec9-6d01778bcc04 tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:10:09.635508 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-62e64c34-8a67-4833-9ec9-6d01778bcc04 tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:10:09.734488 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.objects.instance [None req-62e64c34-8a67-4833-9ec9-6d01778bcc04 tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Lazy-loading 'services' on Instance uuid 4b6f9c5a-d8c7-42d2-8a30-979b4f6bdaac {{(pid=123459) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 29 09:10:09.810658 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-62e64c34-8a67-4833-9ec9-6d01778bcc04 tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] 10.222.0.31 "DELETE /compute/v2.1/servers/4b6f9c5a-d8c7-42d2-8a30-979b4f6bdaac/os-volume_attachments/dfe8ad5f-0854-4865-8818-e469a62273c2" status: 202 len: 0 microversion: 2.1 time: 0.193205 Apr 29 09:10:09.811236 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 657/1319] 10.222.0.31 () {58 vars in 1415 bytes} [Fri Apr 29 09:10:09 2022] DELETE /compute/v2.1/servers/4b6f9c5a-d8c7-42d2-8a30-979b4f6bdaac/os-volume_attachments/dfe8ad5f-0854-4865-8818-e469a62273c2 => generated 0 bytes in 198 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 29 09:10:10.997515 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-e18553d2-588a-425a-9ed7-71a00874027d tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Calling method '>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 09:10:10.998525 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-e18553d2-588a-425a-9ed7-71a00874027d tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] [instance: 4b6f9c5a-d8c7-42d2-8a30-979b4f6bdaac] Fetching instance by UUID {{(pid=123458) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 09:10:11.005878 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-e18553d2-588a-425a-9ed7-71a00874027d tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:10:11.006523 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-e18553d2-588a-425a-9ed7-71a00874027d tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:10:11.007817 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-e18553d2-588a-425a-9ed7-71a00874027d tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:10:11.008371 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-e18553d2-588a-425a-9ed7-71a00874027d tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:10:11.042816 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-e18553d2-588a-425a-9ed7-71a00874027d tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] 10.222.0.31 "GET /compute/v2.1/servers/4b6f9c5a-d8c7-42d2-8a30-979b4f6bdaac/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.049256 Apr 29 09:10:11.043425 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 663/1320] 10.222.0.31 () {58 vars in 1301 bytes} [Fri Apr 29 09:10:10 2022] GET /compute/v2.1/servers/4b6f9c5a-d8c7-42d2-8a30-979b4f6bdaac/os-volume_attachments => generated 25 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 29 09:10:11.182586 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-b189db91-9209-478a-a317-c6eedfd0dd0a tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Calling method '>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 09:10:11.184379 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-b189db91-9209-478a-a317-c6eedfd0dd0a tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] [instance: 4b6f9c5a-d8c7-42d2-8a30-979b4f6bdaac] Fetching instance by UUID {{(pid=123459) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 09:10:11.195819 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-b189db91-9209-478a-a317-c6eedfd0dd0a tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:10:11.196699 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-b189db91-9209-478a-a317-c6eedfd0dd0a tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:10:11.198341 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-b189db91-9209-478a-a317-c6eedfd0dd0a tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:10:11.199141 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-b189db91-9209-478a-a317-c6eedfd0dd0a tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:10:11.234950 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-b189db91-9209-478a-a317-c6eedfd0dd0a tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] 10.222.0.31 "GET /compute/v2.1/servers/4b6f9c5a-d8c7-42d2-8a30-979b4f6bdaac/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.058346 Apr 29 09:10:11.235641 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 658/1321] 10.222.0.31 () {58 vars in 1301 bytes} [Fri Apr 29 09:10:11 2022] GET /compute/v2.1/servers/4b6f9c5a-d8c7-42d2-8a30-979b4f6bdaac/os-volume_attachments => generated 25 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 29 09:10:11.296625 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-017126dc-8ac6-4b3d-b35a-6eedd6a3db9b tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Calling method '>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 09:10:11.297118 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-017126dc-8ac6-4b3d-b35a-6eedd6a3db9b tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] [instance: 4b6f9c5a-d8c7-42d2-8a30-979b4f6bdaac] Fetching instance by UUID {{(pid=123458) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 09:10:11.304823 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-017126dc-8ac6-4b3d-b35a-6eedd6a3db9b tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:10:11.305273 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-017126dc-8ac6-4b3d-b35a-6eedd6a3db9b tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:10:11.306086 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-017126dc-8ac6-4b3d-b35a-6eedd6a3db9b tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:10:11.306502 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-017126dc-8ac6-4b3d-b35a-6eedd6a3db9b tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:10:11.334322 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-017126dc-8ac6-4b3d-b35a-6eedd6a3db9b tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] [instance: 4b6f9c5a-d8c7-42d2-8a30-979b4f6bdaac] Going to try to terminate instance {{(pid=123458) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 29 09:10:11.432540 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-017126dc-8ac6-4b3d-b35a-6eedd6a3db9b tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] 10.222.0.31 "DELETE /compute/v2.1/servers/4b6f9c5a-d8c7-42d2-8a30-979b4f6bdaac" status: 204 len: 0 microversion: 2.1 time: 0.139105 Apr 29 09:10:11.433446 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 664/1322] 10.222.0.31 () {58 vars in 1238 bytes} [Fri Apr 29 09:10:11 2022] DELETE /compute/v2.1/servers/4b6f9c5a-d8c7-42d2-8a30-979b4f6bdaac => generated 0 bytes in 141 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Apr 29 09:10:11.442197 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-f00811ec-8d81-4850-bdc5-0d6d99127c08 tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Calling method '>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 09:10:11.442816 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-f00811ec-8d81-4850-bdc5-0d6d99127c08 tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] [instance: 4b6f9c5a-d8c7-42d2-8a30-979b4f6bdaac] Fetching instance by UUID {{(pid=123459) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 09:10:11.449909 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-f00811ec-8d81-4850-bdc5-0d6d99127c08 tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:10:11.450410 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-f00811ec-8d81-4850-bdc5-0d6d99127c08 tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:10:11.451266 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-f00811ec-8d81-4850-bdc5-0d6d99127c08 tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:10:11.451767 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-f00811ec-8d81-4850-bdc5-0d6d99127c08 tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:10:11.597351 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-f00811ec-8d81-4850-bdc5-0d6d99127c08 tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fe54d1c29bf4300a2d2c9365d1d6dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aba74bd5665f48f69b0d080b09b8ade5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 09:10:11.606943 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-f00811ec-8d81-4850-bdc5-0d6d99127c08 tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] 10.222.0.31 "GET /compute/v2.1/servers/4b6f9c5a-d8c7-42d2-8a30-979b4f6bdaac" status: 200 len: 1672 microversion: 2.1 time: 0.168761 Apr 29 09:10:11.607608 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 659/1323] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 09:10:11 2022] GET /compute/v2.1/servers/4b6f9c5a-d8c7-42d2-8a30-979b4f6bdaac => generated 1672 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 09:10:12.626375 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-69b34e23-75c4-4c72-ba59-f890d663d4ee tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Calling method '>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 09:10:12.627366 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-69b34e23-75c4-4c72-ba59-f890d663d4ee tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] [instance: 4b6f9c5a-d8c7-42d2-8a30-979b4f6bdaac] Fetching instance by UUID {{(pid=123458) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 09:10:12.637835 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-69b34e23-75c4-4c72-ba59-f890d663d4ee tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:10:12.638778 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-69b34e23-75c4-4c72-ba59-f890d663d4ee tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:10:12.640523 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-69b34e23-75c4-4c72-ba59-f890d663d4ee tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:10:12.641452 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-69b34e23-75c4-4c72-ba59-f890d663d4ee tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:10:12.840646 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.policy [None req-69b34e23-75c4-4c72-ba59-f890d663d4ee tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fe54d1c29bf4300a2d2c9365d1d6dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aba74bd5665f48f69b0d080b09b8ade5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123458) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 09:10:12.848826 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-69b34e23-75c4-4c72-ba59-f890d663d4ee tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] 10.222.0.31 "GET /compute/v2.1/servers/4b6f9c5a-d8c7-42d2-8a30-979b4f6bdaac" status: 200 len: 1672 microversion: 2.1 time: 0.227179 Apr 29 09:10:12.849424 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 665/1324] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 09:10:12 2022] GET /compute/v2.1/servers/4b6f9c5a-d8c7-42d2-8a30-979b4f6bdaac => generated 1672 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 29 09:10:13.880255 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-43dc3c6e-d7fa-48c5-a875-e4163d41919c tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Calling method '>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 09:10:13.880890 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-43dc3c6e-d7fa-48c5-a875-e4163d41919c tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] [instance: 4b6f9c5a-d8c7-42d2-8a30-979b4f6bdaac] Fetching instance by UUID {{(pid=123459) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 09:10:13.888127 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-43dc3c6e-d7fa-48c5-a875-e4163d41919c tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:10:13.888570 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-43dc3c6e-d7fa-48c5-a875-e4163d41919c tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:10:13.889376 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-43dc3c6e-d7fa-48c5-a875-e4163d41919c tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:10:13.889794 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-43dc3c6e-d7fa-48c5-a875-e4163d41919c tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:10:14.290591 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-43dc3c6e-d7fa-48c5-a875-e4163d41919c tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fe54d1c29bf4300a2d2c9365d1d6dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aba74bd5665f48f69b0d080b09b8ade5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 09:10:14.302798 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-43dc3c6e-d7fa-48c5-a875-e4163d41919c tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] 10.222.0.31 "GET /compute/v2.1/servers/4b6f9c5a-d8c7-42d2-8a30-979b4f6bdaac" status: 200 len: 1672 microversion: 2.1 time: 0.426743 Apr 29 09:10:14.304563 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 660/1325] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 09:10:13 2022] GET /compute/v2.1/servers/4b6f9c5a-d8c7-42d2-8a30-979b4f6bdaac => generated 1672 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 09:10:14.891105 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [req-a9f1085e-0435-4a0a-9c64-7a09dc819155 req-7c8a7362-0b1e-4320-b775-b73fe9263c79 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4b6f9c5a-d8c7-42d2-8a30-979b4f6bdaac", "name": "network-vif-deleted", "tag": "14dea86b-96df-4276-a0a6-00104aef95b8"}]} {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 29 09:10:14.916424 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [req-a9f1085e-0435-4a0a-9c64-7a09dc819155 req-7c8a7362-0b1e-4320-b775-b73fe9263c79 service nova] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:10:14.917371 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [req-a9f1085e-0435-4a0a-9c64-7a09dc819155 req-7c8a7362-0b1e-4320-b775-b73fe9263c79 service nova] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:10:14.940991 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.compute.server_external_events [req-a9f1085e-0435-4a0a-9c64-7a09dc819155 req-7c8a7362-0b1e-4320-b775-b73fe9263c79 service nova] Creating event network-vif-deleted:14dea86b-96df-4276-a0a6-00104aef95b8 for instance 4b6f9c5a-d8c7-42d2-8a30-979b4f6bdaac on hv-cinder-83987 Apr 29 09:10:14.948078 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [req-a9f1085e-0435-4a0a-9c64-7a09dc819155 req-7c8a7362-0b1e-4320-b775-b73fe9263c79 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064314 Apr 29 09:10:14.949366 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 666/1326] 10.222.0.31 () {64 vars in 1317 bytes} [Fri Apr 29 09:10:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 29 09:10:15.332951 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-728ea398-17e8-4305-9d3e-1187a2ca4e3b tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Calling method '>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 09:10:15.333624 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-728ea398-17e8-4305-9d3e-1187a2ca4e3b tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] [instance: 4b6f9c5a-d8c7-42d2-8a30-979b4f6bdaac] Fetching instance by UUID {{(pid=123459) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 09:10:15.344022 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-728ea398-17e8-4305-9d3e-1187a2ca4e3b tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:10:15.344825 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-728ea398-17e8-4305-9d3e-1187a2ca4e3b tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:10:15.346170 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-728ea398-17e8-4305-9d3e-1187a2ca4e3b tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:10:15.346941 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-728ea398-17e8-4305-9d3e-1187a2ca4e3b tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:10:15.386084 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-728ea398-17e8-4305-9d3e-1187a2ca4e3b tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:10:15.386537 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-728ea398-17e8-4305-9d3e-1187a2ca4e3b tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:10:15.386997 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.objects.instance [None req-728ea398-17e8-4305-9d3e-1187a2ca4e3b tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Lazy-loading 'fault' on Instance uuid 4b6f9c5a-d8c7-42d2-8a30-979b4f6bdaac {{(pid=123459) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 29 09:10:15.432434 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.policy [None req-728ea398-17e8-4305-9d3e-1187a2ca4e3b tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fe54d1c29bf4300a2d2c9365d1d6dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aba74bd5665f48f69b0d080b09b8ade5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123459) authorize /opt/stack/nova/nova/policy.py:199}} Apr 29 09:10:15.440304 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-728ea398-17e8-4305-9d3e-1187a2ca4e3b tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] 10.222.0.31 "GET /compute/v2.1/servers/4b6f9c5a-d8c7-42d2-8a30-979b4f6bdaac" status: 200 len: 1326 microversion: 2.1 time: 0.113260 Apr 29 09:10:15.440892 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 661/1327] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 09:10:15 2022] GET /compute/v2.1/servers/4b6f9c5a-d8c7-42d2-8a30-979b4f6bdaac => generated 1326 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 29 09:10:16.467230 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-a100df34-cb1f-4107-b7d1-aa51b5217503 tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Calling method '>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 09:10:16.468007 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-a100df34-cb1f-4107-b7d1-aa51b5217503 tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] [instance: 4b6f9c5a-d8c7-42d2-8a30-979b4f6bdaac] Fetching instance by UUID {{(pid=123458) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 09:10:16.475636 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-a100df34-cb1f-4107-b7d1-aa51b5217503 tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:10:16.476083 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-a100df34-cb1f-4107-b7d1-aa51b5217503 tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:10:16.476924 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-a100df34-cb1f-4107-b7d1-aa51b5217503 tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:10:16.477365 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-a100df34-cb1f-4107-b7d1-aa51b5217503 tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:10:16.491708 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.wsgi [None req-a100df34-cb1f-4107-b7d1-aa51b5217503 tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] HTTP exception thrown: Instance 4b6f9c5a-d8c7-42d2-8a30-979b4f6bdaac could not be found. Apr 29 09:10:16.492445 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-a100df34-cb1f-4107-b7d1-aa51b5217503 tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Returning 404 to user: Instance 4b6f9c5a-d8c7-42d2-8a30-979b4f6bdaac could not be found. {{(pid=123458) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 29 09:10:16.493387 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-a100df34-cb1f-4107-b7d1-aa51b5217503 tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] 10.222.0.31 "GET /compute/v2.1/servers/4b6f9c5a-d8c7-42d2-8a30-979b4f6bdaac" status: 404 len: 111 microversion: 2.1 time: 0.030289 Apr 29 09:10:16.493933 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 667/1328] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 09:10:16 2022] GET /compute/v2.1/servers/4b6f9c5a-d8c7-42d2-8a30-979b4f6bdaac => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 29 09:10:16.502314 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-497c249a-10be-46af-8c4a-1f5d41816925 tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Calling method '.version_select at 0x7f623caf59d0>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 09:10:16.524890 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-497c249a-10be-46af-8c4a-1f5d41816925 tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] 10.222.0.31 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-613605565" status: 202 len: 0 microversion: 2.1 time: 0.026272 Apr 29 09:10:16.525472 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 662/1329] 10.222.0.31 () {58 vars in 1217 bytes} [Fri Apr 29 09:10:16 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-613605565 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 29 09:10:19.404120 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-76aef623-d16c-4d9a-a8b0-0407744eeb55 tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Calling method '>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 09:10:19.405215 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-76aef623-d16c-4d9a-a8b0-0407744eeb55 tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] [instance: 4b6f9c5a-d8c7-42d2-8a30-979b4f6bdaac] Fetching instance by UUID {{(pid=123458) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 09:10:19.411726 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-76aef623-d16c-4d9a-a8b0-0407744eeb55 tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:10:19.412218 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-76aef623-d16c-4d9a-a8b0-0407744eeb55 tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:10:19.413021 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-76aef623-d16c-4d9a-a8b0-0407744eeb55 tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:10:19.414274 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-76aef623-d16c-4d9a-a8b0-0407744eeb55 tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:10:19.427805 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.wsgi [None req-76aef623-d16c-4d9a-a8b0-0407744eeb55 tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] HTTP exception thrown: Instance 4b6f9c5a-d8c7-42d2-8a30-979b4f6bdaac could not be found. Apr 29 09:10:19.428429 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-76aef623-d16c-4d9a-a8b0-0407744eeb55 tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Returning 404 to user: Instance 4b6f9c5a-d8c7-42d2-8a30-979b4f6bdaac could not be found. {{(pid=123458) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 29 09:10:19.429772 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-76aef623-d16c-4d9a-a8b0-0407744eeb55 tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] 10.222.0.31 "DELETE /compute/v2.1/servers/4b6f9c5a-d8c7-42d2-8a30-979b4f6bdaac" status: 404 len: 111 microversion: 2.1 time: 0.030264 Apr 29 09:10:19.430312 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 668/1330] 10.222.0.31 () {58 vars in 1238 bytes} [Fri Apr 29 09:10:19 2022] DELETE /compute/v2.1/servers/4b6f9c5a-d8c7-42d2-8a30-979b4f6bdaac => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 29 09:10:19.438708 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-96c78f31-7982-48eb-b97b-6357e60dbc30 tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Calling method '>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 09:10:19.439331 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-96c78f31-7982-48eb-b97b-6357e60dbc30 tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] [instance: 4b6f9c5a-d8c7-42d2-8a30-979b4f6bdaac] Fetching instance by UUID {{(pid=123459) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 09:10:19.446362 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-96c78f31-7982-48eb-b97b-6357e60dbc30 tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:10:19.446812 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-96c78f31-7982-48eb-b97b-6357e60dbc30 tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:10:19.447583 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-96c78f31-7982-48eb-b97b-6357e60dbc30 tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:10:19.448023 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-96c78f31-7982-48eb-b97b-6357e60dbc30 tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:10:19.461453 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.wsgi [None req-96c78f31-7982-48eb-b97b-6357e60dbc30 tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] HTTP exception thrown: Instance 4b6f9c5a-d8c7-42d2-8a30-979b4f6bdaac could not be found. Apr 29 09:10:19.462039 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-96c78f31-7982-48eb-b97b-6357e60dbc30 tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Returning 404 to user: Instance 4b6f9c5a-d8c7-42d2-8a30-979b4f6bdaac could not be found. {{(pid=123459) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 29 09:10:19.462865 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-96c78f31-7982-48eb-b97b-6357e60dbc30 tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] 10.222.0.31 "GET /compute/v2.1/servers/4b6f9c5a-d8c7-42d2-8a30-979b4f6bdaac" status: 404 len: 111 microversion: 2.1 time: 0.028474 Apr 29 09:10:19.463411 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 663/1331] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 09:10:19 2022] GET /compute/v2.1/servers/4b6f9c5a-d8c7-42d2-8a30-979b4f6bdaac => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 29 09:10:20.598726 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-9793f373-bd4f-4e04-a4a6-00521b56a6a7 tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Calling method '>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 09:10:20.599255 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.compute.api [None req-9793f373-bd4f-4e04-a4a6-00521b56a6a7 tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] [instance: 4e638d0d-740f-4461-a3de-b5e5a048de54] Fetching instance by UUID {{(pid=123458) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 09:10:20.606894 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-9793f373-bd4f-4e04-a4a6-00521b56a6a7 tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:10:20.607347 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-9793f373-bd4f-4e04-a4a6-00521b56a6a7 tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:10:20.608127 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-9793f373-bd4f-4e04-a4a6-00521b56a6a7 tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:10:20.608600 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG oslo_concurrency.lockutils [None req-9793f373-bd4f-4e04-a4a6-00521b56a6a7 tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:10:20.621973 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.wsgi [None req-9793f373-bd4f-4e04-a4a6-00521b56a6a7 tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] HTTP exception thrown: Instance 4e638d0d-740f-4461-a3de-b5e5a048de54 could not be found. Apr 29 09:10:20.622564 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-9793f373-bd4f-4e04-a4a6-00521b56a6a7 tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Returning 404 to user: Instance 4e638d0d-740f-4461-a3de-b5e5a048de54 could not be found. {{(pid=123458) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 29 09:10:20.623393 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-9793f373-bd4f-4e04-a4a6-00521b56a6a7 tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] 10.222.0.31 "DELETE /compute/v2.1/servers/4e638d0d-740f-4461-a3de-b5e5a048de54" status: 404 len: 111 microversion: 2.1 time: 0.028635 Apr 29 09:10:20.623933 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 669/1332] 10.222.0.31 () {58 vars in 1238 bytes} [Fri Apr 29 09:10:20 2022] DELETE /compute/v2.1/servers/4e638d0d-740f-4461-a3de-b5e5a048de54 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 29 09:10:20.632234 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-44dcc8f6-2137-4325-842d-4419ffc0e9be tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Calling method '>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 09:10:20.632856 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.compute.api [None req-44dcc8f6-2137-4325-842d-4419ffc0e9be tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] [instance: 4e638d0d-740f-4461-a3de-b5e5a048de54] Fetching instance by UUID {{(pid=123459) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 29 09:10:20.640056 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-44dcc8f6-2137-4325-842d-4419ffc0e9be tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:10:20.640537 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-44dcc8f6-2137-4325-842d-4419ffc0e9be tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:10:20.641316 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-44dcc8f6-2137-4325-842d-4419ffc0e9be tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 29 09:10:20.641747 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG oslo_concurrency.lockutils [None req-44dcc8f6-2137-4325-842d-4419ffc0e9be tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Lock "57204a03-ce3c-49ae-ada5-166fc5c6d151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 29 09:10:20.655415 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.wsgi [None req-44dcc8f6-2137-4325-842d-4419ffc0e9be tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] HTTP exception thrown: Instance 4e638d0d-740f-4461-a3de-b5e5a048de54 could not be found. Apr 29 09:10:20.655992 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-44dcc8f6-2137-4325-842d-4419ffc0e9be tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] Returning 404 to user: Instance 4e638d0d-740f-4461-a3de-b5e5a048de54 could not be found. {{(pid=123459) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 29 09:10:20.656843 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-44dcc8f6-2137-4325-842d-4419ffc0e9be tempest-AttachVolumeTestJSON-719983907 tempest-AttachVolumeTestJSON-719983907-project] 10.222.0.31 "GET /compute/v2.1/servers/4e638d0d-740f-4461-a3de-b5e5a048de54" status: 404 len: 111 microversion: 2.1 time: 0.028720 Apr 29 09:10:20.657377 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 664/1333] 10.222.0.31 () {58 vars in 1235 bytes} [Fri Apr 29 09:10:20 2022] GET /compute/v2.1/servers/4e638d0d-740f-4461-a3de-b5e5a048de54 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 29 09:10:25.295014 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-00a0b29f-ac9a-4066-a1de-c43e4b68a5a4 tempest-VolumesGetTestJSON-1856605386 tempest-VolumesGetTestJSON-1856605386-project] Action: 'create', calling method: .version_select at 0x7f6238f62160>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1066952263", "metadata": {"Type": "work"}}} {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 29 09:10:25.611572 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-00a0b29f-ac9a-4066-a1de-c43e4b68a5a4 tempest-VolumesGetTestJSON-1856605386 tempest-VolumesGetTestJSON-1856605386-project] 10.222.0.31 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 0.437562 Apr 29 09:10:25.612248 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 670/1334] 10.222.0.31 () {60 vars in 1155 bytes} [Fri Apr 29 09:10:25 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 439 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Apr 29 09:10:25.624780 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-3ca02e45-78fa-4757-bbd0-99368b20c5b2 tempest-VolumesGetTestJSON-1856605386 tempest-VolumesGetTestJSON-1856605386-project] Calling method '.version_select at 0x7f62399243a0>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 09:10:25.680053 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-3ca02e45-78fa-4757-bbd0-99368b20c5b2 tempest-VolumesGetTestJSON-1856605386 tempest-VolumesGetTestJSON-1856605386-project] 10.222.0.31 "GET /compute/v2.1/os-volumes/ccc37f07-bb96-44e0-81ae-92c8d37d5b37" status: 200 len: 353 microversion: 2.1 time: 0.059281 Apr 29 09:10:25.680661 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 665/1335] 10.222.0.31 () {58 vars in 1244 bytes} [Fri Apr 29 09:10:25 2022] GET /compute/v2.1/os-volumes/ccc37f07-bb96-44e0-81ae-92c8d37d5b37 => generated 353 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 29 09:10:26.692834 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-5a7370f1-fd6f-46c0-b270-4d52ea65057d tempest-VolumesGetTestJSON-1856605386 tempest-VolumesGetTestJSON-1856605386-project] Calling method '.version_select at 0x7f623849d040>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 09:10:26.740285 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-5a7370f1-fd6f-46c0-b270-4d52ea65057d tempest-VolumesGetTestJSON-1856605386 tempest-VolumesGetTestJSON-1856605386-project] 10.222.0.31 "GET /compute/v2.1/os-volumes/ccc37f07-bb96-44e0-81ae-92c8d37d5b37" status: 200 len: 354 microversion: 2.1 time: 0.051601 Apr 29 09:10:26.740849 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 671/1336] 10.222.0.31 () {58 vars in 1244 bytes} [Fri Apr 29 09:10:26 2022] GET /compute/v2.1/os-volumes/ccc37f07-bb96-44e0-81ae-92c8d37d5b37 => generated 354 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 29 09:10:26.753183 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-6d91a4d2-fe07-4d73-a79a-87a2d6f3a953 tempest-VolumesGetTestJSON-1856605386 tempest-VolumesGetTestJSON-1856605386-project] Calling method '.version_select at 0x7f623cc10e50>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 09:10:26.799568 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-6d91a4d2-fe07-4d73-a79a-87a2d6f3a953 tempest-VolumesGetTestJSON-1856605386 tempest-VolumesGetTestJSON-1856605386-project] 10.222.0.31 "GET /compute/v2.1/os-volumes/ccc37f07-bb96-44e0-81ae-92c8d37d5b37" status: 200 len: 354 microversion: 2.1 time: 0.051098 Apr 29 09:10:26.800152 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 666/1337] 10.222.0.31 () {58 vars in 1244 bytes} [Fri Apr 29 09:10:26 2022] GET /compute/v2.1/os-volumes/ccc37f07-bb96-44e0-81ae-92c8d37d5b37 => generated 354 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 29 09:10:26.812165 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-eaa2dcbf-da26-4a9c-9c80-448922ae51ff tempest-VolumesGetTestJSON-1856605386 tempest-VolumesGetTestJSON-1856605386-project] Calling method '.version_select at 0x7f623838f550>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 09:10:26.872030 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-eaa2dcbf-da26-4a9c-9c80-448922ae51ff tempest-VolumesGetTestJSON-1856605386 tempest-VolumesGetTestJSON-1856605386-project] 10.222.0.31 "DELETE /compute/v2.1/os-volumes/ccc37f07-bb96-44e0-81ae-92c8d37d5b37" status: 202 len: 0 microversion: 2.1 time: 0.063599 Apr 29 09:10:26.872630 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 672/1338] 10.222.0.31 () {58 vars in 1247 bytes} [Fri Apr 29 09:10:26 2022] DELETE /compute/v2.1/os-volumes/ccc37f07-bb96-44e0-81ae-92c8d37d5b37 => generated 0 bytes in 65 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Apr 29 09:10:26.881781 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-930fa8a9-70a2-48b0-b538-04bfe9773b7d tempest-VolumesGetTestJSON-1856605386 tempest-VolumesGetTestJSON-1856605386-project] Calling method '.version_select at 0x7f623caf5670>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 09:10:26.932474 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-930fa8a9-70a2-48b0-b538-04bfe9773b7d tempest-VolumesGetTestJSON-1856605386 tempest-VolumesGetTestJSON-1856605386-project] 10.222.0.31 "GET /compute/v2.1/os-volumes/ccc37f07-bb96-44e0-81ae-92c8d37d5b37" status: 200 len: 353 microversion: 2.1 time: 0.054680 Apr 29 09:10:26.933047 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 667/1339] 10.222.0.31 () {58 vars in 1244 bytes} [Fri Apr 29 09:10:26 2022] GET /compute/v2.1/os-volumes/ccc37f07-bb96-44e0-81ae-92c8d37d5b37 => generated 353 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 29 09:10:27.946001 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-31b4601f-ec2b-4b50-b2ea-a43a14f88f0a tempest-VolumesGetTestJSON-1856605386 tempest-VolumesGetTestJSON-1856605386-project] Calling method '.version_select at 0x7f6238581550>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 09:10:27.972533 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.wsgi [None req-31b4601f-ec2b-4b50-b2ea-a43a14f88f0a tempest-VolumesGetTestJSON-1856605386 tempest-VolumesGetTestJSON-1856605386-project] HTTP exception thrown: Volume ccc37f07-bb96-44e0-81ae-92c8d37d5b37 could not be found. Apr 29 09:10:27.973159 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-31b4601f-ec2b-4b50-b2ea-a43a14f88f0a tempest-VolumesGetTestJSON-1856605386 tempest-VolumesGetTestJSON-1856605386-project] Returning 404 to user: Volume ccc37f07-bb96-44e0-81ae-92c8d37d5b37 could not be found. {{(pid=123458) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 29 09:10:27.973980 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-31b4601f-ec2b-4b50-b2ea-a43a14f88f0a tempest-VolumesGetTestJSON-1856605386 tempest-VolumesGetTestJSON-1856605386-project] 10.222.0.31 "GET /compute/v2.1/os-volumes/ccc37f07-bb96-44e0-81ae-92c8d37d5b37" status: 404 len: 109 microversion: 2.1 time: 0.032895 Apr 29 09:10:27.974516 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 673/1340] 10.222.0.31 () {58 vars in 1244 bytes} [Fri Apr 29 09:10:27 2022] GET /compute/v2.1/os-volumes/ccc37f07-bb96-44e0-81ae-92c8d37d5b37 => generated 109 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 29 09:10:30.634786 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-e358938b-2563-40cc-b1e3-2966610a9518 tempest-VolumesTestJSON-964095136 tempest-VolumesTestJSON-964095136-project] Calling method '.version_select at 0x7f6239063160>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 09:10:30.681727 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-e358938b-2563-40cc-b1e3-2966610a9518 tempest-VolumesTestJSON-964095136 tempest-VolumesTestJSON-964095136-project] 10.222.0.31 "GET /compute/v2.1/os-volumes/c3196b63-bd69-4515-9be5-9bd03ea25aba" status: 200 len: 351 microversion: 2.1 time: 0.051254 Apr 29 09:10:30.682303 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 668/1341] 10.222.0.31 () {58 vars in 1244 bytes} [Fri Apr 29 09:10:30 2022] GET /compute/v2.1/os-volumes/c3196b63-bd69-4515-9be5-9bd03ea25aba => generated 351 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 29 09:10:31.992417 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-ec589589-b6f4-4835-a7e7-d03aa42c9954 tempest-VolumesTestJSON-964095136 tempest-VolumesTestJSON-964095136-project] Calling method '.version_select at 0x7f6238581550>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 09:10:32.037377 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-ec589589-b6f4-4835-a7e7-d03aa42c9954 tempest-VolumesTestJSON-964095136 tempest-VolumesTestJSON-964095136-project] 10.222.0.31 "GET /compute/v2.1/os-volumes/34f4afd4-1549-4ca7-a2df-8d789ab860fc" status: 200 len: 351 microversion: 2.1 time: 0.050131 Apr 29 09:10:32.037959 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 674/1342] 10.222.0.31 () {58 vars in 1244 bytes} [Fri Apr 29 09:10:31 2022] GET /compute/v2.1/os-volumes/34f4afd4-1549-4ca7-a2df-8d789ab860fc => generated 351 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 29 09:10:33.362846 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-8148d06e-6080-4ec4-b6d7-09289aa76cfb tempest-VolumesTestJSON-964095136 tempest-VolumesTestJSON-964095136-project] Calling method '.version_select at 0x7f623caf54c0>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 09:10:33.408670 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-8148d06e-6080-4ec4-b6d7-09289aa76cfb tempest-VolumesTestJSON-964095136 tempest-VolumesTestJSON-964095136-project] 10.222.0.31 "GET /compute/v2.1/os-volumes/82e0c60c-5095-426e-a0be-60687779aded" status: 200 len: 351 microversion: 2.1 time: 0.049948 Apr 29 09:10:33.409243 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 669/1343] 10.222.0.31 () {58 vars in 1244 bytes} [Fri Apr 29 09:10:33 2022] GET /compute/v2.1/os-volumes/82e0c60c-5095-426e-a0be-60687779aded => generated 351 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 29 09:10:33.421465 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-2905d575-c9ac-42ee-9e00-7b1f2fd89658 tempest-VolumesTestJSON-964095136 tempest-VolumesTestJSON-964095136-project] Calling method '.version_select at 0x7f623824c820>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 09:10:33.501091 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-2905d575-c9ac-42ee-9e00-7b1f2fd89658 tempest-VolumesTestJSON-964095136 tempest-VolumesTestJSON-964095136-project] 10.222.0.31 "GET /compute/v2.1/os-volumes" status: 200 len: 1036 microversion: 2.1 time: 0.083746 Apr 29 09:10:33.501659 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 675/1344] 10.222.0.31 () {58 vars in 1133 bytes} [Fri Apr 29 09:10:33 2022] GET /compute/v2.1/os-volumes => generated 1036 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 09:10:33.514265 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-b322b13b-dc13-45b2-b893-2aceb914180c tempest-VolumesTestJSON-964095136 tempest-VolumesTestJSON-964095136-project] Calling method '.version_select at 0x7f623caf58b0>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 09:10:33.592558 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-b322b13b-dc13-45b2-b893-2aceb914180c tempest-VolumesTestJSON-964095136 tempest-VolumesTestJSON-964095136-project] 10.222.0.31 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.081957 Apr 29 09:10:33.593138 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 670/1345] 10.222.0.31 () {58 vars in 1148 bytes} [Fri Apr 29 09:10:33 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 695 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 29 09:10:33.605244 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-6252de6f-b983-44df-9884-238a40c78d2a tempest-VolumesTestJSON-964095136 tempest-VolumesTestJSON-964095136-project] Calling method '.version_select at 0x7f62380e75e0>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 09:10:33.686327 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-6252de6f-b983-44df-9884-238a40c78d2a tempest-VolumesTestJSON-964095136 tempest-VolumesTestJSON-964095136-project] 10.222.0.31 "GET /compute/v2.1/os-volumes" status: 200 len: 1036 microversion: 2.1 time: 0.085268 Apr 29 09:10:33.686891 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 676/1346] 10.222.0.31 () {58 vars in 1133 bytes} [Fri Apr 29 09:10:33 2022] GET /compute/v2.1/os-volumes => generated 1036 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 09:10:33.698947 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-c77f345f-54d9-4ff0-a3e5-3bc80ed4a38f tempest-VolumesTestJSON-964095136 tempest-VolumesTestJSON-964095136-project] Calling method '.version_select at 0x7f623caf5160>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 09:10:33.780861 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-c77f345f-54d9-4ff0-a3e5-3bc80ed4a38f tempest-VolumesTestJSON-964095136 tempest-VolumesTestJSON-964095136-project] 10.222.0.31 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.086575 Apr 29 09:10:33.781551 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 671/1347] 10.222.0.31 () {58 vars in 1166 bytes} [Fri Apr 29 09:10:33 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 29 09:10:33.793289 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-80faa69e-a4fe-4768-a558-9606f4bef8ea tempest-VolumesTestJSON-964095136 tempest-VolumesTestJSON-964095136-project] Calling method '.version_select at 0x7f62380ea430>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 09:10:33.874702 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-80faa69e-a4fe-4768-a558-9606f4bef8ea tempest-VolumesTestJSON-964095136 tempest-VolumesTestJSON-964095136-project] 10.222.0.31 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.085227 Apr 29 09:10:33.875271 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 677/1348] 10.222.0.31 () {58 vars in 1169 bytes} [Fri Apr 29 09:10:33 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 695 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 29 09:10:33.887887 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-9e86a953-0362-463f-8abd-e8f9472d0051 tempest-VolumesTestJSON-964095136 tempest-VolumesTestJSON-964095136-project] Calling method '.version_select at 0x7f62385b6af0>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 09:10:33.969296 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-9e86a953-0362-463f-8abd-e8f9472d0051 tempest-VolumesTestJSON-964095136 tempest-VolumesTestJSON-964095136-project] 10.222.0.31 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1036 microversion: 2.1 time: 0.085105 Apr 29 09:10:33.969872 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 672/1349] 10.222.0.31 () {58 vars in 1154 bytes} [Fri Apr 29 09:10:33 2022] GET /compute/v2.1/os-volumes/detail => generated 1036 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 09:10:33.980779 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-7af4afd3-1179-48db-91de-50c22090f9bc tempest-VolumesTestJSON-964095136 tempest-VolumesTestJSON-964095136-project] Calling method '.version_select at 0x7f62380e7040>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 09:10:34.066035 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-7af4afd3-1179-48db-91de-50c22090f9bc tempest-VolumesTestJSON-964095136 tempest-VolumesTestJSON-964095136-project] 10.222.0.31 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.088931 Apr 29 09:10:34.066604 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 678/1350] 10.222.0.31 () {58 vars in 1187 bytes} [Fri Apr 29 09:10:33 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 29 09:10:34.078642 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-f7bfb363-eee0-42d2-839d-94c6953f79ee tempest-VolumesTestJSON-964095136 tempest-VolumesTestJSON-964095136-project] Calling method '.version_select at 0x7f623cc75700>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 09:10:34.157530 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-f7bfb363-eee0-42d2-839d-94c6953f79ee tempest-VolumesTestJSON-964095136 tempest-VolumesTestJSON-964095136-project] 10.222.0.31 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1036 microversion: 2.1 time: 0.082569 Apr 29 09:10:34.158100 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 673/1351] 10.222.0.31 () {58 vars in 1154 bytes} [Fri Apr 29 09:10:34 2022] GET /compute/v2.1/os-volumes/detail => generated 1036 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 29 09:10:38.944414 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-4434de30-8cfb-47cc-9151-65d9065880f8 tempest-VolumesNegativeTest-956207891 tempest-VolumesNegativeTest-956207891-project] Action: 'create', calling method: .version_select at 0x7f6238581550>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-727706475", "metadata": {"Type": "work"}}} {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 29 09:10:38.945928 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-4434de30-8cfb-47cc-9151-65d9065880f8 tempest-VolumesNegativeTest-956207891 tempest-VolumesNegativeTest-956207891-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=123458) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 29 09:10:38.946592 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-4434de30-8cfb-47cc-9151-65d9065880f8 tempest-VolumesNegativeTest-956207891 tempest-VolumesNegativeTest-956207891-project] 10.222.0.31 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.115473 Apr 29 09:10:38.947115 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 679/1352] 10.222.0.31 () {60 vars in 1155 bytes} [Fri Apr 29 09:10:38 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 116 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 29 09:10:38.956752 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-5c3f83f6-ba2b-4038-af5d-1e906bb5c700 tempest-VolumesNegativeTest-956207891 tempest-VolumesNegativeTest-956207891-project] Action: 'create', calling method: .version_select at 0x7f623cc75940>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1525883516", "metadata": {"Type": "work"}}} {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 29 09:10:38.958133 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-5c3f83f6-ba2b-4038-af5d-1e906bb5c700 tempest-VolumesNegativeTest-956207891 tempest-VolumesNegativeTest-956207891-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=123459) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 29 09:10:38.958918 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-5c3f83f6-ba2b-4038-af5d-1e906bb5c700 tempest-VolumesNegativeTest-956207891 tempest-VolumesNegativeTest-956207891-project] 10.222.0.31 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.006500 Apr 29 09:10:38.959480 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 674/1353] 10.222.0.31 () {60 vars in 1155 bytes} [Fri Apr 29 09:10:38 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 7 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 29 09:10:38.969710 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-39826571-0ba1-464c-9171-b0607a13cae8 tempest-VolumesNegativeTest-956207891 tempest-VolumesNegativeTest-956207891-project] Action: 'create', calling method: .version_select at 0x7f623839db80>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-73445632", "metadata": {"Type": "work"}}} {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 29 09:10:38.970838 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-39826571-0ba1-464c-9171-b0607a13cae8 tempest-VolumesNegativeTest-956207891 tempest-VolumesNegativeTest-956207891-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=123458) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 29 09:10:38.971630 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-39826571-0ba1-464c-9171-b0607a13cae8 tempest-VolumesNegativeTest-956207891 tempest-VolumesNegativeTest-956207891-project] 10.222.0.31 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.007665 Apr 29 09:10:38.972375 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 680/1354] 10.222.0.31 () {60 vars in 1155 bytes} [Fri Apr 29 09:10:38 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 9 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 29 09:10:38.981445 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-2454396f-5e7a-4bbe-8c02-8189733bfc9d tempest-VolumesNegativeTest-956207891 tempest-VolumesNegativeTest-956207891-project] Calling method '.version_select at 0x7f6239046940>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 09:10:39.008665 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.wsgi [None req-2454396f-5e7a-4bbe-8c02-8189733bfc9d tempest-VolumesNegativeTest-956207891 tempest-VolumesNegativeTest-956207891-project] HTTP exception thrown: Volume tempest-invalid-408015513 could not be found. Apr 29 09:10:39.009311 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-2454396f-5e7a-4bbe-8c02-8189733bfc9d tempest-VolumesNegativeTest-956207891 tempest-VolumesNegativeTest-956207891-project] Returning 404 to user: Volume tempest-invalid-408015513 could not be found. {{(pid=123459) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 29 09:10:39.010106 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-2454396f-5e7a-4bbe-8c02-8189733bfc9d tempest-VolumesNegativeTest-956207891 tempest-VolumesNegativeTest-956207891-project] 10.222.0.31 "DELETE /compute/v2.1/os-volumes/tempest-invalid-408015513" status: 404 len: 98 microversion: 2.1 time: 0.032339 Apr 29 09:10:39.010642 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 675/1355] 10.222.0.31 () {58 vars in 1214 bytes} [Fri Apr 29 09:10:38 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-408015513 => generated 98 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Apr 29 09:10:39.019380 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-be71eb8f-160c-46d6-90b9-e0dbf2442bf7 tempest-VolumesNegativeTest-956207891 tempest-VolumesNegativeTest-956207891-project] 10.222.0.31 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003683 Apr 29 09:10:39.019865 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 681/1356] 10.222.0.31 () {58 vars in 1139 bytes} [Fri Apr 29 09:10:39 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Apr 29 09:10:39.027670 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-736eaeb0-a4ab-4b80-ae37-f51976298efd tempest-VolumesNegativeTest-956207891 tempest-VolumesNegativeTest-956207891-project] 10.222.0.31 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003653 Apr 29 09:10:39.028185 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 676/1357] 10.222.0.31 () {58 vars in 1136 bytes} [Fri Apr 29 09:10:39 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Apr 29 09:10:39.035946 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-d27114c3-3737-4b2a-9370-7154468b81df tempest-VolumesNegativeTest-956207891 tempest-VolumesNegativeTest-956207891-project] Calling method '.version_select at 0x7f62380e78b0>' {{(pid=123458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 09:10:39.063308 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.wsgi [None req-d27114c3-3737-4b2a-9370-7154468b81df tempest-VolumesNegativeTest-956207891 tempest-VolumesNegativeTest-956207891-project] HTTP exception thrown: Volume 12a46619-585a-49b3-a1bb-7adb593cfd86 could not be found. Apr 29 09:10:39.063894 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: DEBUG nova.api.openstack.wsgi [None req-d27114c3-3737-4b2a-9370-7154468b81df tempest-VolumesNegativeTest-956207891 tempest-VolumesNegativeTest-956207891-project] Returning 404 to user: Volume 12a46619-585a-49b3-a1bb-7adb593cfd86 could not be found. {{(pid=123458) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 29 09:10:39.064752 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO nova.api.openstack.requestlog [None req-d27114c3-3737-4b2a-9370-7154468b81df tempest-VolumesNegativeTest-956207891 tempest-VolumesNegativeTest-956207891-project] 10.222.0.31 "DELETE /compute/v2.1/os-volumes/12a46619-585a-49b3-a1bb-7adb593cfd86" status: 404 len: 109 microversion: 2.1 time: 0.032298 Apr 29 09:10:39.065399 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: [pid: 123458|app: 0|req: 682/1358] 10.222.0.31 () {58 vars in 1247 bytes} [Fri Apr 29 09:10:39 2022] DELETE /compute/v2.1/os-volumes/12a46619-585a-49b3-a1bb-7adb593cfd86 => generated 109 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Apr 29 09:10:39.074263 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-6d04f16c-9f88-4332-9f8d-0b68f6261079 tempest-VolumesNegativeTest-956207891 tempest-VolumesNegativeTest-956207891-project] Calling method '.version_select at 0x7f623cc10ca0>' {{(pid=123459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 29 09:10:39.099829 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.wsgi [None req-6d04f16c-9f88-4332-9f8d-0b68f6261079 tempest-VolumesNegativeTest-956207891 tempest-VolumesNegativeTest-956207891-project] HTTP exception thrown: Volume 86981e07-a367-4c9d-9f24-387ff191bcb6 could not be found. Apr 29 09:10:39.100448 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: DEBUG nova.api.openstack.wsgi [None req-6d04f16c-9f88-4332-9f8d-0b68f6261079 tempest-VolumesNegativeTest-956207891 tempest-VolumesNegativeTest-956207891-project] Returning 404 to user: Volume 86981e07-a367-4c9d-9f24-387ff191bcb6 could not be found. {{(pid=123459) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 29 09:10:39.101275 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO nova.api.openstack.requestlog [None req-6d04f16c-9f88-4332-9f8d-0b68f6261079 tempest-VolumesNegativeTest-956207891 tempest-VolumesNegativeTest-956207891-project] 10.222.0.31 "GET /compute/v2.1/os-volumes/86981e07-a367-4c9d-9f24-387ff191bcb6" status: 404 len: 109 microversion: 2.1 time: 0.030808 Apr 29 09:10:39.102357 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: [pid: 123459|app: 0|req: 677/1359] 10.222.0.31 () {58 vars in 1244 bytes} [Fri Apr 29 09:10:39 2022] GET /compute/v2.1/os-volumes/86981e07-a367-4c9d-9f24-387ff191bcb6 => generated 109 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 29 09:11:10.600444 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 29 09:11:10.601301 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: Fri Apr 29 09:11:10 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 29 09:11:15.134979 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 29 09:11:15.135585 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: Fri Apr 29 09:11:15 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 29 09:12:53.017099 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 29 09:12:53.017900 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: Fri Apr 29 09:12:53 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 29 09:13:09.244287 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 29 09:13:09.244908 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: Fri Apr 29 09:13:09 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 29 09:13:22.357859 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 29 09:13:22.358479 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: Fri Apr 29 09:13:22 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 29 09:14:30.610130 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 29 09:14:30.610773 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: Fri Apr 29 09:14:30 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 29 09:14:35.143578 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 29 09:14:35.144159 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: Fri Apr 29 09:14:35 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 29 09:15:29.249486 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 29 09:15:29.250133 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: Fri Apr 29 09:15:29 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 29 09:16:13.027351 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 29 09:16:13.028024 dv-cinder-839872-1-iscsi devstack@n-api.service[123458]: Fri Apr 29 09:16:13 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 29 09:16:29.253069 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 29 09:16:29.253677 dv-cinder-839872-1-iscsi devstack@n-api.service[123459]: Fri Apr 29 09:16:29 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!